OpenAI’s own mental health experts unanimously opposed “naughty” ChatGPT launch (arstechnica.com)

OpenAI is facing significant backlash over its planned launch of an "adult mode" for ChatGPT, following unanimous opposition from its advisory council on well-being and AI. Insiders revealed that the council, established to address mental health concerns after a minor's suicide linked to ChatGPT, is alarmed that AI-generated erotica could encourage unhealthy emotional dependencies and potentially expose minors to inappropriate content. Experts warned that without major improvements to the safety and ethical guidelines of the platform, users at risk could develop harmful attachments to the AI, with one expert ominously suggesting it could result in a “sexy suicide coach” scenario for vulnerable individuals. The implications of this controversy are profound for the AI/ML community, emphasizing the need for responsible AI development that prioritizes user safety and mental health. As the council does not include a suicide prevention expert, the oversight raises questions about the adequacy of OpenAI's precautions against potential misuse of the technology. With recent reports of ChatGPT potentially worsening the situations of already vulnerable individuals, OpenAI's adherence to ethical standards and user safeguards is under scrutiny as it navigates the balance between innovation and social responsibility.