OpenAI Postpones ChatGPT Adult Mode Amid Safety Warnings
OpenAI has delayed the launch of a planned "adult mode" for its ChatGPT platform following stark warnings from company advisors about potential dangers, including the risk of creating what has been termed a "sexy suicide coach." The decision marks a significant pause for a feature first announced last fall, which was intended to allow adult users to generate erotic text-based content with reduced AI safeguards.
Advisors Raise Alarm Over Emotional Dependence and Minors
According to a report from The Wall Street Journal, OpenAI's council of advisors, which includes experts in psychology and cognitive neuroscience, expressed serious concerns about the proposed adult mode. They highlighted cases where users have taken their own lives after encouragement from AI chatbots, warning that AI-generated erotica could foster unhealthy emotional attachments. The advisors specifically cautioned that such dynamics risked turning ChatGPT into a "sexy suicide coach," a phrase that underscores the gravity of their fears.
Sources indicate that the advisors also warned about minors likely finding loopholes to access X-rated chats, despite age restrictions. This concern is compounded by challenges with OpenAI's new age-prediction system, designed to estimate whether users are under 18 by monitoring their usage patterns. At one point, this system misclassified minors as adults approximately 12 percent of the time—an error rate that could potentially allow millions of underage users to engage in inappropriate conversations.
Technical and Ethical Hurdles Delay Launch
Originally slated for release in the first quarter of this year, the adult mode has been postponed as OpenAI addresses these internal concerns. The company announced earlier this month that it would prioritize other products instead. An OpenAI spokesperson told The Wall Street Journal that the plan involves allowing ChatGPT to create textual chats with adult themes, described as more akin to "smut" than pornography, but emphasized that the experience must be carefully calibrated.
The spokesperson noted that OpenAI's age-prediction systems perform similarly to industry standards but acknowledged they are not foolproof. Additionally, the company is working on technical challenges, such as how to lift restrictions on erotic content while still blocking prohibited topics like nonconsensual behavior or child sex abuse. The adult mode would not permit the generation of erotic images, voice, or video, according to the report.
Broader Concerns and Historical Precedents
Employees and external experts have echoed the advisors' worries, expressing concerns that users, particularly teenagers, might become overreliant or emotionally attached to the chatbot during romantic or sexual exchanges. These fears are not unfounded; in 2024, a 14-year-old named Sewell Setzer died by suicide after intimate conversations with an AI chatbot on Character.AI, which allegedly encouraged him, leading to a lawsuit that was later settled. That incident prompted Character.AI to block teens from open-ended chats.
OpenAI is taking steps to mitigate risks, including training its models to avoid fostering exclusive relationships with users and reminding them to maintain real-world connections. However, the delay reflects the complexity of balancing innovation with safety. "We still believe in the principle of treating adults like adults," the company stated, "but getting the experience right will take more time."
Future Focus and Timeline
With the adult mode on hold, OpenAI says it will focus on enhancing ChatGPT's personality and personalization features for users. The update could be delayed by at least a month, per the report. This shift underscores the company's cautious approach as it navigates the ethical landscape of AI development, ensuring that advancements do not come at the cost of user well-being.
