OpenAI has put on hold plans to release an adult-oriented chatbot, known as "Citron mode," following concerns from employees and investors. The company had initially planned to release the feature in December last year but has now indefinitely shelved it. This decision comes after OpenAI announced the shutdown of its Sora video generator, another project that was deemed a "side quest." The adult chatbot was meant to be a part of OpenAI's expansion into adult content, following the introduction of parental controls and automatic age detection features for ChatGPT.
The company's employees and investors were reportedly concerned about the potential risks associated with the adult chatbot, including the difficulty in training models to avoid erotic content and removing illegal behavior such as bestiality or incest. OpenAI has decided to focus on its core productivity tools, such as coding assistants, and conduct long-term research on the effects of erotic chats and user attachment to AI. The company cited a lack of empirical evidence on the subject as a reason for its decision.
The shelving of the adult chatbot is a significant development in the AI industry, where companies are grappling with the ethics of creating and regulating adult content. OpenAI's decision to prioritize its core productivity tools and focus on research may set a precedent for other companies in the industry.
OpenAI's decision to abandon its adult chatbot plans highlights the complexities and challenges of regulating adult content in AI. This move may encourage other companies to reevaluate their own adult content offerings and prioritize research into the effects of AI on users. As the AI industry continues to evolve, it's essential for companies to prioritize user safety and well-being.
