AI Giants Divided On The Ethics Of Erotic Chatbots

A clear line is being drawn in the sand within the artificial intelligence industry, specifically around the controversial topic of AI-generated erotica. Microsoft's AI CEO, Mustafa Suleyman, has taken a firm stance, warning that such capabilities can be "very dangerous" and confirming that Microsoft will not be providing this type of service.

This position stands in stark contrast to moves made by key players like OpenAI and xAI. Elon Musk, CEO of xAI, has indicated his AI bot, Grok, could function as a companion for subscribers. Similarly, OpenAI CEO Sam Altman recently announced that ChatGPT would soon offer erotic content to verified adult users, framing the decision as part of an ethos to “treat adult users like adults” and allow them the freedom to use AI as they wish. In a post on X, Altman emphasized that his company is “not the elected moral police of the world.”

A Widening Rift Between Microsoft and OpenAI

The divergence on AI erotica highlights a growing separation between Microsoft and OpenAI, who were once considered close partners. Microsoft has been a colossal supporter of the AI startup, providing $13 billion in investments and computing power since 2019. However, recent events suggest a shift in their relationship.

OpenAI reportedly signed a massive $300 billion computing deal with Oracle, a direct competitor to Microsoft. Meanwhile, Microsoft is heavily investing in its own AI software, including its planned fall release of Copilot, which promises “human-centered” AI tools.

Suleyman's concerns are not new. He has previously warned against the development of AI systems that closely mimic human behavior, arguing it makes them harder to regulate. He reiterated this point, stating, “You can already see it with some of these avatars and people leaning into the kind of sexbot, erotica direction. This is very dangerous, and I think we should be making conscious decisions to avoid those kinds of things.”

When asked for comment, OpenAI did not respond, while xAI replied: “Legacy Media Lies.”

The Controversy Over Erotic Chatbots

The decision by OpenAI and xAI to explore sexual content has drawn criticism from outside the immediate AI development community as well. Billionaire investor Mark Cuban cautioned that the move could backfire significantly.

In a response to Altman on X, Cuban warned, “No parent is going to trust that their kids can’t get through your age gating. They will just push their kids to every other LLM. Why take the risk?”

Experts note the difficult position OpenAI occupies. Jessica Ji, a senior research analyst at Georgetown’s Center for Security and Emerging Technology, told Fortune that the company must balance market demand for features like erotic content with its public commitment to building AI that benefits all of humanity.

“Despite some of the narratives around building artificial general intelligence that will supercharge the economy, OpenAI is still trying to operate as a technology platform, and somewhat like a social media company,” Ji explained. This creates an “interesting tension” between the vision sold to investors and the practical realities of the market.