OpenAI’s adult mode reportedly won’t generate pornographic audio, images or video

OpenAI’s forthcoming “adult mode” will allow users to engage in lewd conversations with ChatGPT, but not use the chatbot to generate explicit images, audio or video. In response to reporting from The Wall Street Journal, an OpenAI spokesperson characterized the upcoming release as capable of producing smut rather than pornography.

OpenAI CEO Sam Altman first floated the idea of allowing people to use ChatGPT for erotica last October, saying the company wanted to “treat adult users like adults.” OpenAI originally planned to release adult mode at the start of 2026. Since then, the company has pushed back the feature a handful of times, with the most recent delay coming at the start of March so that OpenAI could “focus on work that is a higher priority for more users.”

Through The Journal’s reporting, we’re learning OpenAI forged ahead with work on adult mode despite reservations from its council on wellbeing and AI. The group of eight researchers and experts were reportedly unanimous in warning the company AI-generated erotica could lead to people developing an unhealthy emotional dependence on ChatGPT, and that underage users would almost certainly find ways to access the feature. According to The Journal, one council member, citing cases where people have taken their own lives after becoming attached to ChatGPT, said the company was at risk of creating a “sexy suicide coach.”

Those concerns appear to have been well-founded. At one point, the company’s age verification technology was misidentifying underage users as adults about 12 percent of the time, according to The Journal. At OpenAI’s scale, with around 100 million teens using ChatGPT every week, that error rate would have translated to millions of minors accessing erotic chats. OpenAI told The Journal its prediction algorithm performs to industry standards, adding no such system will ever be completely foolproof.

This article originally appeared on Engadget at https://www.engadget.com/ai/openais-adult-mode-reportedly-wont-generate-pornographic-audio-images-or-video-150744035.html?src=rss

Read more @ Engadget

Latest posts

X agrees to crack down on illegal hate and terror content in the UK

British online safety regulator Ofcom says it has accepted new commitments from X that aim to better protect UK users from seeing illegal hate...

Bose’s new Lifestyle Ultra speakers are now available

Sonos has a new rival in town. Bose’s new Lifestyle Collection includes a $299 Lifestyle Ultra Speaker, a $1,099 Lifestyle Ultra Soundbar, and the...

X is fighting Andrew Tate’s attempt to unmask his critics

X is fighting for its users' right to anonymity against the far-right influencers and accused human traffickers Andrew and Tristan Tate, who are seeking...

The promises and pitfalls of personalized health

This is Optimizer, a weekly newsletter sent every Friday from Verge senior reviewer Victoria Song that dissects and discusses the latest gizmos and potions...

The funniest thing about the Trump arcade game is how good it is

This week, a trio of video game cabinets emblazoned with pixel art of Donald Trump and a number of other government officials' faces suddenly...

BioLite’s stakeable solar lights are down to a new low price for Memorial Day

The Memorial Day deals have arrived — err, at least some of them. BioLite, purveyors of all things solar, has kicked off a larger...

OpenAI now wants ChatGPT to access your bank accounts

ChatGPT will even know how much credit card debt you have. | Image: OpenAI Your trust in AI is about to be put to the...

Do you like Google’s new 3D emoji designs for Pixel and Android 17? [Poll]

While Android 17 itself wasn’t really a focus of “The Android Show” earlier this week, we did hear about a few new changes coming....

Honor says Robot Phone will launch before September ends with ARRI camera upgrades

The Honor Robot Phone is an interesting concept, but one that’s also felt a little like it might not be real. Honor says it’s...

Fitbit 4.69 rolls out with redesign of focus stats and logging

Google has rolled out version 4.69 of Fitbit for Android as the last update before the Google Health rebrand. Read more @ 9to5google