"Through The Journal's reporting, we're learning OpenAI forged ahead with work on adult mode despite reservations from its council on wellbeing and AI. The group of eight researchers and experts were reportedly unanimous in warning the company AI-generated erotica could lead to people developing an unhealthy emotional dependence on ChatGPT, and that underage users would almost certainly find ways to access the feature."
"At one point, the company's age verification technology was misidentifying underage users as adults about 12 percent of the time, according to The Journal. At OpenAI's scale, with around 100 million teens using ChatGPT every week, that error rate would have translated to millions of minors accessing erotic chats."
"According to The Journal, one council member, citing cases where people have taken their own lives after becoming attached to ChatGPT, said the company was at risk of creating a 'sexy suicide coach.'"
OpenAI is proceeding with an 'adult mode' feature for ChatGPT that permits users to engage in lewd text conversations, though not generate explicit images, audio, or video. CEO Sam Altman proposed this feature in October, framing it as treating adult users appropriately. The release has been delayed multiple times, most recently in March. OpenAI's internal council on wellbeing and AI unanimously opposed the feature, warning of unhealthy emotional dependence on the chatbot and inevitable underage access. Council members cited cases of user deaths linked to ChatGPT attachment, expressing concern about creating a 'sexy suicide coach.' Age verification technology showed a 12 percent error rate misidentifying minors as adults, potentially exposing millions of weekly teen users to erotic content.
Read at Engadget
Unable to calculate read time
Collection
[
|
...
]