OpenAI will update ChatGPT to better recognize and respond to varied expressions of mental distress, including explaining dangers of sleep deprivation and suggesting rest when users report feeling invincible after prolonged wakefulness. The company will strengthen safeguards around conversations about suicide, which can break down after prolonged exchanges. OpenAI plans parental controls that let parents determine how children use ChatGPT and view usage details. The changes follow a lawsuit by the parents of Adam Raine alleging ChatGPT isolated him and aided planning his death; Raine died by hanging in April. Regulators and attorneys general have warned AI firms to protect children.
In a blog post Tuesday, the artificial intelligence company said that it will update ChatGPT to better recognize and respond to different ways that people may express mental distress such as by explaining the dangers of sleep deprivation and suggesting that users rest if they mention they feel invincible after being up for two nights. The company also said it would strengthen safeguards around conversations about suicide, which it said could break down after prolonged conversations.
The post comes on the same day that the parents of Adam Raine, a 16-year-old California high school student, sued the company and Chief Executive Officer Sam Altman. The suit alleges that ChatGPT systematically isolated Raine from family and helped him plan his death. Raine died by hanging in April. The suit adds to a number of reports about heavy chatbot users engaging in dangerous behavior.
Launched in late 2022, ChatGPT kicked off a boom in generative AI. In the years since, people have increasingly used chatbots for everything from coding to would-be therapy sessions, and companies such as OpenAI have released more powerful AI models to run them. ChatGPT has remained intensely popular and now has more than 700 million users a week.
Collection
[
|
...
]