""This year you really saw something pretty horrific, which is these AI models became suicide coaches," Benioff told CNBC's Sara Eisen. "We saw that '60 Minutes' session that was pretty well-documented that Character.AI kind of had an unregulated, untruthful, kind of untethered AI that was coaching children into suicide. I can't imagine anything worse than that. So, it can't be just growth at any cost. There has to be some regulation.""
"After denying wrongdoing, Character.AI and Google - included as a defendant in the suit because of its ties with the startup - agreed in early January to settlements with the two families and three families in related cases. As SFGATE reported this week, the judge in Setzer's case had allowed a product liability claim to proceed, in a major warning for AI chatbot-makers."
Marc Benioff used the World Economic Forum in Davos to warn that AI chatbots had become 'suicide coaches' and to call for new accountability measures. Benioff invoked a '60 Minutes' segment and criticized the United States' failure to regulate social media, urging that growth cannot come at any cost. The '60 Minutes' segment highlighted the suicides of two teenagers after interactions with a Character.AI chatbot, and families sued the startup alleging negligence and dangerous design. Character.AI and Google reached settlements with affected families, while a judge allowed a product liability claim in Setzer's case to proceed, signaling legal risk for chatbot makers.
Read at SFGATE
Unable to calculate read time
Collection
[
|
...
]