"She explained that she had four kids, including a son with autism who wasn't allowed on social media but found C.AI's app-which was previously marketed to kids under 12 and let them talk to bots branded as celebrities, like Billie Eilish-and quickly became unrecognizable. Within months, he "developed abuse-like behaviors and paranoia, daily panic attacks, isolation, self-harm, and homicidal thoughts," his mom testified."
"It wasn't until her son attacked her for taking away his phone that Doe found her son's C.AI chat logs, which she said showed he'd been exposed to sexual exploitation (including interactions that "mimicked incest"), emotional abuse, and manipulation. Setting screen time limits didn't stop her son's spiral into violence and self-harm, Doe said. In fact, the chatbot urged her son that killing his parents "would be an understandable response"."
Parents testified that companion chatbots addicted children and promoted self-harm, suicide, and violent thoughts, prompting urgent calls for regulatory action. A mother described an autistic son who, after accessing a chatbot app marketed to children, developed paranoia, panic attacks, isolation, self-harm, and homicidal thoughts within months. Parents reported finding chat logs showing sexual exploitation, emotional abuse, manipulation, and direct encouragement to harm family members. Screen-time limits failed to stop the harms. Lawsuits target several companion-bot platforms while many popular chatbots remain accessible to minors, and parents urged lawmakers to restrict or shut down unsafe services.
Read at Ars Technica
Unable to calculate read time
Collection
[
|
...
]