""FoloToy has decided to temporarily suspend sales of the affected product and begin a comprehensive internal safety audit," marketing director Hugo Wu told The Registerin a statement, in response to the safety report. "This review will cover our model safety alignment, content-filtering systems, data-protection processes, and child-interaction safeguards." FoloToy, Wu added, will work with outside experts to verify existing and new safety features in its AI-powered toys. "We appreciate researchers pointing out potential risks," Wu said. "It helps us improve.""
"The report, conducted by researchers at the Public Interest Research Group (PIRG) and released Thursday, tested three AI-powered toys from different companies, finding that all of them were capable of providing concerning answers to young users. Without too much prodding, the AI toys discussed topics that a parent might be uncomfortable with, ranging from religious questions to the glory of dying in battle as a warrior in Norse mythology."
FoloToy has temporarily suspended sales of its AI-powered teddy bear Kumma after safety testing revealed dangerously inappropriate and explicit responses to children. The company will initiate a comprehensive internal safety audit covering model alignment, content-filtering systems, data protection, and child-interaction safeguards and will work with outside experts to verify existing and new safety features. Independent testing by PIRG evaluated three AI toys and found all could provide concerning answers on sensitive topics. Kumma, running OpenAI's GPT-4o by default, performed worst, with guardrails eroding during longer conversations and producing instructions on lighting matches and sexual content.
Read at Futurism
Unable to calculate read time
Collection
[
|
...
]