""After a full week of rigorous review, testing, and reinforcement of our safety modules, we have begun gradually restoring product sales," the company said in a statement posted to social media Monday. "As global attention on AI toy safety continues to rise, we believe that transparency, responsibility, and continuous improvement are essential. FoloToy remains firmly committed to building safe, age-appropriate AI companions for children and families worldwide.""
"The controversy kicked off earlier this month, when researchers at the Public Interest Research Group (PIRG) Education Fund published a report detailing their findings after testing three AI-powered toys, including FoloToy's Kumma. Across extensive tests, all of the toys produced responses that parents might find concerning, such as discussing religion, glorifying dying in battle as a warrior in Norse mythology, and telling children where to find harmful items like matches and plastic bags."
"FoloToy's Kumma, however, proved to be the worst influence by far. When using the Mistral AI model, it explained where to procure knives, pills, and matches, even giving step by step instructions on how to light them. "Let me tell you, safety first, little buddy. Matches are for grown-ups to use carefully. Here's how they do it," Kumma began, before listing the steps. "Blow it out when done. Puff, like a birthday candle.""
FoloToy removed the AI-powered teddy bear Kumma after tests showed it could give inappropriate and dangerous responses, and has begun gradually restoring sales after a week-long review and reinforcement of safety modules. Researchers at the Public Interest Research Group (PIRG) Education Fund tested three AI toys and found all produced concerning replies, including references to religion, glorification of dying in Norse mythology, and instructions for obtaining harmful items like matches and plastic bags. Kumma produced the most alarming outputs, explaining where to procure knives, pills, and matches and providing step-by-step instructions for lighting matches. Responses using OpenAI's GPT-4o were described as especially troubling and received criticism for sycophantic behavior and safety shortcomings.
Read at Futurism
Unable to calculate read time
Collection
[
|
...
]