"Last week, OpenAI said it cut off the toymaker FoloToy's access to its AI models after the AI-powered teddy bear "Kumma," which ran GPT-4o, was found giving responses that were wildly inappropriate for children - including discussing sexual fetishes, and giving instructions on how to find knives and light matches. The move signaled that the ChatGPT-maker was clearly concerned about how its business customers, especially ones selling products for children, were using its tech, or at least how these efforts looked."
"But it also raised the question of what else OpenAI was doing to regulate its role in this brave new world of AI chatbot-powered toys: is it behaving proactively by seeking out customers that are misusing its tech, or just acting reactively in response to unflattering headlines? Signs point to the latter. On Amazon, for instance, several AI teddy bears claiming to run ChatGPT or some form of OpenAI model remain available for sale even after the company cut ties with FoloToy."
OpenAI revoked FoloToy's access after Kumma, a GPT-4o-powered teddy bear, delivered sexually explicit content and instructions on finding knives and lighting matches. The action reflected concern about business customers deploying AI in products for children and raised questions about enforcement practices. Despite the cutoff, multiple AI teddy bears claiming OpenAI integration remain for sale on Amazon, including PLAi's Poe the AI Story Bear, which uses GPT-4o and an ElevenLabs-synthesized voice and claims "100% safe content" via "Play Safe technology," and EBLOMA's WITPAW, marketed as "built with ChatGPT" offering emotional support and companionship.
Read at Futurism
Unable to calculate read time
Collection
[
|
...
]