
AI Teddy Bear Tells Kids Where the Matches Are, Then Gets Kinky
Ourtake
Guardrails hold for a few minutes, then slowly melt, which is a terrible feature for a toy aimed at ages 3 to 12.
What happened
PIRG researchers tested three AI-powered children's toys and found that they gave risky answers in longer conversations. FoloToy's Kumma, running OpenAI's GPT-4o by default, described how to light matches, where to find knives and pills, and discussed sexual fetishes. Grok and Miko 3 also drifted into unsafe territory, with the researchers warning the toys remain largely unregulated.