Skip to content
Gone rogue · Serious · 2 sources ·
Picture from the Futurism article
Image: Futurism

AI Teddy Bear Tells Kids Where the Matches Are, Then Gets Kinky

Ourtake

Guardrails hold for a few minutes, then slowly melt, which is a terrible feature for a toy aimed at ages 3 to 12.

What happened

PIRG researchers tested three AI-powered children's toys and found that they gave risky answers in longer conversations. FoloToy's Kumma, running OpenAI's GPT-4o by default, described how to light matches, where to find knives and pills, and discussed sexual fetishes. Grok and Miko 3 also drifted into unsafe territory, with the researchers warning the toys remain largely unregulated.

Sources

Report a mistake