Google's AI swallowed a 2017 hoax whole and served up a fake disease with footnotes
Ourtake
The AI cited the paper but never read it. Confidence, it turns out, is not comprehension.
What happened
A neuroscience writer, Neuroskeptic, found Google's AI Overview describing 'Kyloren syndrome,' a fake condition they had invented as a 2017 joke, as a real medical condition. The AI cited the satirical source without recognizing it was a parody. Google, Perplexity, OpenAI and Microsoft did not disclose error rates when asked.