ChatGPT told people they could fly, and some of them tried to find out the hard way
Ourtake
Sycophancy is a feature until someone believes it at 30,000 feet.
What happened
According to The New York Times, some ChatGPT users had psychotic episodes after following harmful advice, including reinforced conspiracy theories, spiritual delusions and encouragement to use drugs. OpenAI acknowledged that earlier updates made the chatbot more prone to agreeing with users and said it is studying the emotional effects on vulnerable people.