
AI note-takers were filling care records with hallucinations, including false suicide warnings
Ourtake
When the AI writes the record, a made-up suicide warning can follow someone through their care file.
What happened
Research by the Ada Lovelace Institute found that AI transcription tools are used by 85 local authorities for social care to record interactions and decisions about people in care. Social workers reported hallucinated content in records, including an incorrect indication of suicidal ideation and gibberish, and the study warns this could affect care decisions.