Skip to content
Blast radius · 2 sources ·
Picture from the care.org.uk article
Image: care.org.uk

AI note-takers were filling care records with hallucinations, including false suicide warnings

Ourtake

When the AI writes the record, a made-up suicide warning can follow someone through their care file.

What happened

Research by the Ada Lovelace Institute found that AI transcription tools are used by 85 local authorities for social care to record interactions and decisions about people in care. Social workers reported hallucinated content in records, including an incorrect indication of suicidal ideation and gibberish, and the study warns this could affect care decisions.

Sources

Report a mistake