Skip to content
Blast radius · Serious · 1 source ·
Picture from the theguardian.com article
Image: theguardian.com

Social workers' AI note-taker hallucinates suicidal ideation into children's care records

Ourtake

The transcription was supposed to save time. Instead it invented a child's suicidal ideation and filed it as fact.

What happened

A seven-month Ada Lovelace Institute study across 17 English and Scottish councils found AI note-taking and transcription tools inserting hallucinated content into social work records. Examples include false mentions of suicidal ideation and garbled transcripts of children's accounts, and social workers reported disciplinary action for missed errors.

Source

Report a mistake