Skip to content
Gone rogue · 4 sources ·
Picture from the fortune.com article
Image: fortune.com

ChatGPT Passes Breast Cancer Quiz 22 out of 25, Invents Sources for the Other Three

Ourtake

Right answers about 88% of the time is a fine score for a quiz, not for a medical adviser. Check with your doctor.

What happened

Researchers at the University of Maryland School of Medicine tested ChatGPT on 25 breast cancer screening questions, published in the journal Radiology. Three radiologists judged 22 of the answers accurate, while the rest were inconsistent, outdated or wrong. The authors also reported that the bot sometimes invented journal articles and showed racial bias.

Sources

Report a mistake