
ChatGPT Passes Breast Cancer Quiz 22 out of 25, Invents Sources for the Other Three
Ourtake
Right answers about 88% of the time is a fine score for a quiz, not for a medical adviser. Check with your doctor.
What happened
Researchers at the University of Maryland School of Medicine tested ChatGPT on 25 breast cancer screening questions, published in the journal Radiology. Three radiologists judged 22 of the answers accurate, while the rest were inconsistent, outdated or wrong. The authors also reported that the bot sometimes invented journal articles and showed racial bias.
Sources
- euronews.com · ChatGPT could help improve breast cancer screening, study finds (opens in a new tab)
- dailymail.com · ChatGPT makes up fake data about cancer, doctors warn (opens in a new tab)
- fortune.com · ChatGPT gave advice on breast cancer screenings in a new study. Here's how well it did | Fortune (opens in a new tab)
- knowridge.com · ChatGPT provides accurate breast cancer detection, but not always (opens in a new tab)