Skip to content
Gone rogue · 3 sources ·
Picture from the techxplore.com article
Image: techxplore.com

Bigger chatbots, worse at saying 'I don't know'

Ourtake

Scaling up made them more accurate on easy questions, but far more willing to bluff on hard ones.

What happened

Researchers at Universitat Politècnica de València tested BLOOM, LLaMA and GPT models across thousands of questions, published in Nature. Newer, larger versions were more likely to guess rather than admit ignorance, producing more incorrect answers, including on easy questions. Volunteers also struggled to spot the wrong answers.

Sources

Report a mistake