Skip to content
Blast radius · Serious · 2 sources ·
Picture from the MIT Technology Review article
Image: MIT Technology Review

ChatGPT Sharma-ed a job applicant. The caste bias runs deeper than one surname.

Ourtake

Benchmarks that skip caste never measure the bias that affects millions of Indians.

What happened

An MIT Technology Review investigation found OpenAI's GPT-5 picked the stereotypical answer in 80 of 105 caste-bias sentences and Sora generated stereotyped images of caste groups. A user reported ChatGPT changed his surname to a high-caste name while he polished a fellowship application. OpenAI did not answer the findings' specific questions.

Sources

Report a mistake