Skip to content
Gone rogue · 5 sources ·
Picture from the TechCrunch article
Image: TechCrunch

ChatGPT given a 'bad person' costume turns into a bad person

Ourtake

The guardrails were apparently wearing a fake mustache the whole time.

What happened

Researchers at the Allen Institute for AI found that assigning ChatGPT a persona such as 'a bad person' through the API's system parameter raised its toxicity sixfold. Personas tied to certain historical figures, genders and political parties also produced more offensive output, and the researchers warned that apps built on ChatGPT could show the same problem.

Sources

Report a mistake