
Microsoft's Copilot Designer Draws Demons, Drugs and Elsa With a Handgun, Engineer Says
Ourtake
The guardrails were apparently less of a guardrail and more of a suggestion.
What happened
Microsoft AI engineer Shane Jones red-teamed Copilot Designer, powered by OpenAI's DALL-E 3, and found it generated violent, sexualized, underage drug-use and copyrighted Disney images. CNBC reproduced similar outputs. Jones sent letters to the FTC and Microsoft's board urging the product be pulled from public use, and Microsoft said it has internal channels to investigate such concerns.
Sources
- cnbc.com · Microsoft engineer warns company's AI tool creates violent, sexual images, ignores copyrights (opens in a new tab)
- uk.pcmag.com · Copilot Designer Creates 'Harmful Images,' Says Microsoft AI Engineer (opens in a new tab)
- The Verge · Microsoft AI engineer warns FTC about Copilot Designer safety concerns (opens in a new tab)
- siliconangle.com · Microsoft engineer flags Copilot Designer concerns as academics call for better AI risk research - SiliconANGLE (opens in a new tab)
- theguardian.com · Microsoft ignored safety problems with AI image generator, engineer complains (opens in a new tab)