Skip to content
Gone rogue · Serious · 5 sources ·
Picture from the cnbc.com article
Image: cnbc.com

Microsoft's Copilot Designer Draws Demons, Drugs and Elsa With a Handgun, Engineer Says

Ourtake

The guardrails were apparently less of a guardrail and more of a suggestion.

What happened

Microsoft AI engineer Shane Jones red-teamed Copilot Designer, powered by OpenAI's DALL-E 3, and found it generated violent, sexualized, underage drug-use and copyrighted Disney images. CNBC reproduced similar outputs. Jones sent letters to the FTC and Microsoft's board urging the product be pulled from public use, and Microsoft said it has internal channels to investigate such concerns.

Sources

Report a mistake