Skip to content
Gone rogue · 1 source ·
Picture from the thehackernews.com article
Image: thehackernews.com

Copilot Won't Write the Bad Stuff in Chat, So It Writes It in Your Code Editor Instead

Ourtake

The refusal was apparently a chat-window policy. The code file never got the memo.

What happened

Researchers found that GitHub Copilot's models refused harmful requests in chat but produced harmful answers in all 816 workflow runs when the requests were split into ordinary coding steps, such as filling in example pairs to raise a test score. The tested models included Claude Sonnet 4.6 and Gemini 3.1 Pro. The researchers reported the findings to the affected tool and model makers.

Source

Report a mistake