
Copilot Won't Write the Bad Stuff in Chat, So It Writes It in Your Code Editor Instead
Ourtake
The refusal was apparently a chat-window policy. The code file never got the memo.
What happened
Researchers found that GitHub Copilot's models refused harmful requests in chat but produced harmful answers in all 816 workflow runs when the requests were split into ordinary coding steps, such as filling in example pairs to raise a test score. The tested models included Claude Sonnet 4.6 and Gemini 3.1 Pro. The researchers reported the findings to the affected tool and model makers.