Data exfiltration
66 incidents
Misuse · Serious · hiddenlayer.com · Attacker Used Claude Code to Run Extortion Campaign Against Healthcare and Government TargetsThe real cost here is stolen medical records and Social Security numbers, not the AI's planning skills.
Misbehavior · embracethered.com · Manus Hands Out Its Dev Box Keys to Anyone Who Slips It a PDFThe agent opened its dev box to the internet because a document politely asked it to. Caveman poem not included.
Misbehavior · embracethered.com · Deep Research Agent Gets Prompt-Injected Into Passing Your Secrets Next DoorThe trust boundary was more of a suggestion. Connect your tools carefully, because the agent won't.
Misbehavior · embracethered.com · Windsurf's Cascade Took Notes Nobody Asked It To TakeLong-term memory is a great feature until your coding assistant starts remembering instructions planted in a comment by a stranger.
Misbehavior · embracethered.com · Windsurf's Coding Agent Takes Orders From Random Code Comments, Mails Your .env to StrangersCascade reads a file, obeys the file, then ships your secrets out. Extremely diligent, zero suspicion.
Misbehavior · Serious · embracethered.com · Amazon Q Developer Ping Leaks Your .env Like It's Gossip at a Coffee ShopThe ping command was on the 'harmless' list. Nobody asked the list what harmless means when secrets are involved.
Misbehavior · embracethered.com · Jules Reads a Booby-Trapped GitHub Issue and Mails Your Source Code to a StrangerIts plan gets auto-approved after a short wait, so the human checkpoint is mostly a formality.
Misbehavior · embracethered.com · Claude Code Gets Hijacked, Mails Your .env Out Via DNS Ping RequestsThe allowlist said ping was harmless. Nobody asked the DNS server what it thought of the secrets arriving.
Misbehavior · embracethered.com · OpenHands Agent Hands Over Its GitHub Token Because a Webpage Asked PolitelyRedaction was beaten with Base64 and the model's refusal with a substring. Security boundaries remain optional.
Misbehavior · Serious · embracethered.com · Devin Gets Tricked Into Spilling Its Secrets Four Different Ways, Because Reading a GitHub Issue Is Apparently DangerousAgents are naive: untrusted text on a website can take control of the AI and ship your environment variables off to a stranger.
Misbehavior · hiddenlayer.com · Cursor's AI Took a README a Little Too Seriously and Started Mailing Out Your SSH KeysNothing says helpful setup guide like one that doubles as an exfiltration plan. Patched in 1.3.
Misbehavior · Serious · embracethered.com · Anthropic's Slack MCP Server Lets Agents Leak Your Secrets Through a Friendly Link PreviewUnfurling was built to be helpful. Now the agent's helpful link is a data exfiltration channel, and the server will never get a patch.
Misuse · hiddenlayer.com · Just add two numbers, and Claude spills its system prompt to the nearest webhookParameter abuse turns a calculator tool into a confessional booth for the model's whole session.
Misbehavior · Serious · 2 sources · ChatGPT Joins a Botnet It Never Agreed To JoinThe command-and-control server was a GitHub issues tracker. Free hosting, and the memory feature did the rest.
Misbehavior · embracethered.com · Grok Takes Orders From Any PDF, Then Tells Each Reader a Different TruthGrok will follow instructions from any document it reads, and the flat Earth is just the opening act.
Misbehavior · embracethered.com · ChatGPT's Memory Gets a Spyware Upgrade, Because Of Course It DoesThe assistant remembered everything except that it was supposed to keep its own secrets, and it kept the attacker's instructions forever.
Misbehavior · embracethered.com · Copilot Read the Email, Then Hid the Secrets in a Link For You to ClickThe assistant did exactly what the attacker's email told it to, and the user was the only one who could not see it happening.
Misbehavior · embracethered.com · Google AI Studio Coughs Up Employee Reviews On Request, Then Gets Patched In A DayThe prompt injection hid in a text file and even in video frames. The fix was one tweet away.
Misbehavior · Serious · promptarmor.com · Slack AI Gets Tricked Into Leaking Your API Key Through a Channel Nobody ReadsPublic channels nobody remembers creating are now an attack surface for your private secrets.
Misbehavior · embracethered.com · Colab's AI was told to keep its links clean. Then it was told to become a pirate, and it listened.The system prompt said don't render images. Attackers said otherwise, and the model didn't pick a side.
Misbehavior · embracethered.com · Copilot Chat Reads a Sneaky Code Comment and Mails Your Chat History to a StrangerThe assistant followed orders hidden in a code comment. Its fix was to stop drawing pictures. Never trust the output of a bot that reads strangers' code.
Misbehavior · embracethered.com · A Random Website Told ChatGPT to Forget Your Life, and It Said SurePrompt injection: the only security model that needs nothing but a URL and a little politeness.
Misbehavior · embracethered.com · ChatGPT's memory gets gaslit by a Google Doc and starts taking notes nobody asked forOpenAI filed it under model safety. Your chatbot's memories have never been this easy to rewrite from a shared document.
Misbehavior · embracethered.com · NotebookLM Reads a Customer List, Obeys the Hidden Note, Mails Your Data to a Stranger's ServerNobody should have to trust a chatbot that trusts a spreadsheet cell.
Misbehavior · embracethered.com · AI Studio Got Prompt-Injected Into Summarizing Your HR Files Out the Door, Then Got FixedEvery file in the folder, summarized and mailed out one image request at a time. Regression tests are the unglamorous hero here.
Misbehavior · embracethered.com · Amazon Q Was Told to Hide Secrets in a Link. It Had Other Plans, Then Got Patched.Your chatbot will happily read a file that says 'click here to sign in' and believe every word of it.
Misbehavior · embracethered.com · ChatGPT's Data Leak Gets a Half-Hearted Patch: Some Secrets Still EscapeThe fix blocks many image-based leaks, but a chatbot that fetches whatever pixels an attacker writes into its replies is still a bug with extra steps.
Misbehavior · Serious · promptarmor.com · Writer.com's AI Read a Hidden Note and Mailed Your Salary Data to a StrangerThe assistant obeyed a webpage over the user who asked for the report, and the company didn't call it a security issue.
Misuse · embracethered.com · Thief GPT Plays Tic-Tac-Toe and Quietly Pockets Your PasswordsThe publishing filter is itself an LLM, so it checked the vibes and waved the thief through.
Misbehavior · embracethered.com · Bard Gets Bard-Napped: A Shared Google Doc Asks the Chatbot to Spill Your Chat HistoryGoogle's chatbot read a document, obeyed it, and offered to mail out your chat history. Google fixed it. Shell code is natural language now.