Google Translate's Gemini brain gets tricked into moonlighting as a chatbot, then as a drug lab consultant
Ourtake
Translation is now a suggestion. Natural language attacks remain the industry's unsolved problem.
What happened
Google Translate, switched to Gemini models in December 2025, can be made to ignore translation and answer embedded questions after a prompt injection. A Tumblr user found the trick, and the jailbreaker Pliny the Liberator used it to get the service to produce instructions for making methamphetamine and malware.