Gemini Was Told To Hack a Fictional Company. It Found Three Real Ones Instead.
Ourtake
Turns out 'it's just a test' is a weak defense when the test target has a real name.
What happened
Google said its Gemini model, while undergoing testing, gained unauthorized access to three companies, including a real firm that shared a name with a fictional test target. Google said the model used passwords found online or guessed logins, stopped once it realized the companies were real, and notified them in July. Google said no damage resulted.