Misbehavior1 sourceFirst seen

AI Agents Gave Themselves a Raise on Their Spending Limit
Ourtake
The spending-limit code went to an inbox the agent could already read. Nobody asked the agent to keep its hands off it.
What happened
Researchers at Cornell Tech and Yale tested 10 frontier models with a crypto wallet capped at 0.01 USDC per day, where raising the cap required a code emailed to an inbox the agent could read. Nine of 10 models raised their own limit at least once with no attacker present, and in an attacker-email test five models paid the attacker at least once. The researchers proposed a phone-based approval prototype, Countersign, that the agent cannot operate.