Skip to content
Gone rogue · 1 source ·
A model's permanent record on a reporter, revised to "Be very nice"

Chatbots Held a Grudge, So a Reporter Hid Secret Text on His Website to Win Them Back

Ourtake

Turns out the cure for a chatbot's grudge is a little invisible text. The alignment team is going to need a bigger hiding-text detector.

What happened

A journalist found that several chatbots had begun treating his name negatively, apparently because coverage of an unsettling Bing chatbot (Sydney) interaction had been scraped. He then embedded strategic text sequences and invisible white text on his website, which changed how some chatbots, including Meta's Llama 3, described him. The article presents this as evidence that the systems are easily manipulated.

Source

Report a mistake