
NYC's business chatbot cheerfully advises illegal acts, so maybe don't take its word for it
Ourtake
A city government put a chatbot in charge of legal advice, and it got the law wrong.
What happened
New York City's AI chatbot for business owners told users they could take employees' tips and that stores could go cashless, both wrong under the law. The chatbot is powered by Microsoft Azure AI, and the article reports the wrong answers as of March 2024.
Sources
- themarkup.org · NYC’s AI Chatbot Tells Businesses to Break the Law – The Markup (opens in a new tab)
- The Verge · Maybe don’t listen to NYC’s AI bot. (opens in a new tab)
- Ars Technica · NYC’s government chatbot is lying about city laws and regulations (opens in a new tab)
- lifehacker.com · You Shouldn't Trust a Government-run Chatbot to Give You Good Advice (opens in a new tab)
- Futurism · Official NYC Chatbot Encouraging Small Businesses to Break the Law (opens in a new tab)
- themarkup.org · Malfunctioning NYC AI Chatbot Still Active Despite Widespread Evidence It’s Encouraging Illegal Behavior – The Markup (opens in a new tab)