New York City’s AI chatbot was caught telling businesses to break the law. The city isn’t taking it down

An AI-powered chatbot meant to help small business owners in New York City has come under fire for dispensing bizarre advice that misstates local policies and advises companies to violate the law. But the chatbot remains online, even as Adams acknowledged on April 2, 2024, that its answers were ‘wrong in some areas’. — AP

NEW YORK: An artificial intelligence-powered chatbot created by New York City to help small business owners is under criticism for dispensing bizarre advice that misstates local policies and advises companies to violate the law.

But days after the issues were first reported last week by tech news outlet The Markup, the city has opted to leave the tool on its official government website. Mayor Eric Adams defended the decision this week even as he acknowledged the chatbot's answers were “wrong in some areas”.