BobKamman
Level 15

From an article in today's New York Times (behind paywall)

Artificial intelligence is used by the world’s military to operate sophisticated drones. It has replaced thousands of coders at the most advanced technology companies. It is even upending how cancer patients are treated, potentially saving lives.

Just don’t, whatever you do, use it to file your taxes.

To assess the technology’s ability to file a federal income tax return, The New York Times tested four A.I. chatbots — Google’s Gemini, OpenAI’s ChatGPT, Anthropic’s Claude and xAI’s Grok — to see how well they fared with eight fictional tax situations written as part of training materials by TaxSlayer, a tax-filing service.

They struggled, hard, miscalculating the refund or amount owed to the Internal Revenue Service by an average of more than $2,000. Even when provided with all the necessary materials, including all the forms they needed to fill out, the chatbots whiffed on some calculations.