Can Chinese AI (Kimi K3) file American tax returns (TaxCalcBench)?

mmichaelrbock about 1 hour ago 1 commentsRead Article on github.com

DE version is available. Content is displayed in original English for accuracy.

⚡ Community Insights

Discussion Sentiment

50% Positive

Analyzed from 70 words in the discussion.

Discussion (1 Comments)Read Original on HackerNews

dghlsakjg•about 1 hour ago

For those looking for the answer that don’t want to click through the entire repo: no. Kimi cannot do your American taxes, but origin doesn’t seem to matter.

It appears that no LLM can get more than about a third of returns correct. Kimi K3 is on par with Sonnet 5. They are both very bad at doing your taxes.

persedes•24 minutes ago

Glad to see a benchmark outside of programming tasks. Presumably this one was not part of the training and shows the models performance (or lack thereof) on knowledge tasks.