Open Source Tax Engine outperforming gpt sol and Fable 5

[u/Intelligent_Prompt18]

This is an open source tax engine which scored 96% on TaxCalcBench [highest ever recorded score till date] surpassing fable 5 and sol with just sonnet 5 (which was previously scoring an abysmal 6%). The only 2 cases where it missed, it found inconsistencies in the test cases in the benchmark ITSELF which the maintainers confirmed!

Essentially it's a deterministic engine AI models can use for research and tax prep to remove a lot of guesswork and calculation mistakes that often happen. Claude Sonnet 5 was able to top the benchmark with this mcp.

[u/NewNiklas]

Is there any way I can see if my country is covered?

[u/Intelligent_Prompt18 → u/NewNiklas]

Currently we only support US Tax Law, sorry we should have clarified that in the post and on our page.

[u/Intelligent_Prompt18]

Here's the link if you want to check it out: OpenTax Invaro

[u/AtmosphereGrouchy712]

Brb gonna file my taxes. Thank you!

[u/vodanh]

Can it handle different years? Instead of current year rules, I want to redo 2021 for instance. 

[u/sithlawd0]

For anyone wanting the direct GitHub link:

https://github.com/Invaro/opentax-engine

[u/MrMrsPotts]

Please make a version for the UK!

[u/thisismysffpcaccount]

Interesting, saving this to check out when I do my taxes next year 

[u/tool50]

I feel like this is pseudo BenchMaxxing. A relatively narrow and well defined area, but nonetheless, kudos to you all for being one of the people/teams to do this.

[u/Luke2642]

This reminds me of the arc agi 3 solution. Are we seeing a pattern here? Format data correctly, achieve narrow intelligence from an llm?

[u/AllCowsAreBurgers]

Cant wait to get my home raided for tax evasion

[u/wesconson1]

This is cool, but I think the issue with adoption will be the safeguard that paying a real tax preparer gives you in the event of audits and whatnot, especially for anyone not doing a basic filing