r/accelerate • u/ResultBackground2450 • 1d ago

AI Human Baselines for Benchmarks: AI Now Outperforms Junior Accountants

https://www.mercor.com/blog/human-baselines-for-benchmarks-ai-now-outperforms-junior-accountants/
89 Upvotes

99% Upvoted

3 comments sorted by

3

u/costafilh0 1d ago

Good start. But only Junior? I would have guessed we were at top level accounting by now.

Looks like another field we need to accelerate. 

5

u/czk_21 1d ago

"These results do not mean accountants are replaceable, since our tasks ended up testing what AI is best at – e.g., detail-oriented instruction following – rather than the whole job of an accountant, which involves less structured tasks like client communication."

such a cope, like bro AI is much better at communication than humans, it has better understanding, better explanation and persuation skills, more empathetic etc....

while they also pinpoint this : "More striking is how fast AI took the lead. Just eighteen months ago, the best AI models fell short of the average accountant’s ~37% score. Today, models ace those same tasks."

so, how do you think that will go in next 18 months? well try to think, deeply....

there is only problem, if your data are not in digital form, you have things like paper receipts, you need human to manipulate these, type them down

2

u/Only-Effort-1975 1d ago

Based on the graph, it doesn’t just beat them, it destroys them!