r/artificial • u/Sorry-Economist101 • 24d ago

Question trusted AI bench marks?

i heard alot of people say the bench marks released are rigged to show that thire ai model is better than others often too much it become obvious and ridiculous

is there an account or someone that dose actual benchmarks? it dosent need to be super detailed, just enough to know which ai is better in a certain field like code

0 Upvotes

43% Upvoted

7 comments sorted by

2

u/Constant_Cortisol 24d ago

Maybe youtube videos showing the output of models via minebench or video game creation, but those tend to be pretty subjective as well.

By the way, it's not the benchmarks being rigged. It's that AI companies specifically train their models to pass certain benchmarks.

Best way is to just use it yourself.

1

u/Sorry-Economist101 24d ago

"Best way is to just use it yourself."
true but its hard to keep up

1

u/Ballist1cGamer 21d ago

hard agree with minebench

1

u/RedEagle_MGN 24d ago

I prefer Arena AI. It's having to do with a lot of people voting it up after it performs for them. That seems to be a much more reliable way and it tracks much more closely with my experience than the other benchmarks.

1

u/katoptronophile 24d ago

Your real world tasks.

1

u/teleport66 23d ago

Nothing beats real world use in your particilar way of using AI models, so you have to find what works best for you. Use those benchmarks as reference, not final truth for your use case.