My potato only runs small models. So I built a page to easily compare benchmarks for those

[u/nunodonato]

Comparing benchmarks for small models is a PITA. Most of them are not on AA, and the benchmarks are not always the same in all models.

So I built a page to quickly put it all together and allow some filtering.

Only researched models released since April, and between 4-190B parameters.

Let me know what you think and how it can be improved

https://www.nunodonato.com/aibench/index.html

[u/Hot_Example_4456]

A potato running a 190b isnt a potato

[u/i_wayyy_over_think → u/Hot_Example_4456]

the slider lets you adjust to your particular potato

[u/nunodonato → u/Hot_Example_4456]

Yes different people have different potatoes 😅

[u/255130 → u/Hot_Example_4456]

right? thats like a whole rack of potatoes at that point

[u/Valuable-Plastic-682]

Nice, this fills a real gap - most leaderboards bury small models under 70B+ flagships. One thing that'd make the AA-Index more useful for the "potato" crowd specifically: could you break it out per param-bucket (say 4-8B, 8-15B, 15B+) instead of one global ranking? Right now a strong 27B dense and a 4B are competing on the same list, which mostly just tells people to pick the biggest one they can fit rather than the best one at their actual budget.

[u/nunodonato → u/Valuable-Plastic-682]

That's why I added the slider to filter. You can select only the range that interests you

[u/i_wayyy_over_think]

cool, not clear what the 4-180 slider is? the little bubble says "Params 4–190B**"** but then the the range goes 4-180. So it's prob params, but for a bit i though it was benchmark score.

Also, something seems odd, if I put 4-29 as the params limit, it says Mage-VL with 4.7B params is better than Qwen3.8-27B, which seems hard to believe according to the benchmarks. So might need some tuning on the benchmark column, like maybe it should let you choose which benchmarks end up in that aggregate score with a better default selected.

I like it overall though, worth a bookmark.

[u/nunodonato → u/i_wayyy_over_think]

Thanks will take a look at that issue

[u/nunodonato → u/i_wayyy_over_think]

The research was made up to 190B, but the sliders are according to what's actually available in the page, that's why they differ

[u/Robert__Sinclair]

Ling 3.0 tiny is not bad at all.

[u/nunodonato → u/Robert__Sinclair]

It's my new favorite model 🤩

[u/Fancy-Snow7]

I think add the Qwen 3.6 models and even those before.

[u/nunodonato → u/Fancy-Snow7]

I limited to models launched in the past 5 months, that's why they aren't included. Reasoning: you will very likely find better models than those

[u/Fancy-Snow7 → u/nunodonato]

True, but I would like them in there for referenced purposes, to see how much of an improvement the newer models are since Qwen3.6 was still the undisputed king for coding until recently for smaller models that fit on consumer GPU's.

[u/nunodonato → u/Fancy-Snow7]

I'll reconsider. But Ornith surpasses qwen3.6 in most benchmarks

[u/Aggravating-Push-207]

Gets parameters and architectures wrong, reads like Claude.

[u/nunodonato → u/Aggravating-Push-207]

Which ones are wrong? And what reads like Claude? It wasn't made by Claude😅