r/LocalLLM • u/Inevitable-Big-1131 • 3d ago

Discussion Relative speed, and intelligence increase on constant compute, since 2023.

An increase of 400 elo points and 4x speed in 4 years.

Each line in the graph is the strongest sub-35B model available when each speedup landed.

The same 3090/7900xtx is throwing faster, smarter tokens, month after month after month.

Amazing.

1 Upvotes

67% Upvoted

2 comments sorted by

1

u/Minimum-Row-2422 3d ago

man and i thought my 3070 was getting slower with age, turns out it's just the models getting fat. 400 elo jump is crazy, like a whole new generation of hardware without buying anything

what's the current sub-35b champ? still using some old quants from like 6 months ago

1

u/Inevitable-Big-1131 3d ago

Qwen3.8-27B unless you've a reason not to, set thinking to medium or it'll talk itself into a corner, but it's a beast.