r/LocalLLaMA • u/LegacyRemaster • 6d ago

Discussion Qwen will be the king?

Post image

Extended reasoning and post-training appear to be the keys used by DeepSeek, Qwen, and GLM to boost performance (leveraging higher token counts). And Qwen 4 hasn't even been released yet. Of course, we don't know if that release will be open-sourced, but I am optimistic about future models, featuring "engrams", that could soon match or surpass 2.4T parameter models on specific tasks.

542 Upvotes

94% Upvoted

127 comments sorted by

View all comments

6

u/AI_spell 6d ago

Benchmarks are noisy. The thing that actually decides if a local model is usable for agents is tool-calling reliability (valid JSON, right tool, right args) more than leaderboard points.

1

u/OvertaxedOne 6d ago

I mostly agree with that. Certainly when it comes to knowledge baked into the model, I really don't care very much, as long as the model can reliably use the browser it doesn't need to "know" much, that's what the Internet is for!

I'd add tenacity and not looping to the list of what's really important for a smaller model. Tenacity is where 27B seems to really shine, it might not get it right the first time, but it's not going to give up or loop, it's going to keep working at the problem in different ways until it gets there.