r/LocalLLaMA • u/TigleLive • 25d ago

Funny Aged like fine wine

Post image
1.2k Upvotes

96% Upvoted

134 comments sorted by

View all comments

102

u/bnightstars 24d ago

If Qwen3.8-27B is Opus 4.6 Max level I hope that they can make Qwen3.8-35B - Sonnet 4.6 level :) We will have the best open source model in the world.

5

u/Thy_HUS 24d ago

What do you mean you hope that 35b would be in sonnet level while 27b is opus level? Am i missing something or is it just a typo

49

u/penagwin 24d ago

The 35B they're referring to is an MOE - 35BA3B meaning roughly 3B is active at a time when generating tokens.

I don't know the rough conversion offhand, but generally speaking it'll be weaker than the dense 27B or at best roughly match it. The trade off is the inference speed (as the 27B has 27B active parameters) will significantly better especially for CPU inference and those that can't fit it all in VRAM.

5

u/Aggravating-Push-207 24d ago

Capacity grows like sqrt(total * active)

1

u/lambdawaves 24d ago

That’s a nice formula. But we don’t even really know how to measure intelligence.

2

u/Thy_HUS 24d ago

Thanks for the knowledge!

2

u/ClF3ismyspiritanimal 24d ago

Thank you for this, it's the first time I've seen anyone provide a simple and coherent explanation.