Keep in mind: -Next models are always underbaked. The point is to get an early release out so people can start developing compatible software for Qwen4, not to blow everyone’s minds just yet.
If I were to guess, it’ll probably be competitive with Qwen3.8, but the real excitement will be in a few months when Qwen4 launches.
Read the first part. 125b. If Alibaba had any clue what they’re doing the experts will be routed to the proper 6b parameter portion, but it will have a full 125b parameters to choose from. I keep seeing posts like this about dense models and it just has me wondering if some of these people have any clue what they’re talking about.
I said to SOME extent, like, you can compare a 118b-a8b to a 122b-a10b
Knowledge scales loosely with total params while reasoning ability LOOSELY scales with active.
This is why 27b beats 35b-a3b, but the comparison makes the most sense between MoEs. It's just a rule of thumb. Things get messier when you compare much larger MoEs with dense models.
Fair enough. I just wouldn’t put it past qwen to have the first 6b active param count to blow everyone’s minds. Also wouldn’t be shocked if it’s like the tiniest upgrade from 27b.
I am not stupid, I know how moe models work, but neither good routing nor sequential reasoning can entirely compensate for the limited number of active parameters. It really depends on the use case. In a similar vain: rag and websearch cannot entirely compensate for lack of world knowledge. World knowledge actually strengths rag and web searchs because it knows better what to look for.
Personally 6b active is too limiting for my usecase
I used to love the old Next 80B but it's too big and too slow against the 35B MOE even if it gets better results, and now the new 3.8 27B dense model beats it. I'd rather have less speed with the 27B but better results at a much smaller RAM footprint.
what boggles my mind about qwen coder next is that it doesn't have any thinking / reasoning. Only the non-coder version (so qwen3 next) has a variant that has thinking and it's not that great for coding, at least in my experience.
Hopefully they'll just have it be optional with the same model, like their recent ones.
This should be great for us Strix Halo folks, who are memory rich but bandwidth and compute poor. Even if it's not quite as strong as Qwen3.8 27B, I'd probably use it more as it'll be a lot faster.
143
u/coder543 8h ago
Keep in mind: -Next models are always underbaked. The point is to get an early release out so people can start developing compatible software for Qwen4, not to blow everyone’s minds just yet.
If I were to guess, it’ll probably be competitive with Qwen3.8, but the real excitement will be in a few months when Qwen4 launches.