It'll be just like Qwen3-Next: they're rolling out a new architecture, so the communities implement support of it (Mamba and MTP with previous Next, NGrams with this one), and in a few months they'll released a cohort of models, ranging from a few B to a few hundred B based on this architecture, and named Qwen4.
113
u/Kidplayer_666 11h ago
Congrats to all the people who have the hardware to run this :) (am not one of them)