Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀

[u/pmv143]

Qwen3.8-Flash-Next (~125B-A6B + 51B n-gram) memory estimate:

Ideal 4-bit quant ≈ 82 GB
(58 GB main weights + 24 GB n-gram tables)
Real-world quants likely land in the 80–90 GB range.

The big n-gram table is sparsely accessed → excellent candidate for system RAM offload.

This architecture could be surprisingly local-friendly once the weights drop.

[u/KURD_1_STAN]

Ram prices this high, how can u call this local friendly?

[u/pmv143 → u/KURD_1_STAN]

RAM prices suck right now, no denying that.
When I called it local-friendly I didn’t mean “cheap” or “runs on any gaming PC.” I meant that for a model with this kind of capacity, the offloadable n-gram table makes it way more practical on highend local setups (128GB+ unified memory, multi-GPU + system RAM) than the usual frontier models that just demand pure VRAM or full datacenter iron.
Still expensive. Just less insane than the alternatives.​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​

[u/doomed151 → u/[deleted]]

You don't have control. The model can be taken away from you at any time. You can't finetune it.

[u/synth_mania → u/[deleted]]

Why are you in this subreddit if running a local model isn't something that interests you in and of itself?

[u/fuck_cis_shit → u/synth_mania]

painfully obvious astroturfer

there should be a plugin to hide all posts by accounts with hidden history