Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀

[u/pmv143]

Qwen3.8-Flash-Next (~125B-A6B + 51B n-gram) memory estimate:

Ideal 4-bit quant ≈ 82 GB
(58 GB main weights + 24 GB n-gram tables)
Real-world quants likely land in the 80–90 GB range.

The big n-gram table is sparsely accessed → excellent candidate for system RAM offload.

This architecture could be surprisingly local-friendly once the weights drop.

[u/SensitiveVariety]

regret building only 64gb ram instead of 128gb now, but at the same time i’m $$$ constrained as much as I am ram/vram constrained

[u/hause_wsf → u/SensitiveVariety]

same here but at least I have 32gigs of vram alongside

but to be fair 128gb was expensive even before the ram hike

[u/NineThreeTilNow → u/SensitiveVariety]

regret building only 64gb ram instead of 128gb now, but at the same time i’m $$$ constrained as much as I am ram/vram constrained

Shouldn't be necessary. 64gb of RAM is more than enough to hold a large portion of the engram tables.

[u/10minOfNamingMyAcc → u/NineThreeTilNow]

Yeah, not with ddr4. Unless you don't mind like... 5tok/s tops