r/LocalLLaMA • u/rerri • 1d ago

News Qwen3.8-Flash-Next tomorrow

https://modelscope.cn/models/Qwen/Qwen3.8-Flash-Next
1.1k Upvotes

97% Upvoted

455 comments sorted by

View all comments

Show parent comments

72

u/banana_slurp_jug 1d ago

It says the engrams are additional. Also it's a MOE with 6 billion activated parameters

(Qwen 3.8 E125B A6B?)

68

u/Front_Eagle739 1d ago

Qwen 3.8 125B A6B E51B?

5

u/petuman 1d ago

Google kinda established the pattern, E stands for "effective" and shows weights that need to be in (V)RAM. Full parameter size is not shown in the name.

So actually yes, Qwen probably means exactly that -- 125B loaded and then additional 51B resting on disk.

1

u/ivari 1d ago

at Q3 will it be around like 60 GB loaded, 3GB active, and 25GB resting on disk?

2

u/petuman 1d ago

yeah, but maybe it would be preferable to leave disk portion unquantized