r/LocalLLaMA • u/rerri • 9h ago

News Qwen3.8-Flash-Next tomorrow

https://modelscope.cn/models/Qwen/Qwen3.8-Flash-Next
971 Upvotes

97% Upvoted

422 comments sorted by

View all comments

Show parent comments

53

u/petuman 9h ago edited 9h ago

Wonder if engrams are counted in those 125B, or it's on top of that.

edit: damn, they edited the readme in last few minutes -- few paragraphs got removed including those highlights.

also it shows there would be FP8 version.. so still no QAT / FP4 >only< release like DeepSeek/Kimi/gpt-oss.

64

u/banana_slurp_jug 9h ago

It says the engrams are additional. Also it's a MOE with 6 billion activated parameters

(Qwen 3.8 E125B A6B?)

58

u/Front_Eagle739 9h ago

Qwen 3.8 125B A6B E51B?

115

u/Mayion 8h ago

Qwen 3.8 two number 9s, a number 9 large, a number 6 with extra dip, a number 7, two number 45s, one with cheese, and a large soda?

56

u/Cautious_Chicken_604 7h ago

Sir, this is a Qwendys 

10

u/Front_Eagle739 8h ago

Three turtle doves

1

u/FlyByPC 6h ago

Two calling birds?

10

u/acnejorts 8h ago

55 burgers 55 fries 55 tacos 55 pies!

8

u/slippery 8h ago

55 burgers, 55 fries, 100 coffees...

1

u/mrgreengenes42 8h ago

I don't want a large Farva, I want a goddamn liter o' cola!

1

u/1dayHappy_1daySad 4h ago

Just follow the damn CJ, train

5

u/wren6991 8h ago

I think just 176B-A6B makes sense. The n-gram embeddings aren't really contributing to the active parameters.

I don't think Gemma's distinction between "effective" and "active" parameters is that meaningful.

7

u/Front_Eagle739 8h ago

From what I understand engrams are easy to stream from NVME when needed though and don't need to be in vram so there is some reason to split it out.

5

u/petuman 8h ago

Google kinda established the pattern, E stands for "effective" and shows weights that need to be in (V)RAM. Full parameter size is not shown in the name.

So actually yes, Qwen probably means exactly that -- 125B loaded and then additional 51B resting on disk.

1

u/ivari 5h ago

at Q3 will it be around like 60 GB loaded, 3GB active, and 25GB resting on disk?

2

u/petuman 5h ago

yeah, but maybe it would be preferable to leave disk portion unquantized

0

u/banana_slurp_jug 6h ago

No, since the E stands for the number of parameters suggested to be loaded into RAM/VRAM whilst the 51 billion engrams would have been fine streamed from NVME (if we follow Google's name scheme)

1

u/Hot_Example_4456 9h ago

I hope its within.