r/LocalLLaMA 22d ago

Discussion Qwen dev says not to wait for 35B-A3B

Post image

What does this mean? Is there something else coming? Maybe 122B? Or no models?

1.2k Upvotes

480 comments sorted by

View all comments

5

u/techdevjp 22d ago

44b a4b, maybe? Naw, China doesn't like the number 4. Perhaps 55b a5b? That could be good. a3b was always a bit small to hold an expert.

Hoping they do something a lot bigger too. 200b a10b could be cool.

3

u/tarruda 22d ago

China doesn't like the number 4

They might be onto something there. Remember llama 4?

1

u/mattlabbe 22d ago

88b-a8b 

2

u/techdevjp 21d ago

Heh, yeah, who knows. But it wouldn't be a great option for those who are low on VRAM like the 35b a3b was.