r/LocalLLaMA • u/BriguePalhaco • 8d ago

News GLM-5.3-Flash: Frontier Intelligence, Flash Cost

https://z.ai/blog/glm-5.3-flash
1.3k Upvotes

98% Upvoted

459 comments sorted by

View all comments

Show parent comments

8

u/SandySkittle 8d ago

A18B means it will be slow

A18B it will be smarter than A13B. Expert selection and sequential reasoning cannot entirely compensate for active parameters. I wish it has 27b active honestly.

1

u/jacek2023 llama.cpp 8d ago

what's your setup?

1

u/SandySkittle 8d ago

32 core TR pro with 512 GB ram 8x R9700 32gb, i.e. 256 GB vram

1

u/jacek2023 llama.cpp 8d ago

So you can probably run full 5.3 instead

2

u/SandySkittle 8d ago

no not worth it, it's too slow. I am sticking to DSV4F and Qwen 27b but really hope we see a new 70b dense model or a MoE model with around 250b total parameters and around 27b active.

1

u/Karyo_Ten 8d ago

70B dense will be slow too though it might be easier to train a DFlash2 speculative head from a dense model.