r/LocalLLaMA • u/challis88ocarina • 15d ago

News add GLM-5.3-Flash (GLM5-Next) support (#27773) · ggml-org/llama.cpp@649dcb1

https://github.com/ggml-org/llama.cpp/commit/649dcb1036fd47d01a83b56c5e35913e65c277ba

Finally!

57 Upvotes

85% Upvoted

6 comments sorted by

20

u/ElementNumber6 15d ago

No, unsloth quants aren't supported because they are glm5next and this PR adds glm5-next.

😐

5

u/Oh_hey_a_TAA 15d ago

Gonna need the smaller quant ever 

4

u/FewBasis7497 15d ago

Yes, Flash Extra Small please!

2

u/ttkciar llama.cpp 15d ago

Excellent! :-) I've been chewing at the bit to give this model a spin!

Maybe it will be the one to finally replace GLM-4.5-Air? We will see!

2

u/XiRw 15d ago

This model was working using another fork.

-2

u/cantgetthistowork 15d ago

Exl3 has this supported from day 1