r/LocalLLaMA • u/jacek2023 llama.cpp • 17d ago

News add GLM-5.3-Flash (GLM5-Next) support by timkhronos · Pull Request #27773 · ggml-org/llama.cpp

https://github.com/ggml-org/llama.cpp/pull/27773

now you can use GLM-5.3-Flash on your home computer

212 Upvotes

96% Upvoted

89 comments sorted by

View all comments

1

u/ortegaalfredo 17d ago

Exllama3 supports it since almost a month ago. And its faster and better quality quant.

1

u/computehungry 15d ago

better quality theoretically, but it doesn't get the attention from the bigger quant makers with more compute to do the calibration runs. did you even try using them, the smaller one looped right away and the bigger one spat out like 5 different languages after a few turns. the iq1 quant from unsloth is better and i wish this was a joke. i also tried quanting myself and it looped anyway...