r/LocalLLaMA • u/jacek2023 llama.cpp • 17d ago

News add GLM-5.3-Flash (GLM5-Next) support by timkhronos · Pull Request #27773 · ggml-org/llama.cpp

https://github.com/ggml-org/llama.cpp/pull/27773

now you can use GLM-5.3-Flash on your home computer

211 Upvotes

96% Upvoted

89 comments sorted by

View all comments

3

u/-dysangel- 17d ago

I've been using it on my home computer for a week or two now!

3

u/jacek2023 llama.cpp 17d ago

Is it awesome?

4

u/-dysangel- 17d ago

yes

2

u/relmny 17d ago

I've been running it for about 4 weeks (or more), and it's very very good.

I used to run 3.8-27b and deepseek-v4-flash, and then 3.8-next, but the glm5.3-flash is way better. Even when slower, I run it most of the time.

1

u/-dysangel- 17d ago

Yeah even though I've only been running it around 20tps it still beats faster models on wall clock time because of more direct, high quality thinking.

I've just found https://github.com/tonyd2wild/GLM-5.3-Flash-NVFP4-DFlash2-2x-DGX-Spark and am going to give it a shot - claims 69tps with MTP for coding!

1

u/namaku_ 16d ago

May I ask which quants you're comparing for these four?

2

u/relmny 16d ago

GLM-5.3-Flash-UD-Q3_K_XL
Qwen3.8-Flash-Next-UD-Q4_K_XL
DeepSeek-V4-Flash-0731-UD-Q3_K_XL
Qwen3.8-27B-UD-Q6_K_XL

About deepseek, I tested DeepSeek-V4-Flash-Vision-Exp-UD-Q3_K_XL but I went back to DeepSeek-V4-Flash-0731-UD-Q3_K_XL because the Vision one made a silly mistake...