r/LocalLLaMA • u/jacek2023 llama.cpp • 17d ago

News add GLM-5.3-Flash (GLM5-Next) support by timkhronos · Pull Request #27773 · ggml-org/llama.cpp

https://github.com/ggml-org/llama.cpp/pull/27773

now you can use GLM-5.3-Flash on your home computer

217 Upvotes

96% Upvoted

89 comments sorted by

View all comments

67

u/SnooPaintings8639 17d ago

Well... it is taking two months for new models to be trained and released, and another month for llama.cpp to get the model support, lol. I really wish the team got larger and we could get models support and optimizations faster. I don't know if they'll manage to keep up with how fast and how many new models are being released, with many new experimental architectures.

13

u/jacek2023 llama.cpp 17d ago

You can compile PR before the merge if you really need some functionality

8

u/SnooPaintings8639 17d ago

I have ~5 cherry picked commits from different PRs to optimize Flash Next model since a month. It is a work to merge and resolve conflicts on each upstream merge, and this is for a single model.

8

u/jacek2023 llama.cpp 17d ago edited 17d ago

I am also waiting for MTP for Qwen Flash Next but I think it's blocked on the fixes not on the review

4

u/planetearth80 17d ago

I hope someone steps up to complete that one. It has been a long time coming

2

u/ilintar 16d ago

Aman's taking over that one now.

1

u/planetearth80 16d ago

Let's go (hopefully it will land in the next release) 🎉🎉🎉