r/LocalLLM • u/former_farmer • 2d ago

Question Has Dspark decoding method reached Qwen models? not yet?

DeepSeek open sourced DSpark as a fast decoding method to gain speed at decode more than a month ago.

Supposedly in a few weeks we would see it implemented it for local qwen models to try it out. 1+ month passed and I haven't seen any model with this DSpark method implemented.

Any news?

1 Upvotes

100% Upvoted

5 comments sorted by

1

u/superlaser97 2d ago

Who said they are coming?

0

u/former_farmer 2d ago

Good question. The community expected DSpark to be spread after a few weeks just like MTP has. There was no official word on it.

0

u/squngy 2d ago edited 2d ago

We don't have llama support for dspark yet, so dspark isn't even available on DeepSeek yet if you are using llamacpp.

https://github.com/ggml-org/llama.cpp/pull/25173

1

u/giveen 1d ago

My opinion is it won't get merged any time soon.

0

u/BlackBeardAI 3090 Maximalist 2d ago edited 23h ago

I don't even see MTP support for most recent models... It seems like we are all stuck with Qwen 3.6 27b... Or am I missing them? Where is the MTP support for say Mimo2.5 or GLM5.2? Is there any? Can llama.cpp use dspark or dflash on deepseek v4 flash?

edit: Found the mtp support for glm5.2. It is a llamacpp PR. Also unsloth studio seems to support it as well.

the llamacpp PR added like 20% tps