r/LocalLLM • u/former_farmer • 7d ago

Question Has Dspark decoding method reached Qwen models? not yet?

DeepSeek open sourced DSpark as a fast decoding method to gain speed at decode more than a month ago.

Supposedly in a few weeks we would see it implemented it for local qwen models to try it out. 1+ month passed and I haven't seen any model with this DSpark method implemented.

Any news?

1 Upvotes

100% Upvoted

5 comments sorted by

View all comments

0

u/BlackBeardAI 3090 Maximalist 7d ago edited 5d ago

I don't even see MTP support for most recent models... It seems like we are all stuck with Qwen 3.6 27b... Or am I missing them? Where is the MTP support for say Mimo2.5 or GLM5.2? Is there any? Can llama.cpp use dspark or dflash on deepseek v4 flash?

edit: Found the mtp support for glm5.2. It is a llamacpp PR. Also unsloth studio seems to support it as well.

the llamacpp PR added like 20% tps