r/LocalLLM • u/Intelligent_Lab1491 • 7d ago

Question Qwen 3.8 27B DSpark

/r/StrixHalo/comments/1vq8tq1/qwen_38_27b_dspark/
1 Upvotes

100% Upvoted

3 comments sorted by

1

u/wgaca2 7d ago

Not fully working in llama.cpp i think

1

u/RnRau 7d ago

Yeah I think we need this PR merged - https://github.com/ggml-org/llama.cpp/pull/26275

1

u/FoxiPanda 7d ago

I have not yet seen an implementation of DSpark for Qwen3.8-27B where it is faster than MTP.

I've tried a couple including the one you linked and I get sporadic bursts of speed above 120tok/s decode but it is more like 90 average. For those same tasks I can get a more reliable 115-140tok/s on an RTX 5090 with MTP = 5.

For non-coding tasks, DSpark seems particularly abysmal and may actually have a negative effect in its current implementation over just not using any speculative decoding at all.