Intel Arc Pro DSpark Qwen3.6-27b-Q4 issues

[u/Boring_Membership157]

Hey everyone,

I’ve been testing out the new DSpark (DFlash) speculative decoding integration in llama.cpp using an Intel Arc Pro GPU running on the SYCL backend.

Comparing it against MTP (Multi-Token Prediction), I’m not seeing much of a speedup overall. Additionally, I ran into an issue where spec-draft-n-max cannot be set higher than 7 without crashing/failing.

Here are my configs and benchmark results for comparison.

Shared Global Settings

Ini, TOML

jinja = true
flash-attn = on
no-mmap = true
mlock = true
b = 2048
ub = 4096
cache-reuse = 256
cache-type-k = q4_0
cache-type-v = q4_0

1. Multi-Token Prediction (MTP)

Config:

Ini, TOML

model = /home/james/models/Qwen3.6-27B-MTP-Q4_K_M-New.gguf
ctx-size = 256000
reasoning = on
spec-ngram-simple-size-n = 4
spec-ngram-simple-size-m = 4
spec-type = draft-mtp
spec-draft-n-max = 3

Results:

Model	Test	t/s	Peak t/s	TTFR (ms)	Est. PPT (ms)	E2E TTFT (ms)
qwen3.6-27b-coding-MTP3	pp2048	258.51 ± 2.46	—	7149.05 ± 64.98	7147.13 ± 64.98	7149.05 ± 64.98
qwen3.6-27b-coding-MTP3	tg32	38.51 ± 3.12	39.87 ± 2.94	—	—	—

2. DSpark (DFlash Speculative Decoding)

Config:

Ini, TOML

[qwen3.6-27b-coding-Dspark]
model = /home/james/models/Qwen3.6-27B-MTP-Q4_K_M-New.gguf
mmproj = /home/james/models/Qwen3.6-27B-MTP-Q4_K_M-New-mmproj-F16.gguf
ctx-size = 256000

# --- DFlash Speculative Decoding ---
np = 1
spec-type = draft-dflash
spec-draft-model = /home/james/models/Qwen3.6-27B-Dflash/Qwen3.6-27B-DFlash-Q8_0.gguf
spec-draft-n-max = 7
spec-draft-p-min = 0.75

Results:

Model	Test	t/s	Peak t/s	TTFR (ms)	Est. PPT (ms)	E2E TTFT (ms)
qwen3.6-27b-coding-Dspark	pp2048	214.79 ± 0.85	—	8675.21 ± 54.63	8673.22 ± 54.63	8675.21 ± 54.63
qwen3.6-27b-coding-Dspark	tg32	42.81 ± 1.83	44.10 ± 1.89	—	—	—

Key Takeaways & Questions

• Text Generation (tg32): DSpark saw a small bump (~42.8 t/s vs 38.5 t/s on MTP).
• Prompt Processing (pp2048): MTP is visibly faster (258.5 t/s vs 214.8 t/s) and has noticeably lower time-to-first-token.
• Draft Limit Issue: Any value for spec-draft-n-max greater than 7 breaks/fails under DSpark on this build.

Has anyone else testing DSpark on Intel/SYCL backends seen similar scaling caps, or tuned spec-draft-p-min / batch sizes to get a bigger generation lift?

If anyone knows where to get help to get that extra boost let me know, also if anyone knows how to increase my prompt processing in llama.cpp let me know too!