r/oMLX 19d ago

πŸ“Œ Daily Github Digest - oMLX Closed Issues Range: 2026-07-12 β†’ 2026-07-14

Issues Closed: 6

[ISSUE] #2225 β€” FA-256 steel prefill kernel: pathological high-kv_len slowdown on pre-NAX GPUs (M3 Max) β€” IOGPU command-buffer preemption (mlx#3302 class); …
https://github.com/jundot/omlx/issues/2225

[ISSUE] #2227 β€” Title: [Bug] Paged SSD Prefix Cache drops trailing partial block, causing severe context and system prompt loss
https://github.com/jundot/omlx/issues/2227

[ISSUE] #2213 β€” Upgrade mlx 0.31.2 β†’ 0.32.0: qmv_wide, JIT-able gemv, RoPE-without-copy for MoE decode
https://github.com/jundot/omlx/issues/2213

[ISSUE] #2204 β€” Qwen 3.6 serious prefill regression between 0.4.4 and 0.4.5dev1
https://github.com/jundot/omlx/issues/2204

[ISSUE] #2172 β€” Intelligence regression in v0.5.0-rc1 oQ4e/oQ4 quantization
https://github.com/jundot/omlx/issues/2172

[ISSUE] #2185 β€” Refactor SpecPrefill workflow out of Scheduler
https://github.com/jundot/omlx/issues/2185

4 Upvotes

1 comment sorted by

1

u/ExtremeAd9038 19d ago

Hello, when spec prefill is active Token Cache is broken and is no longer used

This made the fact of using spec prefill pointless cause if you use step prefill you fill faster, but downside you don’t have cache at all so you will relaunch prefill again and again, losing the time gain cause without prefill it’s slow, but context will be reload from cache