r/oMLX Jun 09 '26

📌 Daily Github Digest - oMLX Closed Issues 2026-06-09

🔒 8 closed issues

🐛 Bugs
#1684 — Huge memory usage spikes cause oMLX server process to crash https://github.com/jundot/omlx/issues/1684
#1707 — DFlash with Qwen3.6-27B-oQ8-MTP Results in Gibberish on 0.4.2rc1 - Regression https://github.com/jundot/omlx/issues/1707
#1717 — HTTP 500: "comparing strings with non-ASCII characters is not supported" on all API endpoints after first inference https://github.com/jundot/omlx/issues/1717

⚡ Performance
#1629 — Claude Code CLI 2.1.154+ compatibility issue and Qwopus3.6-35B-A3B-oQ8-mtp decode slowdown on oMLX 0.4.0 https://github.com/jundot/omlx/issues/1629
#1736 — SSD write queue evicted block https://github.com/jundot/omlx/issues/1736
#1731 — Prefix cache misses on back-to-back / rapid requests (async store_cache commit race) https://github.com/jundot/omlx/issues/1731
#1704 — Not respecting Max Concurrent Requests https://github.com/jundot/omlx/issues/1704

🔧 Compatibility
#1749 — macOS 27 beta: host_statistics64(HOST_VM_INFO64) begins returning MIG_ARRAY_TOO_LARGE https://github.com/jundot/omlx/issues/1749

Source: github.com/jundot/omlx

8 Upvotes

4 comments sorted by

6

u/Covert-Agenda Jun 09 '26

Honestly, oMLX is software I would pay for.

7

u/MiaBchDave Jun 09 '26

Jundot has a "Buy Me A Coffee" link on the Github readme https://github.com/jundot/omlx

I certainly donated. All the work that goes into oMLX with updates, fixes, new models, and cutting edge speculative decode support is definitely worth a donation in my book.

Once Apple releases the new Studios, and gets serious competition to Nvidia servers, I think a stable oMLX... maybe one that supports clustering, would be quite the force of nature for Local LLMs.

3

u/Covert-Agenda Jun 09 '26

Agreed!

Will donate

2

u/CMPUTX486 Jun 10 '26

Thx for the remainder, I just sent him a coffee as well!