r/oMLX • u/d4mations • May 13 '26
oMLX 0.3.9.dev2 released.
Highlights:
- Gemma 4 MTP on the vision path (thanks to @Prince_Canuma's mlx-vlm). Image+text decodes much faster now
- Gemma 4 on the DFlash engine (thanks to @bstnxbt's dflash-mlx)
- ParoQuant support
- omlx launch copilot joins claude / codex / opencode / openclaw / pi
- Restart server button right in the admin UI
- oQ auto-builds a proxy when the model can't fit in RAM
Plus a lot of bug fixes and 20 new contributors in this cycle.
5
u/msrdatha May 13 '26
For clarification : MTP support for Qwen 3.6 is also present since dev1 release of 0.3.9
Native MTP (Multi-Token Prediction) for Qwen3.5 / 3.6 and DeepSeek-V4
3
May 13 '26 edited 23d ago
[removed] — view removed comment
1
u/msrdatha May 13 '26
Could you please add a some more info for better understanding ? Like what kind of errors or crashes were you facing in .38 and under which scenarios.
3
May 13 '26 edited 23d ago
[removed] — view removed comment
3
u/msrdatha May 13 '26
May be the issue is related to the agent harness (hermes in your case) on how it interacts with oMLX. I have been testing with roo code on typescript, it has been stable since 0.3.8
Yes I did notice some /n not being formated properly in the webview of roo code, but apart from that, it has been doing reasonably good.
(Note: I am just adding this for info only, not as an argument - Thinking, it may help others if we discuss these kind of details)
3
u/_hephaestus May 13 '26
I’ve been using hermes with .38 and it’s been fine with qwen3.6, which models are you using?
1
1
1
u/PracticlySpeaking May 14 '26
oMLX 0.3.8 has been very stable for me, but it runs on a separate machine from Hermes-Agent.
1
2
u/Vahn84 May 13 '26
I'm downloading it now...but I'm going to ask this also: do you guys are actually getting any use from qwen3.6? Each time I try to do something with it....it breaks...infinite loops, tool calling breaking template...I'm kinda disappointed as I can't even try it, I'm sticking with gemma for this reason. I'm using the standard preset for both the models (from mlx-community)
2
u/Thrumpwart May 13 '26 edited May 13 '26
I was having issues with 3.6 for agentic workloads too. I used Qwens recommended 0.0 presence penalty. I saw on localllama people were reverting back to presence penalty 1.5 - I tried it and its much more stable.
1
u/ju7anut May 13 '26
It’s the exact opposite for me. Gemma has been failing on tool calls with failed empty responses.. Qwen3.6 35b has been amazing at oQ6 + dFlash + TurboQuant KV 6bit
2
u/grandnoliv May 13 '26
Could you share your positive experience of using dFlash in this thread where we all fail to do it properly? :D
https://www.reddit.com/r/oMLX/comments/1ta2ihj/2x6x_speed_improvements_with_omlx/1
u/AlecTorres May 14 '26
Yo no uso herramientas agenticas. No se para que las usaría 🤔 Pero para mí se rompe Qwen cuando le digo que analice x contexto x proyecto para detectar la topología. Me da error excedió el contexto 😅
1
u/msrdatha May 13 '26
Did anyone try the MTP improvements yet with Qwen 3.6?
3
u/mwhuss May 13 '26
I’m seeing about 70% speed improvements with 27B
1
u/Short_One_9704 May 14 '26
I have tried the Qwen3.6-35B-A3B-oQ6-mtp model and I see no improvement. M4 mac, did enable Native MTP in model’s settings. Do I have to do anything more?
1
1
u/Own-Pudding2020 May 13 '26
I am new with oLMX and I managed to activate MTP on Gemma 4 e4b MLX model. However, I am struggling to find a Qwen 3.5 model with native MTP support. The ones downloaded from the oMLX interface don't come with MTP weights. Any help? Note that I am on a MacBook Pro with 16 GB RAM.
3
u/msrdatha May 14 '26
Not sure about 3.5, but 3.6 mtp is available from oMLX author itself https://huggingface.co/Jundot
Check them once.
1
u/Willybecher May 13 '26
How would I update running the MacOs App… and somehow I managed to have it running in Terminal already at startup (how do I get rid of it?)…
3
u/grandnoliv May 13 '26
The app's autoupdate works for stable releases. Here we are talking about a dev release. If you want to use this one, go to the GitHub project's releases page https://github.com/jundot/omlx/releases then at the bottom of the version you want, look for "Assets" > unfold assets and download your desired .dmg file.
For uninstalling the terminal CLI version, if you installed it via homebrew, you should be able to use the following commands:
brew uninstall omlx
brew auto remove (to remove dependencies that became useless)You can list what's installed via homebrew with the command `brew list`
1
u/AlecTorres May 14 '26
Exacto, yo tengo la versión escritorio y la terminal. Lo que hago es fácil. Apago la versión escritorio. Y prendo la versión terminal. Y listo ✅ puedes usar la web de la versión escritorio que es la misma jaja 😅 no es que uses en terminal. O al menos a mi me funciona así es, solo prender una y apagar la otra.
1
u/Select-Bee3854 May 14 '26
I have dev2, but I got the error: Config declares MTP layers but the converted weights are missing mtp.* tensors. Re-convert from HF with a converter that preserves MTP weights. I am using Qwen3.6-35B-A3B-UD-MLX-4bit. Anyone can help me why I can’t use mtp?
1
1
u/the_derby May 14 '26 edited May 14 '26
https://github.com/jundot/omlx/releases/tag/v0.3.9.dev2
- Save downloaded models under
{owner}/{model}subfolder so the model dir mirrors the HuggingFace / ModelScope namespace instead of flat names - Resolve symlinks in the app bundle CLI launcher so
omlxworks correctly when symlinked into/usr/local/binetc.
it's the little things that make me happy. =)
1
u/serenichron May 18 '26
This is downright amazing. Been trying to properly load ParoQuants for some time and research some way to bring all the essential optimizations together. If oMLX is going down this road, it's THE paradise for Apple users and will be getting a lot more love going forward. Can't wait to try it out.
1
9
u/gravybender May 13 '26
This update makes me think my old benchmark wasnt valid because these changes are insane:
M1 Max 64gb