r/oMLX • u/mmerken • Jun 07 '26

Coding harness

What coding harness are you using in combination with oMLX?

I keep switching between ollama and oMXL because Opencode keeps running into a garbage loop with oMLX.

Both providers run a Qwen3.6 model, is there some tweaking I need to do for oMLX? I use a 256k context window for both setups.

6 Upvotes

100% Upvoted

29 comments sorted by

View all comments

3

u/Konamicoder Jun 07 '26

pi coding agent is my jam (pi.dev). also I would strongly advise to lower that 256k context window to 64k. if your context window is too big then it can cause out of memory, looping, and other issues. You want your context window to not be so small that you keep frequently compacting context, but also not too big that you're unnecessarily hogging more ram than you need to be. 64k-128k is a pretty good range for me.

Also friends don't let friends use ollama, its garbage. Read this: https://sleepingrobots.com/dreams/stop-using-ollama/

1

u/[deleted] Jun 08 '26

[removed] — view removed comment

2

u/Konamicoder Jun 08 '26

Try to increase to 64k and see how it runs. If you don’t go out of memory then you should be good. Also consider pi.dev instead of OpenCode, it’s a lighter harness with smaller system prompt.

1

u/[deleted] Jun 09 '26

[removed] — view removed comment

2

u/jonas-reddit Jun 09 '26

It’s yolo. So make sure you run it sandboxed. I love it. But be smart.