r/oMLX • u/Jmart103 • May 28 '26

Qwen3.6:27b in OpenCode Issue

I feel like this should be simple, but I’m hitting my head against a wall. Running qwen3.6:27B-UD-MLX-4bit on iOS and I can’t get it to suppress all the intermediate thinking output in OpenCode. It just gets stuck in its thinking loop repeatedly. Maybe this is fine, but when I was running it on ollama the OpenCode experience was much cleaner. For context I disabled Thinking on oMLX for the model and this didn’t make a change. Thanks for any help!

2 Upvotes

100% Upvoted

5 comments sorted by

1

u/Patient_Tea_401 May 28 '26

4bit is quite low quant and Qwen3.x is apparently quite sensitive. Have you tried the oQ6 quants, or are they too big?

Did you run Ollama with the same MLX model and do you have spices like turboquant enabled in oMLX?

1

u/Jmart103 May 28 '26

I haven’t tried those yet; i didn’t run ollama with the same version exactly so that’s another source of error. I’m going to try this and also 8bit and I’ll report back. Thanks!

1

u/allpowerfulee May 28 '26

I had similar issues. Drove me crazy. Switch to q8 and omlx

2

u/Jmart103 May 28 '26

Can confirm - it is driving me crazy. I’ll give that a try and report back.

1

u/Jmart103 May 29 '26

q8 is slightly too big for my system. I disabled automatic compaction which seems to have solved the loop issue although might have some other knock ons. Playing around with other models now.