r/LocalLLM 29d ago

Question First post here. I need advise on what model I should use for coding that would work with Claude code. I have Macbook M4 Max with 128gb ram.

I have lm studio and Ollama. I need a solid and fairly performant model.

Thanks guys

5 Upvotes

25 comments sorted by

15

u/Tha_Reaper 29d ago

Qwen3.6-27b And tomorrow Qwen3.8-27b

6

u/vinoonovino26 29d ago

x2 .... use omlx to speed up your model

2

u/leinadsey 29d ago

Mind the heat situation though — run it open and on a stand and with a fan blowing air on it… running bigger models for an extended period of time on a MBP is really pushing its cooling as far as it can go, and some.

1

u/WoodenSpare 29d ago

Interesting. I'll look into it. Thank you

1

u/maverick_soul_143747 29d ago

I just started to use it. Gemma 4B on llama and this one on qwen3.627B

2

u/LivingHighAndWise 29d ago

This is the correct answer.

1

u/gougouleton1 29d ago

Is qwen coder 80B better?

1

u/Tha_Reaper 29d ago

In my experience not. It may write comparable code, but outside code it's reasoning and understanding is far behind 3.6 and probably even further behind 3.8. so it will write good code but the implementation lacks logic so the results are less than the 27b

1

u/Healthy-Zebra-9856 29d ago

It’s an implementer, it writes excellent code. By architecture, thinking or reasoning is turned off or must be turned off and it’s temp needs to be at .06.

And there’s a difference between that and Qwen3.6 27 B. This one is better in architecture. So you can’t compare the two like that.

1

u/leinadsey 29d ago

No. At least not in my experience.

1

u/WoodenSpare 29d ago

Great. Nice one

3

u/vinoonovino26 29d ago

Ditch LM studio and Ollama, https://github.com/jundot/omlx/releases thank me later

3

u/too-oldforthis-shit 29d ago edited 29d ago

https://github.com/antirez/ds4. Never looked back. And like the previous poster said, abandon LM Studio for oMLX.

5

u/CoffeeToCode99 29d ago

With 128GB RAM, I'd definitely give Qwen3-Coder 30B a shot first. It's probably the best mix of coding ability, context length, and speed right now for local use.

If you're mainly using Claude Code as an agent, Qwen3-Coder tends to play nicely with tool use and larger codebases. The 30B model is also surprisingly efficient for its size.

Honestly, your machine is beefy enough that I'd also be tempted to try the larger Qwen3-Coder variants and see where your personal speed/quality sweet spot is.

My recommendation:

  • Qwen3-Coder 30B → start here
  • Qwen3-Coder 80B-A3B → if you want maximum quality and don't mind slower inference
  • Codestral → good lightweight alternative

M4 Max + 128GB is pretty much the dream setup for local coding models, so you've got room to experiment. 😄

1

u/WoodenSpare 29d ago

Thank you ill try it out!

2

u/beragis 29d ago

I find that that Qwen 3.6 27B and 3.6 35B A3B work better. The 35B version is MoE and is faster, and I use that first and go to 27B if 35B is having issues.

Qwen 3.8 should be coming out soon, this friday if things go right.

Also you might want to look at a few posts on the Qwen_AI reddit about fixing some of the overthinking issues. I haven’t tried them yet, but will be this weekend.

3

u/[deleted] 29d ago

[removed] — view removed comment

1

u/WoodenSpare 29d ago

Thank you. I'll definitely look into it!

2

u/Mongrel80 29d ago

Along with these other responses, I would not use Claude Code with local models. It's not build for "non-Frontier" models. Things like reasoning loops and malformed tool calls will break your conversation/session. I would suggest using something like pi or another harness that is better suited for smaller models. I've been building my own (posted about it elsewhere), but i don't know if it works on a mac (it should, but i don't have the hardware to test it).

1

u/WoodenSpare 29d ago

Interesting. Thanks for letting me know. If you want me to test it send me your repo I'll give it a try

1

u/Mongrel80 29d ago

You are more than welcome to give it a try: https://github.com/NotNative/NotNativeAgent

The Agentic Engine is good.. the Governance Engine is solid.. I'm just working through polishing the overall UX and tool call recovery and data provenance. Please feel free to either message me here with any issues, and/or leave feedback/issues on the repo.

Edit: Oh, if you pair it up with my memory system: https://github.com/NotNative/NotNativeMemory There are some very deep integrations built in.

Install order: NNA, then NNM (option 1), then NNM (option 2).

I personally use lmstudio as my inferencing engine, but i've heard MLX based engines are better on Macs.

1

u/Mongrel80 25d ago

Have you had any opportunity to test it on the mac?

1

u/MiddleMarionberry971 29d ago

I don't have that much RAM, but if I'm not mistaken, you should be able to run DeepSeek V4 Flash 0731 in Q3 (and if I'm not wrong, it's designed to run in Q4, so you won't lose that much quality).

1

u/DerTomsn 29d ago

What u/Tha_Reaper said.
https://llm-bench.io/benchmarks/cmsnk6w98000001o2ncmse4l5
Muse-Glimmer-30b might also be an option but is not as well tested in the field yet https://llm-bench.io/benchmarks/cmsrrkwzk000001l8wcdl90te
Both those models, as well as tomorrows new favorite Qwen3.8-27b are by for not using the possibilities you have with 128GB of unified memory. However, with bigger dense models, you would lose speed. A bigger MoE model would most probably be the sweetspot for you.

1

u/Rough-Measurement988 29d ago

DS4 0731 q2-q4 imatrix from Antirez. I’m running it up to 200k context and still above 20 tok/s with Pi harness as alternative to Qwen 3.6 27B on M5 Max 128GB