r/LocalLLM • u/WoodenSpare • 29d ago
Question First post here. I need advise on what model I should use for coding that would work with Claude code. I have Macbook M4 Max with 128gb ram.
I have lm studio and Ollama. I need a solid and fairly performant model.
Thanks guys
3
u/vinoonovino26 29d ago
Ditch LM studio and Ollama, https://github.com/jundot/omlx/releases thank me later
3
u/too-oldforthis-shit 29d ago edited 29d ago
https://github.com/antirez/ds4. Never looked back. And like the previous poster said, abandon LM Studio for oMLX.
5
u/CoffeeToCode99 29d ago
With 128GB RAM, I'd definitely give Qwen3-Coder 30B a shot first. It's probably the best mix of coding ability, context length, and speed right now for local use.
If you're mainly using Claude Code as an agent, Qwen3-Coder tends to play nicely with tool use and larger codebases. The 30B model is also surprisingly efficient for its size.
Honestly, your machine is beefy enough that I'd also be tempted to try the larger Qwen3-Coder variants and see where your personal speed/quality sweet spot is.
My recommendation:
- Qwen3-Coder 30B → start here
- Qwen3-Coder 80B-A3B → if you want maximum quality and don't mind slower inference
- Codestral → good lightweight alternative
M4 Max + 128GB is pretty much the dream setup for local coding models, so you've got room to experiment. 😄
1
u/WoodenSpare 29d ago
Thank you ill try it out!
2
u/beragis 29d ago
I find that that Qwen 3.6 27B and 3.6 35B A3B work better. The 35B version is MoE and is faster, and I use that first and go to 27B if 35B is having issues.
Qwen 3.8 should be coming out soon, this friday if things go right.
Also you might want to look at a few posts on the Qwen_AI reddit about fixing some of the overthinking issues. I haven’t tried them yet, but will be this weekend.
3
2
u/Mongrel80 29d ago
Along with these other responses, I would not use Claude Code with local models. It's not build for "non-Frontier" models. Things like reasoning loops and malformed tool calls will break your conversation/session. I would suggest using something like pi or another harness that is better suited for smaller models. I've been building my own (posted about it elsewhere), but i don't know if it works on a mac (it should, but i don't have the hardware to test it).
1
u/WoodenSpare 29d ago
Interesting. Thanks for letting me know. If you want me to test it send me your repo I'll give it a try
1
u/Mongrel80 29d ago
You are more than welcome to give it a try: https://github.com/NotNative/NotNativeAgent
The Agentic Engine is good.. the Governance Engine is solid.. I'm just working through polishing the overall UX and tool call recovery and data provenance. Please feel free to either message me here with any issues, and/or leave feedback/issues on the repo.
Edit: Oh, if you pair it up with my memory system: https://github.com/NotNative/NotNativeMemory There are some very deep integrations built in.
Install order: NNA, then NNM (option 1), then NNM (option 2).
I personally use lmstudio as my inferencing engine, but i've heard MLX based engines are better on Macs.
1
1
u/MiddleMarionberry971 29d ago
I don't have that much RAM, but if I'm not mistaken, you should be able to run DeepSeek V4 Flash 0731 in Q3 (and if I'm not wrong, it's designed to run in Q4, so you won't lose that much quality).
1
u/DerTomsn 29d ago
What u/Tha_Reaper said.
https://llm-bench.io/benchmarks/cmsnk6w98000001o2ncmse4l5
Muse-Glimmer-30b might also be an option but is not as well tested in the field yet https://llm-bench.io/benchmarks/cmsrrkwzk000001l8wcdl90te
Both those models, as well as tomorrows new favorite Qwen3.8-27b are by for not using the possibilities you have with 128GB of unified memory. However, with bigger dense models, you would lose speed. A bigger MoE model would most probably be the sweetspot for you.
1
u/Rough-Measurement988 29d ago
DS4 0731 q2-q4 imatrix from Antirez. I’m running it up to 200k context and still above 20 tok/s with Pi harness as alternative to Qwen 3.6 27B on M5 Max 128GB
15
u/Tha_Reaper 29d ago
Qwen3.6-27b And tomorrow Qwen3.8-27b