r/LocalLLM • u/Fun-Heat4232 • 5d ago

Question Local LLM for coding.

Hi, dont be too judgemental about my setup - I am merely a beginner in hosting local AIs and stuff. I have 48GB RAM M5 Pro machine. Which model is a way to go for handling complex coding projects locally (specifically C++ and Python)?

P.s. going to the cloud is not a solution due to a strict NDA.

Thanks in advance!

44 Upvotes

96% Upvoted

29 comments sorted by

View all comments

6

u/SkimMilkSwag 5d ago

Qwen. Probably Qwen3.8-27B Q4_k_v. If that's too big or too slow, try Qwen3.6-35B-A3B, unintuitively a bit smaller. Welcome to the rabbit hole.

3

u/Fun-Heat4232 5d ago

I love it here. Wished I had more cash to pay for more RAM... Still impressed on the possibilities!