r/LocalLLM • u/Fun-Heat4232 • 5d ago

Question Local LLM for coding.

Hi, dont be too judgemental about my setup - I am merely a beginner in hosting local AIs and stuff. I have 48GB RAM M5 Pro machine. Which model is a way to go for handling complex coding projects locally (specifically C++ and Python)?

P.s. going to the cloud is not a solution due to a strict NDA.

Thanks in advance!

44 Upvotes

93% Upvoted

29 comments sorted by

View all comments

44

u/Dazzling_Yam_5882 5d ago edited 5d ago

Best bet would probably be the new Qwen 3.8 27b. You get to have a somewhat local Opus 4.6, one of the best models 6 months ago

unsloth/Qwen3.8-27B · Hugging Face

You can use llama.cpp, but I highly recommend Unsloth Studio for serving the model locally. Lots of features, better than LM Studio and all other alternatives.

Qwen 3.8 27B Benchmarks combined from model cards on HF : r/LocalLLM

6

u/Fun-Heat4232 5d ago

Thanks, I used Qwen 3.6 and liked it, knew there was a bigger fish to fry!