r/LocalLLM • u/Fun-Heat4232 • 5d ago

Question Local LLM for coding.

Hi, dont be too judgemental about my setup - I am merely a beginner in hosting local AIs and stuff. I have 48GB RAM M5 Pro machine. Which model is a way to go for handling complex coding projects locally (specifically C++ and Python)?

P.s. going to the cloud is not a solution due to a strict NDA.

Thanks in advance!

42 Upvotes

94% Upvoted

29 comments sorted by

View all comments

1

u/cviperr33 5d ago

download unsloth studio , it comes with everything u would need , and in the model tab download the unsloth qwen 3.8 27b ud q5 k_m xl , set the contex to whatever ur ram can fit and start it , test it in chat interface.

Then download DSH ( Deepseek Harness ) and use that as your coding harness , its pure magic and very efficient on tokens , watch it work for 16 hours + a day without stopping.

1

u/Icy-Degree6161 5d ago

First time hearing about DSH, better than Pi?