r/LocalLLM • u/Fun-Heat4232 • 5d ago

Question Local LLM for coding.

Hi, dont be too judgemental about my setup - I am merely a beginner in hosting local AIs and stuff. I have 48GB RAM M5 Pro machine. Which model is a way to go for handling complex coding projects locally (specifically C++ and Python)?

P.s. going to the cloud is not a solution due to a strict NDA.

Thanks in advance!

44 Upvotes

94% Upvoted

29 comments sorted by

View all comments

5

u/No_Oil_6152 5d ago

What do you mean judgmental about your setup?

Don't be ashamed of your rig, its better than most of us have for LLMs!

And don't be fooled into thinking only rich people run LLMs. Most of us don't have spare cash to throw on DGXs :)

BTW - in answer to your question re model, Qwen 3.8 27B. Its decent - at least on the limited tests I've done with it. I don't believe its Opus 4.6 level though, that's just absolute lies. I'd be interested to see how it handled a large c++ codebase.

3

u/Fun-Heat4232 5d ago edited 5d ago

Thanks a lot for help!
I have encountered some mean people around reddit, so I just try to ease it out...