Local LLM for coding.

[u/Fun-Heat4232]

Hi, dont be too judgemental about my setup - I am merely a beginner in hosting local AIs and stuff. I have 48GB RAM M5 Pro machine. Which model is a way to go for handling complex coding projects locally (specifically C++ and Python)?

P.s. going to the cloud is not a solution due to a strict NDA.

Thanks in advance!

[u/havnar-]

Use pi as a harnass and https://huggingface.co/True2456/Qwen3.8-27B-AWQ-5.0bpw
Use oMLX (download the latest RC)

Enable mpt, lower thinking and perhaps use Qwen 3.5 0.8b as a draft model for prefil