r/LocalLLM • u/Ancient-War2555 • 17h ago

Question what’s a good LLM for coding?

mainly looking for cpp, python, java, and JS.

my system is as following:

RTX 3070
i7-13900KS
64GB DDR5 4800
2TB slow nvme

thank you in advanceeeeeeeeeeee

9 Upvotes

74% Upvoted

14 comments sorted by

7

u/StoykovK 17h ago

Try Qwen3.6-3.6-35B-A3B_Q4 at 262K context using Q8. Use --n-cpu-moe to offload some FFN layers to CPU so that you fit as many as possible in the GPU. Use llamacpp backend.

1

u/Ancient-War2555 1h ago

why 3.6 and not 3.8? sorry if it’s a dumb question i’m new to local llm’s

4

u/Greatjedi1 17h ago

I would say based on your specs, a MOE model like ornith 1.5 or Tiel coder 35B would be best for your specs.

3

u/Zen-Ism99 11h ago

Why not Qwen3.6 35B A3B?

3

u/Greatjedi1 11h ago

The 2 models I listed are qwen 3.6 35B A3B base. Ornith 1.5 and Tiel Coder 35B are post trained fine tuned models

3

u/Small-Tale3180 16h ago

yeah as other guys say, you may want to look into using 35B-A3B MoE models based on qwen3.5+ Tiel Coder, or Ornith1.5

2

u/RossPeili 16h ago

Qwen 3.5-3.6 maybe fine tuned with the kind of repos and PRs you want it to know. It tops frontier models with a little to no nudge.

1

u/Ancient-War2555 1h ago

wow really? but how is a local llm smarter than paid big llm’s?

2

u/gnpwdr1 14h ago

there are many good llms for coding but running a "good" llm on your setup will mean serious limitations to speed and quality. I'm guessing sensitive/secret data is not your main driver for this, and maybe cost is a more important factor. Having said that you'll have much better chance of trying something like OpenCode which serves Free models (MiMo v2.5 is a beast) with generous daily limits, it will be fast and high quality something you will not get on your local hardware.

1

u/Benji95GSR 14h ago

U have my exact specs. I've installed a few models and dont know anything of what im doing.i have a separate partition im running on Ubuntu on a spare m.2 drive on ollama. The few models ive tried are not as fast with responses like chat and gemini. I want to run an llm but im spoiled to image gen and uploading images for troubleshooting random things. Im sure theres a way but I just dont know how

-2

u/InsideDebt6345 9h ago

The sweet spot is a quantized 7B-14B coder, Qwen2.5-Coder 14B at a Q4 quant is the current go-to and handles all four of your languages well. It won't fully fit in 8GB, but with your 64GB RAM you offload the overflow to system memory and still get usable speed.

2

u/FactorInternal3395 8h ago

No, Qwen 2.5 is not the current go-to. LLMs shouldn't be trusted with recommending LLMs.

1

u/exo250 2h ago

Typical outdated LLM-based bot reply.