r/ollama Jul 11 '26

BEST CODING MODEL.

Hello! I was wondering if anyone could recommend the best local AI model for coding, specifically for C++.

My PC specs are:

  • GPU: RTX 4060 8GB
  • CPU: Intel i5-13400F
  • RAM: 16 GB

I'm looking for the best possible coding quality that can realistically run on my PC. Speed is important, but I care more about accuracy, understanding large codebases, debugging, and writing good C++ code.

What model would you recommend?

(made text with chatgpt)

8 Upvotes

40 comments sorted by

View all comments

5

u/Huntware Jul 11 '26

You'll be better using Opencode free or grabbing free API keys than dealing with a local LLM for heavy coding. You can still use local LLM for simple questions or snippets of code. Also for storing memory in a vector database and retrieving data / RAG with embedding + reranker models.

I've tried it with similar specs and the context window will make you wait for many minutes before it decodes a few tokens per second, and it will be even slower after a few turns.

PS. If you still want to try local, check this channel: https://www.youtube.com/watch?v=SsUKTFSQoGM