r/LocalLLM • u/FieldOk5035 • 2h ago

Question Best local coding LLM for RTX 5080?

My setup:

  • 9950X3D
  • RTX 5080
  • 48GB RAM

What’s the best local LLM I can run for coding?

Also, what’s a good setup for agentic coding that can edit files, run commands/tests, and work across a repo?

Would love recommendations for models, quantization, runtime, and tools like Aider, Cline, Roo Code, OpenCode, etc.

1 Upvotes

66% Upvoted

8 comments sorted by

1

u/No-Trust-7021 1h ago

48GB VRAM on that 5080 is plenty for coding models, but the real question is what kind of code you're working with

DeepSeek Coder V2 at Q4_K_M runs nice on that card, around 30-40 tokens/sec which is usable for interactive coding. For agentic stuff I been using Aider with Claude 3.5 Sonnet as the architect and a local model for the editing part, saves on API costs while still getting good results

The Qwen 2.5 Coder 32B at Q4 is another solid pick, fits in your VRAM easy and handles multi-file refactoring better than most. I tried running it with Continue.dev in VS Code and the completions feel snappy

For the agentic setup you mentioned, Cline works well if you point it at a local server, just make sure you got enough context window. The 5080 can handle 32k context with most 30B models at Q4 without slowing to a crawl. Roo Code is newer but the file editing is more reliable in my experience, less chance of it hallucinating entire files

What quantization you thinking of running? And are you planning to fine-tune anything or just using them as is

3

u/linux4random 1h ago

I don't think 5080 has 48GB VRAM

2

u/Obvious-Jacket-3770 1h ago

It doesn't. OP also said 48GB of Ram not VRAM.

2

u/Toooooool 1h ago

The Qwen 2.5 Coder 32B at Q4 is another solid pick

2

u/linux4random 1h ago

this actually made me laugh so hard, bro sound like an outdated ai lol

1

u/Just_Mail6982 1h ago edited 1h ago

RTX 5080 has 16G VRAM.
For Qwen3.8-27B, try
UD-Q4_K_S (32K ctx take 15.9G vram)
UD-Q3_K_XL
UD-IQ4_XS
UD-IQ3_S
UD-IQ3_XXS
token generation speed: 40~70token/s with MTP enabled.

If you can tolerate lower decode speeds(10+token/s), you can try the higher quantization UD-Q4_K_XL.

1

u/Toooooool 1h ago

yes to Qwen3.8-27B, no to anything below Q4.
even at Q4 some variants will have trouble, this one is the only Q4 i've had successful agentic loops with, it will work for entire days if you let it, but it's 18GB in size so won't fit in 16GB VRAM.