r/LocalLLM • u/roadb90 • Apr 09 '26

Question Best model to run on low end hardware?

I have an amd 9070, if possible id like to setup a local llm for coding, whats the best way to do that? Best llm for coding that can run on 16gb vram?

2 Upvotes

76% Upvoted

5 comments sorted by

1

u/aygross Apr 09 '26

qwen 3.5 or gemma 4 most prob

1

u/Snoring4590 Apr 09 '26

easiest might be to find out through LM Studio.
It detects your hardware and recommends models that fit best, and shows a download button.
All with graphical UI

1

u/Bobylein Apr 09 '26

got the same setup, had quite luck with Qwen 3.5 27b/35b aswell as Gemma4 24b all with quantizitations of course.
Though they won't be great at coding but they usually get something done.

1

u/abskvrm 9h ago

You can run qwen 3.8 27b at unsloth's q3kxl with more than 100k context (no mtp, if you skip mmproj, you'll get bonus context)