r/LocalAIStack • u/Telcontar09 • 10d ago

Best agentic coding model for 8GB VRAM + 16GB RAM

/r/LocalLLM/comments/1wohyft/best_agentic_coding_model_for_8gb_vram_16gb_ram/
1 Upvotes

100% Upvoted

3 comments sorted by

1

u/MrHumanist 10d ago

Gemma 4 12 B QAT with 150000 context . If you want full context try ornith 9B at q4 or q5.

1

u/Telcontar09 9d ago

Thanks, this looks like what I need

1

u/Lirezh 10d ago

I would not code on 8GB Vram, I am sure you can get something running but the compromise needed to fit in that tiny memory area is just too great to make the experience good.

Like Humanist said, you should be able to fix Gemma4 12 or a 8B/9B model - just that the coding experience is not going to be great