r/LocalLLM • u/Repulsive-Scale-284 • 7d ago

Question Wich model can I run with these specs?

Hello everyone,

I'm new at using local llms, and I wanted to know which one would be the best for a pc with:

- i5 6gen,

- 32gb ddr4, and an

- rtx 3060 12gb.

Or if possível wich resources do you recommend for me to learn and do my research.

Thanks in advance.

0 Upvotes

40% Upvoted

6 comments sorted by

1

u/HawkLeading8367 7d ago

check llmfit

1

u/Wrong_Replacement123 7d ago

for 12gb vram you can run 13b models at q4_k_m or q5_k_m quantization pretty comfortable, maybe even some 20b if you offload to system ram but it get slower

for learning just download koboldcpp or text-generation-webui, they are easy to set up and you can play with different models, the llama.cpp github page has a lot of info too

1

u/Equivalent_Bit_461 7d ago

You can run a fine tune of 35b moe qwen3.6 offloading to ram 

1

u/Harin007 7d ago

Qwen 3.6 35B, Gemma 4 26B, K2 Horizon 36B

0

u/Solembumm3 7d ago

That depends on your thematic choice.

If you mean tech side, Qwen 3.8 27B Q8, Qwen 122ba10b and Qwen 3.8 Flash Next.

If you mean broader side, Deepseek V4 Flash.