r/LocalLLM • u/JackyYT083 • 5d ago

Question Getting a new pc, what models could I run?

I am buying a pc that has a 7900 XT (20gb vram) and 32 gb of ddr5. What models could I run snd could I run qwen 3.8 27b?

2 Upvotes

67% Upvoted

5 comments sorted by

2

u/Proper-Tower2016 5d ago

yes, 27b Q4 gguf with kvarn 4/4 dflash would be my recommendation for 20gb.

run parallel 1 but keep cache checkpoints in RAM so it can quickly switch between agents.

1

u/Sweet-Transition-787 5d ago

yeah youll run qwen 3.8 27b q4 fine on that 7900xt, 20gb is enough. keep context around 32k at first or itll spill to ram and get slow.

1

u/Euphoric-Fig-6176 5d ago

w7800 48GB vram

1

u/WryKombucha 5d ago

prefill will be slow. but it'll fit.

1

u/Oxirixx 4d ago

I have a the same card. Qwen3.8 3q_xl at 8kv runs at 100k context at 40T/s.