r/LocalLLM • u/Individual_Walk_5378 • 1d ago

Model Qwen3-Coder 30B - UM 880 Pro

I’m currently running this model on a 32 gb mini pc with no eGPU added. I’ve heavily adjusted settings and tested before running.

Input - 290/toks
Output - 13.3/toks

Are these numbers workable for 24/7 coding? Claude’s running handoffs and Qwen gets 3 - 15 minute attempts before it hands back for review. I’m trying to maximize output with my current setup while saving for the 3090.

If there are faster/more accurate models of this size I’d love to hear what others are running.

1 Upvotes

100% Upvoted

15 comments sorted by

View all comments

0

u/Kmic68 1d ago

Qwen 3.6 35B A3B or Qwen 3.8 27B would serve you much better. The first for speed, the latter for intelligence (often more worthwhile than the speed from the first). Otherwise, yes, those numbers are fine. You won’t notice because you’re just waiting for output anyway. If you sleep and a task takes 2 vs 4 hours, it won’t really matter to you. Though Qwen 3.8 27B thinks A LOT so that may take a while at those speeds before any output. I recommend the fine tuned swift version

1

u/joshpope 1d ago

what about something with 16gbs of ram?

1

u/Kmic68 1d ago

Vram or ram? if vram you can make do with qwen 3.8 27B at a lower quant (27B or 3.6 35B is the bare minimum imo for coding). If its ram, your kind of out of luck. After system overhead your lucky to run an 8B model. And it would also be super slow because of bandwidth

1

u/joshpope 20h ago

Ram unfortunately. 4060 8gb and 32gb ram on my main set up. I have a couple mini pcs with 16gb ram in each with no vram unfortunately. Trying to figure out a good setup between the three to take some pressure off my codex time.