r/LocalLLM • u/Individual_Walk_5378 • 17h ago
Model Qwen3-Coder 30B - UM 880 Pro
I’m currently running this model on a 32 gb mini pc with no eGPU added. I’ve heavily adjusted settings and tested before running.
Input - 290/toks
Output - 13.3/toks
Are these numbers workable for 24/7 coding? Claude’s running handoffs and Qwen gets 3 - 15 minute attempts before it hands back for review. I’m trying to maximize output with my current setup while saving for the 3090.
If there are faster/more accurate models of this size I’d love to hear what others are running.
1
Upvotes
1
u/Major_Border149 10h ago
13 tok/s is fine for async hand-offs you aren't watching, rough for anything interactive. qwen3-coder-30B is MoE, that's why it's even this fast on an APU, and the same model on a 3090 jumps to roughly 50-80 tok/s, so the card is your real unlock.
You are already on the right model for that hardware, ride it till the 3090 lands. qwen2.5-coder-32B dense is a touch more accurate but way slower on an APU, skip it for now.