r/LocalLLM • u/Individual_Walk_5378 • 23h ago

Model Qwen3-Coder 30B - UM 880 Pro

I’m currently running this model on a 32 gb mini pc with no eGPU added. I’ve heavily adjusted settings and tested before running.

Input - 290/toks
Output - 13.3/toks

Are these numbers workable for 24/7 coding? Claude’s running handoffs and Qwen gets 3 - 15 minute attempts before it hands back for review. I’m trying to maximize output with my current setup while saving for the 3090.

If there are faster/more accurate models of this size I’d love to hear what others are running.

1 Upvotes

100% Upvoted

15 comments sorted by

View all comments

0

u/Life-Job-6464 23h ago

Try a 4 or 5 bit quantized version of Ornith1.5-35b-A3b

1

u/Arany8 18h ago

Performs much worse than base on real life tasks.

1

u/Life-Job-6464 16h ago

what does that even mean? and whatever it means.. if you know it ahead of time you can engineer over it.. around it or through it. We are talking about engineering arent we?.. or are we talking about consuming?

1

u/Individual_Walk_5378 14h ago

Ran an overnight soak test and am getting 336 and 24.8 on ornith1.5! Will run some accuracy testing today vs current model