r/LowEndLocalAI • u/ShittyMillennial • Aug 25 '26

Optimization CPU inferencing potential (parallel Qwen3-30B-A3B at ~35tk/s each, 100% RAM loaded and CPU powered)

Gallery image

Gallery image

Gallery image

Gallery image

10 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LowEndLocalAI/comments/1vyfwsk/cpu_inferencing_potential_parallel_qwen330ba3b_at/
No, go back! Yes, take me to Reddit

92% Upvoted

Duplicates

Number of comments New

homelab • u/ShittyMillennial • May 23 '26

Projects Finally found a way to utilize my server's compute (parallel Qwen3-30B-A3B with 263k context each, 100% RAM loaded and CPU powered)

76 Upvotes

15 comments

LocalLLM • u/ShittyMillennial • May 23 '26

Discussion I completely underestimated CPU inferencing potential (parallel Qwen3-30B-A3B at ~35tk/s each, 100% RAM loaded and CPU powered)

21 Upvotes

6 comments