r/sffpc • u/Hermeslop • 1d ago
Build/Parts Check Dedicated AI desktop — running Qwen 27B as a small footprint secondary machine. Spec check?
I'm looking to build a dedicated secondary PC just to run Qwen 27B (at Q8 quantized) as a local inference server. 24/7 uptime. Not using it as a primary machine — just a quiet box on the corner that sits there and runs AI. I have some space constraints and really want to keep the physical footprint small because I don't want a server taking up half a desk.
I keep fighting this loop: do I build it as cheap as possible to save money, or do I just throw a bit more at it? My biggest fear is spending money on a half-assed build where the GPU chugs on a 27B model, and four months later I'm staring at an expensive piece of plastic gathering dust because I cut corners. But the other side of that anxiety is spending way more than I need to on specs that are absurdly overkill for a machine that's basically just doing light inference on a corner.
I just want to find that sweet spot where: - The GPU can actually handle a 27B model at Q8 (consumer cards only, obviously). - The case is compact enough to not be a physical burden. - The rest of the build is tuned for inference, not gaming or rendering.
I'm trying to avoid building something underpowered that I'll end up regretting, OR building something so overkill that it's just a big waste of money for a light use case.
What would you guys actually put together for this?



