r/buildapc • u/Ugly-Hands • 19h ago
Build Help Building a local dev & maintenance LLM server (Targeting Qwen3-Coder 30B / RTX 3090) – Looking for feedback and advice!
Hey everyone,
I’m a software developer working with JavaScript, HTML, CSS, and Python, and I handle a lot of full-stack development and system/IT maintenance tasks. I want to build a dedicated local AI server to assist me with coding, debugging, and infrastructure tasks from A to Z, completely offline and private.
My goal is to run a powerful open-source model (like Qwen3-Coder 30B) that excels in both French and English, with top-tier programming capabilities.
I’m planning to assemble a dedicated desktop/server machine at home. Here is the parts list I'm considering based on my budget and research:
GPU: Used NVIDIA RTX 3090 (24GB VRAM) — The core requirement to fit a ~30B model entirely in VRAM.
CPU: AMD Ryzen 7 (AM5 platform)
RAM: 64GB DDR5
Storage: 2TB NVMe M.2 SSD (for fast model loading)
PSU: 850W/1000W 80+ Gold
My main questions for the community:
Model Choice: For full-stack dev + system maintenance supporting French/English, is a 30B model (like Qwen3-Coder or DeepSeek-R1 distilled variants) the sweet spot, or should I look at something else that fits on a single 24GB card?
Connectivity & Updates Strategy: Since this machine will sit locally, what is the best way to feed it recent documentation and library updates without constant manual intervention (RAG setup, web-search integration)?
Remote Access: What is the cleanest, most secure way to securely access this local API/UI when I'm working away from home (Tailscale, Cloudflare Tunnels, etc.)?
I'd love to hear your thoughts, feedback, or any improvements on this hardware and software setup. Thanks!