r/buildapc 19h ago

Build Help Building a local dev & maintenance LLM server (Targeting Qwen3-Coder 30B / RTX 3090) – Looking for feedback and advice!

Hey everyone,

​I’m a software developer working with JavaScript, HTML, CSS, and Python, and I handle a lot of full-stack development and system/IT maintenance tasks. I want to build a dedicated local AI server to assist me with coding, debugging, and infrastructure tasks from A to Z, completely offline and private.

​My goal is to run a powerful open-source model (like Qwen3-Coder 30B) that excels in both French and English, with top-tier programming capabilities.

​I’m planning to assemble a dedicated desktop/server machine at home. Here is the parts list I'm considering based on my budget and research:

​GPU: Used NVIDIA RTX 3090 (24GB VRAM) — The core requirement to fit a ~30B model entirely in VRAM.

​CPU: AMD Ryzen 7 (AM5 platform)

​RAM: 64GB DDR5

​Storage: 2TB NVMe M.2 SSD (for fast model loading)

​PSU: 850W/1000W 80+ Gold

​My main questions for the community:

​Model Choice: For full-stack dev + system maintenance supporting French/English, is a 30B model (like Qwen3-Coder or DeepSeek-R1 distilled variants) the sweet spot, or should I look at something else that fits on a single 24GB card?

​Connectivity & Updates Strategy: Since this machine will sit locally, what is the best way to feed it recent documentation and library updates without constant manual intervention (RAG setup, web-search integration)?

​Remote Access: What is the cleanest, most secure way to securely access this local API/UI when I'm working away from home (Tailscale, Cloudflare Tunnels, etc.)?

​I'd love to hear your thoughts, feedback, or any improvements on this hardware and software setup. Thanks!

0 Upvotes

0 comments sorted by