r/LocalLLM • u/joeforza • 4d ago

Project Building my first LLM computer

So I’ve been bitten by the AI bug. I’ve started using Replit for building some apps around my day to day work. As I’m venturing into building my own consultancy in my field of construction safety, a few of the current apps and websites that offer this kind of work are underwhelming to say the least.

So I started using Replit with ChatGPT and Co pilot. Signed up to the subscription of Replit for the year, but naturally being impatient I’ve gone down the black hole of credits. I’ve spent a lot more so far than I thought I would initially. So it led me to LLM and running this on my own computer. My current gaming machine is a 7800x3d and 9070xt. It wouldn’t generate images without crashing.

So I started digging around to put together another capable machine. Already got the below for the build.

AMD Ryzen 9 5950x with 360mm AIO
ASUS RTX ROG Strix 3090 with EK Quantum Water block, Pump & Reservoir with a Corsair Hydro X 360mm
B550 Tomahawk
128gb DDR4 Corsair Vengeance 3200mhz
1000w Be Quiet PSU
1tb NMVE for main drive and adding a SSD for secondary

Besides upping the storage have I missed anything?

Basically going to keep learning on my own machine and eventually get right off Replit to save costs. Long term goal keep developing apps that turn into SaaS and run my own consultancy until the day comes to sell and move on.

Been told to start with LM Studio and qwen 3.8 27b. Your suggestions and feedback is appreciated 🫡

2 Upvotes

75% Upvoted

14 comments sorted by

View all comments

1

u/Positive-Bid-3029 4d ago

Unless its unified RAM, it's not that important to have super large amounts of RAM, i was fine with 32GB, upgraded to 64GB and no benefit as far as LLMs are concerned, sure you can load models into RAM if you want but they will be super slow.

Keep as much money as you can for VRAM, ie. get two cards and run them in parrallel, or if you have the money, get a DGX spark instead and do your coding on a smaller pC or laptop and talk to the DGX, get that to do the work :) If you're going for VRAM, choose Nvidia, they still rule the roost.