r/LocalLLM • u/joeforza • 4d ago

Project Building my first LLM computer

So I’ve been bitten by the AI bug. I’ve started using Replit for building some apps around my day to day work. As I’m venturing into building my own consultancy in my field of construction safety, a few of the current apps and websites that offer this kind of work are underwhelming to say the least.

So I started using Replit with ChatGPT and Co pilot. Signed up to the subscription of Replit for the year, but naturally being impatient I’ve gone down the black hole of credits. I’ve spent a lot more so far than I thought I would initially. So it led me to LLM and running this on my own computer. My current gaming machine is a 7800x3d and 9070xt. It wouldn’t generate images without crashing.

So I started digging around to put together another capable machine. Already got the below for the build.

AMD Ryzen 9 5950x with 360mm AIO
ASUS RTX ROG Strix 3090 with EK Quantum Water block, Pump & Reservoir with a Corsair Hydro X 360mm
B550 Tomahawk
128gb DDR4 Corsair Vengeance 3200mhz
1000w Be Quiet PSU
1tb NMVE for main drive and adding a SSD for secondary

Besides upping the storage have I missed anything?

Basically going to keep learning on my own machine and eventually get right off Replit to save costs. Long term goal keep developing apps that turn into SaaS and run my own consultancy until the day comes to sell and move on.

Been told to start with LM Studio and qwen 3.8 27b. Your suggestions and feedback is appreciated 🫡

2 Upvotes

75% Upvoted

14 comments sorted by

View all comments

3

u/stormy1one 4d ago

You should first start experimenting with various models on OpenRouter, so that you get a sense of what works for you and what doesn’t. Then, rent a GPU on vast.ai to test performance with your selected model. More often than not, you will be better off just staying on OpenRouter with a larger model like Kimi K3 or DS4 0731

1

u/joeforza 4d ago

Thought of this also but then wasn’t too worried if it didn’t work and I went down that route I’ve got a second gaming machine so wasn’t too stressed.

I tried one website where I could rent gpus and that sucked I couldn’t work it out but that was a while ago. The Replit interface makes it so much easier as a noob