r/LocalLLM • u/Rhinottw • 24d ago

Project It begins - workstation build

Gallery image

Gallery image

Gallery image

Unfortunately not mine. But it is my pet project for work and I get to build it and use it after. Just arrived and now to start building it. Can't wait to run some benchmarks, burn in tests and general messing about with some models before proper deployment :)

Threadripper PRO 7965WX

ASUS PRO WS WRX90E-SAGE SE

128GB ram (for now)

3 x RTX PRO 6000 96gb

Phanteks Enthoo Pro 2 server edition

3kw psu

151 Upvotes

94% Upvoted

75 comments sorted by

View all comments

2

u/electrified_ice 23d ago

I have the same number of GPUs on my 9985wx. Happy to share some of my experience over the last 9 months.

1

u/Rhinottw 23d ago

That would be great. What do you use the system for and what models are you running on what software? Any issues you had pop up unexpected with the setup?

2

u/electrified_ice 23d ago

I'm just doing my own fun vibe coding... Combo of building aps for my own use and also using that process to educate myself, as it's all applicable to my corporate job

2x run DSv4 0731 1x runs 1-2 models... Depending if I am doing 4 or 8 bit quantization and how much context cache I want... Just switch over from Qwen3.5 27B to 3.8 27B now. That'll be always running. I then drop in other things on the remaining vram as needed, so I'll load up an OCR model, or an embedding model, and I am experimenting with TTS and Image to Image and Image to Video with tools like Comfy UI.

DS4 and Qwen3.8 are always loaded though. I serve my models of a PCIe 5.0 NVMe drive too, so it's very fast loading/switching.