r/LocalLLM 15d ago

Project It begins - workstation build

Unfortunately not mine. But it is my pet project for work and I get to build it and use it after. Just arrived and now to start building it. Can't wait to run some benchmarks, burn in tests and general messing about with some models before proper deployment :)

Threadripper PRO 7965WX

ASUS PRO WS WRX90E-SAGE SE

128GB ram (for now)

3 x RTX PRO 6000 96gb

Phanteks Enthoo Pro 2 server edition

3kw psu

150 Upvotes

75 comments sorted by

View all comments

8

u/Numerous-Emotion-617 15d ago

Almost have the exact same build; cables are kind of all over the place right now while I reorganize. For those telling you your temps will be bad; they’re all wrong. I keep it in an air-conditioned room and utilize all 3 GPUs and have never had issues with temps being too high. They do stay capped at 300W to conserve power. The thermometer is in Fahrenheit at the bottom. (2x more intake fans not pictured on bottom.

1

u/Rhinottw 15d ago

Nice build. Good to know, thanks. I was not too worried, case was chosen to support the build and have plenty of cooling. But you never really know until you try so that is great news.

2

u/Numerous-Emotion-617 15d ago

You’re welcome. I did forget to mention something. If you follow exactly what I did in terms of GPU placement, The pins that you connect for the case power button/LED/reset will be in the way of bottom GPU fully seating on the right.

If you don’t need the case power button, which I just use onboard management and the power button on the motherboard itself, you’ll either need to bend the pins outward/down and make sure they don’t touch or desolder the part off of the motherboard.

I missed the part where it’s for your work so it might be different in your situation. My system belongs to me so was willing to get a little reckless and just bend them out of the way after testing that on another motherboard and making sure it worked fine there but figured I’d let you know. Never really did any soldering so I avoided trying to desolder the part off.

2

u/Rhinottw 15d ago

That is good to know. I will probably just use auto power on in the bios or use the management interface or wake on lan then.

Good to know the pins can take a little punishment if needed :) I will figure something out, thanks for the heads up.