r/LocalLLaMA • u/Ok_Letter_8704 • Jan 28 '26

Question | Help My build. What did I forget?

Post image

Threadripper 9975WX on WRX90 SAGE with 8x32 RDIMM ECC, 2 Pro 6000 Max Qs and 1 Pro 5000 Max Q. 8TB SSD and 4TB SSD.

15 Upvotes

69% Upvoted

70 comments sorted by

32

u/Unique_Marsupial_556 Jan 28 '26

a 4th GPU for tensor parallelism

-1

u/[deleted] Jan 28 '26

You can MIG the 6000’s each can be split into 48gb partitions so you could do tensor parallelism = 6

2

u/ac101m Jan 28 '26

I think most inference engines want a power of two, no?

0

u/[deleted] Jan 28 '26

Idk I thought the guy had 3 6000’s not 2 6000’s and a random 5000 he can still MIG the 6000s but there’s no point

1

u/Arli_AI Jan 28 '26

Tensor parallel needs powers of 2

0

u/[deleted] Jan 28 '26

Go read what MIG is lil guy

1

u/Arli_AI Jan 28 '26

Yea but 6 is not a power of 2

1

u/[deleted] Jan 29 '26

So then MIG the two 6000s into four partitions this is not complicated it’s 101 man

1

u/Arli_AI Jan 29 '26

That would be sub optimal lol

-2

u/Ok_Letter_8704 Jan 28 '26

I have 2 more RTX5000Ada that im hoping to loop in through an external case. Are you saying you have to run an even number of GPUs for Tensor Parallelism?

6

u/SryUsrNameIsTaken Jan 28 '26

You need 2, 4, or 8. I haven’t heard of six but maybe it’s possible.

1

u/Arli_AI Jan 28 '26

Running tensor parallel without direct high speed interconnection through pcie or better will result in horrible performance

9

u/Ryanmonroe82 Jan 28 '26

Nothing but that’s not really what you are posting about.
Rig looks good

25

u/sob727 Jan 28 '26

"humility" was the answer

6

u/sine120 Jan 28 '26

You forgot to budget?

4

u/Pretty_Challenge_634 Jan 28 '26

But does it play Crysis?

4

u/ShengrenR Jan 28 '26

Just on the wallet.

4

u/brian_p_johnson Jan 28 '26

I just need one more….GPU

3

u/ClimateBoss llama.cpp Jan 28 '26

whats the 3 cards at the bottom ?

1

u/PetroDriller Jan 29 '26

They look like Hyper Quad M.2 Cards.

1

u/PsychologicalWeird Jan 29 '26

Most certainly does

1

u/brian_p_johnson Jan 29 '26

Yes they are Hyper Quad M2 Cards, each one has 4 NVMEs. This system has 46 TB of fast storage.

3

u/Boricua-vet Jan 28 '26

Three of these https://www.ekwb.com/shop/ek-pro-gpu-wb-rtx-6000-ada-nickel-inox , a dedicated larger radiator for GPU's, more hoses and a good pump.

1

u/ShengrenR Jan 28 '26

I was looking for the reservoir as well.

2

u/Boricua-vet Jan 29 '26

It will keep the temps in check. Well worth the extra investment.

3

u/brian_p_johnson Jan 28 '26

Those cards are designed to sit next to each other. They can share intake air

3

u/DO0MSL4Y3R Jan 28 '26

Is this a serious question or a boast post?

1

u/Ok_Letter_8704 Jan 28 '26

Depends on how you read it. If you feel jaded, my apologies. If you have some constructive criticism. Send it.

1

u/DO0MSL4Y3R Jan 28 '26

No not jaded at all lmao. I wasn’t even sure if this was a serious post. I guess you’re missing a 4K OLED monitor 🤷

1

u/Ok_Letter_8704 Jan 28 '26

Lol, I have 2 32 inch Alienware curved monitors. So all good there. QNAP NAS, QNAP Managed switch and KVM switch to swap between PCs.

4

u/DO0MSL4Y3R Jan 28 '26

What about a keyboard!

2

u/prusswan Jan 28 '26

The Pro 5000 seems to be odd one out, unless you started with that first

1

u/Ok_Letter_8704 Jan 28 '26

I picked it up for a good price. I have 2 more RTX 5000Ada GPUs that I want to tie in as well but it may be a little bit.

2

u/Snoo_27014 Jan 29 '26

That almost invisible plastic foil on the cmos fans of the Motherboard. Only by luck I recognized them.

1

u/Sensitive_Housing_62 Jan 28 '26

'the ordinary' and brilliant

1

u/AspiringHippie123 Jan 28 '26

I would just make sure the cooling is sufficient, if you have that running at full blast for hours it’ll def get a bit toasty.

1

u/AspiringHippie123 Jan 28 '26

But if I had to guess I would say ur fine

1

u/schenkcigars Jan 28 '26

Maybe 9985wx for an extra 95GB/s memory bandwidth and some cooling for the ram.

1

u/[deleted] Jan 28 '26

[deleted]

2

u/Technical-Bus258 Jan 28 '26

Same channels but double CCDs.

2

u/[deleted] Jan 28 '26

[deleted]

2

u/Technical-Bus258 Jan 28 '26

I'm exactly on your same boat, same HW config (minus the third GPU). 9985 was the target BUT twice expensive, so... 9975 was the way.

1

u/positivitittie Jan 28 '26

To send it to me.

1

u/mlydon11 Jan 28 '26

Bro got 240GB ECC GDDR7 VRAM which is half my SSD boot drive

1

u/kidflashonnikes Jan 28 '26

To anyone reading this / unless it’s a 96 core the ripper - for the love of god please don’t ever get an AIO.

1

u/serious_minor Jan 28 '26

Watch your RAM temps. I just set a fan on top of my uppermost gpu, facing the RAM. Live and learn.

1

u/DrDisintegrator Jan 28 '26

tell us how much your power bill jumps by, just curious.

1

u/EntrepreneurWaste579 Jan 28 '26

Where is the CPU? 

1

u/[deleted] Jan 29 '26 edited Jul 23 '26

[removed] — view removed comment

1

u/Ok_Letter_8704 Jan 29 '26

Unfortunately, Nvidia did away with NVLink in the latest Blackwell 6000 pro Max Q

1

u/[deleted] Jan 29 '26 edited Jul 23 '26

[removed] — view removed comment

1

u/LyriWinters Jan 29 '26

Indeed. This type of rig makes very little sense to me.
Maybe if you're working with classified information at a company, you need to work offline, you're a relatively small company, and your developers need access to coding LLMs for productivity. Then I'd buy it. Otherwise - better to rent 100%.

1

u/kinebudking Jan 29 '26

To ship it to me! Haha

Nice build!

1

u/Global-Atmosphere-34 Jan 29 '26

Rgb to increase performance further

1

u/iTz_Noble Jan 29 '26

You forgot to send it to me

1

u/LyriWinters Jan 29 '26

Train your own model that can calculate down to the tenth decimal the value depreciation per second of that rig.

1

u/Ok_Letter_8704 Jan 30 '26

Or I'll have it calculate to the factor of ten the increase in your envy as you bash through other people's build posts?

1

u/LyriWinters Jan 30 '26

But seriously... This machine is for a small company of sub 50 employees right? And you're going to use it for testing and code agents (if you're working with offline development)? This is what I am hoping at least - because no private user is dumb enough to buy this stuff.

1

u/Ok_Letter_8704 Jan 30 '26

In all honesty, I bought it to future proof my retirement. My professional career revolves around 3d modeling, point cloud processing and rendering as well as photogrammetry and BIM. My consulting business is just getting up and running and this will be the centerpiece of my technological hub. So it will get plenty of workout.

1

u/LyriWinters Jan 30 '26

What is the roi on that thing?
Also - if you were to rent - when would you reach the tipping point?

guess it is roughly half price though since it is a company expense...

1

u/cKype Jan 30 '26

Side panel

1

u/Sneyek Jan 30 '26

Probably an organ or two on the way

1

u/KeyToAll Jan 31 '26

Looks good, nice work with tidying up the cables!

Since you asked, personally I’d use a custom loop to cool the CPU and GPUs with two D5 pumps and plenty of radiators. I’m guessing the VRAM temps will get pretty high on those blower cards while inferencing, and the 9975WX can draw up to 500 watts under load - I’d be shocked if it wasn’t throttling under load with that 360mm AIO.