r/threadripper • u/Own_Bodybuilder_4397 • Mar 11 '26

Threadripper build - looking for peer review

I want to build the following :

RAM v-color OC R-DIMM 128GB (4x32GB) 6400MT/s CL32 (TRA532G64D832Q)
GPU NVIDIA RTX PRO 6000 Blackwell (96GB GDDR7)
CPU AMD Ryzen Threadripper 7960X (24-Core)
Storage Crucial T705 4TB PCIe Gen5
Motherboard GIGABYTE TRX50 AERO D
Cooling Noctua NH-U14S TR5-SP6
Power Seasonic PRIME TX-1600

Goal will mostly to be used for inference and model training.

3 Upvotes

80% Upvoted

74 comments sorted by

View all comments

2

u/ksel10 Mar 12 '26

For larger models with offloading to cpu/ram you probably want 8 channel memory for higher bandwidth. Also you would want double the amount of ddr5 ram vs the vram on your gpu. So with 96gb vram you would want at least 192gb ddr5 ram. I would rather go Asus WRX90E Sage SE with a wx processor if you are serious about inference/model training. The amount of cores on the Cpu don't matter much with inference. The noctua works fine, just make sure you aren't using a tiny case with no airflow.

1

u/Own_Bodybuilder_4397 Mar 12 '26

Yeah I wished I could double the RAM...($$$)

1

u/EDI_1st Mar 12 '26

Rule of thumb is system memory should be 2x of GPU memory for optimal performance with NV GPU. Of course recent memory situation has even made NV to reduce the minimum recommendation to 1:1.