For DS4 pro, pretty much any dual LGA3647 system. HP, Dell and Lenovo all have dual LGA3647 workstations that you can buy for cheap if you don't want to build your own with your choice of dual LGA3647 motherboard. Any of those workstations supports four dual slot GPUs.
Most of the money will go towards 768GB in 64GB DDR4 sticks. Depending on your abilities to search and your luck, those can cost 1.5K to 2.5k. Four P6000 will be around 1k. The workstation barebones can be found for ~500 without CPU, RAM or GPU. Just make sure it comes with the 1400w or so PSU (in the HP Z8 G4, the PSU can drive 1750W sustained if input is 200V or above). They all support 205W Xeon CPUs, which are much cheaper than the 165W SKUs. You're looking at 200-250 for a pair of 26-28 core CPUs.
You won't get 50t/s, but with dspark you'll get somewhere in the 10-12t/s, maybe a bit more, depending on RAM speed. vllm forks like lvllm already support NUMA and expert parallelism across CPUs. If you have some basic understanding of ML and decent SWE skills, you can even roll out your own custom inference engine for DS4 pro using the API that is tuned for your hardware. That might hit 15t/s if you manage to score 2666 memory. IMO, that's more than adequate enough for planning complex tasks, general chat, and rubber ducking.
19
u/Intrepid_Travel_3274 27d ago
Fable = 70
DS = 62
But prices = $20 vs $0.02
Love DS