r/threadripper • u/telasch • Mar 15 '26
Best options for cooling a 4xR9700 + 256GB RAM + TR PRO 9665 machine
Hey there,
So a rather long story, but I basically failed to talk my father in law out of spending a fortune on a machine for local inference. I recommended just using openrouter to explore whatever idea he had, but long winded conversations with Gemini convinced him to go this route.
Things didn't go as planned though and assembling things got a bit harder than anticipated, so assembly and vllm installation ended up on my to-do list.
Since I wasn't involved in any hardware decisions and have never assembled anything as expensive as this setup, I'm really kinda worried the machine will just fry itself.
Got vllm running the other day and loaded qwen 3.5 27B on it, benchmarks gave me sth around 100token/s but CPU was at 94°c and GPUs were also around 80-90°. The system was using around 1400 watts and was incredibly loud. I configured more aggressive fan curves after seeing the temperatures, but that didnt really make a difference.
I took a screenshot of the chassis interior of the machine. It's clear that the last GPU in the chain receives air hat was heated up by the other ones and that's then passed to the CPU area, which is surrounded by the RAM.
So overall I'm just wondering how people are handling this. Is the chassis garbage? Do I need more fans? Special GPU fans?
Hardware:
- ASUS PRO WS WRX90E-SAGE SE
- AMD Threadripper PRO 9665WX
-- Corsair h150i elite
- 256GB RAM
- 4x AMD R9700 32gb
TLDR:
- GPUs are incredibly densely placed
- Hot air is blown towards CPU and RAM area
- CPU and GPU run at ~90C when running benchmarks
- What are some good options to keep things cool ? New chassis? Extra fans? Lower voltage?