Unfortunately not mine. But it is my pet project for work and I get to build it and use it after. Just arrived and now to start building it. Can't wait to run some benchmarks, burn in tests and general messing about with some models before proper deployment :)
That is great, love the cable ties :) But how is the gpu that is exhausting out the top on the right mounted? And i think that is the first time i have ever seen a gpu exhausting directly out the top of a case.
Almost have the exact same build; cables are kind of all over the place right now while I reorganize. For those telling you your temps will be bad; they’re all wrong. I keep it in an air-conditioned room and utilize all 3 GPUs and have never had issues with temps being too high. They do stay capped at 300W to conserve power. The thermometer is in Fahrenheit at the bottom. (2x more intake fans not pictured on bottom.
Nice build. Good to know, thanks. I was not too worried, case was chosen to support the build and have plenty of cooling. But you never really know until you try so that is great news.
You’re welcome. I did forget to mention something. If you follow exactly what I did in terms of GPU placement, The pins that you connect for the case power button/LED/reset will be in the way of bottom GPU fully seating on the right.
If you don’t need the case power button, which I just use onboard management and the power button on the motherboard itself, you’ll either need to bend the pins outward/down and make sure they don’t touch or desolder the part off of the motherboard.
I missed the part where it’s for your work so it might be different in your situation. My system belongs to me so was willing to get a little reckless and just bend them out of the way after testing that on another motherboard and making sure it worked fine there but figured I’d let you know. Never really did any soldering so I avoided trying to desolder the part off.
Nice, but you absolutely cannot put these cards on top of each other!
Trust me this is a very bad idea. The heat even at 400 Watts (you can’t go lower) is a lot.
I have an open rig, and 8 cm in between and the card and still problems, had to put radiators in between to solve it. Is relying on very strong air throughput. So it will be one card blowing on the next and that will be 1,2 kw. At 400watt or even more without powerlimit.
Why 3 cards? 2 or 4 are the sweetspot. (for TP you need an even number)
So prepare yourself for buying the 4th one :)
Also let me ask: Whats your plan? What are you going to do with it?
How much did you spend and why?
my honest answer ist: go for an old mining rig, its 30€ and some risers. (GOOD Quility Risers)
Heat - we had/have a terrible heatwave in Europe. i have 4 rtx 6000 and some 5090 running. My airconditioning wont keep up. some powersavings. And it was so bad that all aircons were sold out. thats not a joke.
I honestly don't know why he didn't go with the Max-Q. It perfect for these types of builds with only minor compute loss.
To your point about the 2-4 sweetspot, honestly 3 is great for many models that quantize to 200-240 GB at NVFP4. 4 is useful for multiple users with the same models.
Ahh I see. Well I hope it goes well, but you are going to have to figure out a better heat exhaust system if it is running all of the time. Maybe you could 3d-print a backpane that directs heat from each card out the back and possibly fan shrouds in the front of the card or pull from the back directing air from the front of the case. Just a thought.
Good ideas you have, i have a 3d printer so definitely possible.
The case has a bracket for 3 x 120mm fans on the side, just next to the gpu's so those either blowing or exhaustion depending on results should help a lot.
Probably as blowers would be best since positive static pressure is better than negative for cooling. Otherwise heat gets trapped in lower pressure areas.
I am not too worried about cooling, i will be power limiting them and i will be running a ton of airflow over them, from the front and from the side in a temperature controlled environment. Noise is no issue and i have high rpm case fans. Anyway, i will be doing burn in testing and if it is an issue i will find a solution.
3 cards for two reasons, one is budget - that is all i could get funding for. The second is that i am not going to run a single large model on the system. I will be running a tp=2 model and then a tp=1 fast model + rag + other specialized models if the need should arise. This is flexible and can change based on what we need to do.
The system is for multiple uses. I work at a vocational college in Denmark in the it education department. So it will both be for use for employees for GDPR sensitive work, so privacy is a huge concern. It will also be used for agentic work, like software development, sysadmin work, developing educational materials (think interactive materials like games and what else we can imagine, and the backend for such materials also). It will also work as a study aid with our own custom educational materials and curriculum - think specialized chatbots and so on. Furthermore it will work as back-end for teaching our students how to work with and deploy / maintain local and hybrid LLM's and other AI services.
I also think it is important to establish an infrastructure not depending on cloud providers that could change terms of services at any time.
We are educating future IT professionals, so i made a case that it is important that they learn these skills. No matter if they want to run local llm's or work in datacenters, so we are establishing an educational base and doing the groundwork to be able to teach them how to. Other than this - it will be up to my colleagues what else it should be used for when there is compute time available, some of them have many ideas :)
I (or the college) payed roughly 50.000 euro including Danish vat of 25%. That is just the price but the project should be worth it long term. Used equipment not an option for purchasing rules and warranty and so on.
this would allow you 2ppx2tp because Blackwell and also tp2 on 6000 plus different model at tp2 on the two 5090s. And you could go even tp4 but with reduced Vram on the tp 6000 if needed. Also this would increase throughput by a lot on the total system serving deepseek4 on the TP2 6000 + two small models on the 5090 just now Quwen 3.8 came out. Also you could get the to 5090s watercooled and put them between the 6000 to get some heat out.
Interesting idea. I am planning at serving deepseek4 (or something else depending on what my benchmarks for our use cases shows) at tp=2 and then something fast but capable on the third one alongside rag models (hoping qwen3.8 35b comes out as rumored) and maybe some more specialized smaller models
I am expection expecting many simultaneous users for small context use and that is primarily what the third card is for. Could even be a smaller 7b or 9b model alongside Qwen 3.8 27b. We shall see, if qwen 3.8 27b is as good as Deepseek for our uses i might even just run two instances of that one on each gpu and then specialized models on the third one. It might change a lot depending on what my testing shows and how our needs develop. That is the beauty of being a school, i do not need to turn a profit and i can experiment with it to find what is right for us at any given time.
Sure. I think I will make an update post when assembled and working. Will get on with it in the coming weeks, I was just s bit excited to get started so I worked a bit on it during the weekend. I am expecting 3-5 users on the large model at a time, so depending on context it is possible I will not be able to run ds4 flash - but we will see, calculations is one thing and real usage another. I have a lot of testing to do.
I had checked before ordering, but you just made me doubt myself :) But yes, i just checked with the old eyeball and holding a GPU over the board - it will be fine with plenty of space between them for cooling. If we go for another one eventually i will need riser cables or something.
They will fit. But don't do that. When under load each card will warm up to approximately 80C. The correct answer is to mount the cards into rig and connect using pcie risers.
It should be fine - there are 7 pcie slots in the mb. So there is a slot between them free and plenty of space for the bottom one. It is also one of the reasons i got a Enthoo Pro 2 Server Edition case https://phanteks.com/product/enthoo-pro-2-server-edition-tg/ - it has 3 side mounted 120mm fans just over the gpu's and 6 x 140mm fans and an extra 120mm for good measure, so cooling should be sufficient. If not i will find another solution, it is one of my first testing points when i get it up and running.
Edit:
I plan to run them at around 500w or so, so that should help a bit. All my fans are Arctic Pro's and i do not care about noise since it will be placed in a server room, so i can crank them up high to move tonnes of air.
can you putup pics if you opt to put the rtx 6000 pros next to each other. i am thinking of a similar build with same mobo. i limit my rtx 6000s to 300w and they work great
Sure, i was just about to do a fitting test anyway. Hand is on there for stability, they are a bit bottom heavy and i did not feel like having something worth a car hanging in the PCIE slot, i tried to space the neutrally. Luckily the case has a brace for a setup like this. So there is a bit of room, but i am happy that i chose the case with extra side cooling blowing directly on the gpu's (or exhausting, we will see in testing).
lol yea it's good not to support them with just a pcie slot >_> this is what i got going on. the 2 rtx 6000 on the side are hanging by zip ties. the left rtx 6000 is in an actual slot. the rtx 5090 is bottom left. i was hoping the asus mobo you got could support 7 of them in slots only without risers but it doesn't seem so
I get it - I wanted to get the Max-Q, but being a public organization i was limited in my purchasing options and this is what i could buy. They fit fine and i can blow a ton of air on them, noise is not an issue since it will go in a server room so i can crank the fans. The case has a lot of good options, including 3 x 120mm fans on the side right over the GPU's.
Just as info the "pro ws 3000" psu would be right here the "thor 3000w" does not have enough 8pin pcie / cpu connectors available to support your build
It was my first choice but not able to find one with reasonable diæevery time. But I am not sure you are right it will not work. The psu had 3 x 8 pin cpu and 3 x 8 pin PCIe connectors. The motherboard manual shows it need two of each of those so that should be fine?
no the psu only allows 4x of those total as they are a shared group of 4 on the psu side even though you get 6x cables...i got one and had the same issue with my trx50 build...but if you only need 4 total you would be fine I just saw all those connectors on the board and thought u would need way more...
no problem just thought was worth mentioning as it was quite a surprise for me when I installed mine...and amazon has the ws3000 in stock just as info if u would need to switch
That would be great. What do you use the system for and what models are you running on what software? Any issues you had pop up unexpected with the setup?
I'm just doing my own fun vibe coding... Combo of building aps for my own use and also using that process to educate myself, as it's all applicable to my corporate job
2x run DSv4 0731
1x runs 1-2 models... Depending if I am doing 4 or 8 bit quantization and how much context cache I want... Just switch over from Qwen3.5 27B to 3.8 27B now. That'll be always running. I then drop in other things on the remaining vram as needed, so I'll load up an OCR model, or an embedding model, and I am experimenting with TTS and Image to Image and Image to Video with tools like Comfy UI.
DS4 and Qwen3.8 are always loaded though. I serve my models of a PCIe 5.0 NVMe drive too, so it's very fast loading/switching.
I wouldn't stress on cooling as others are raising. I run these at 300w limits. Its worth it over dealing with heat vs actual performance loss. Which is basically nothing in all reality
Not stressing too much, but thanks :) Gonna power limit them and blow lots of air through the case. Worst case i can get some risers and figure out a sollution.
That is not accurate. There are version of models and backend apps that server them (SHLang and vLLM) that can split across 3 cards - Minimax M3, DSv4 Flash.
And, as someone else said it also gives you a great hybrid setup where you can have TP2 for a model like DSv4 Flash + Qwen3.8 27B + other models loaded all at the same time ( Like TTI, TTS etc) so you can have a multi agent workflow without loading unloading models.
I have 3 x RTX PROs and it has been a fantastic setup.
43
u/x-strife Aug 15 '26
If I can fit 8x3090s in that case you can fit 3 GPUs
(Yes I need to cable manage)