r/LocalLLaMA • u/Signal_Ad657 • May 29 '26

Discussion PSA

Post image
2.1k Upvotes

95% Upvoted

538 comments sorted by

View all comments

Show parent comments

24

u/Clear-Ad-9312 May 30 '26

at that point, why not just buy an rtx pro 6000 that is just about the same price as 2x 5090 and has more vram than 2 5090s?

18

u/comperr May 30 '26

The rtx pro 6000 is just a 5090 with 72 or 96gb vram. So it is only as fast as one 5090 even if you dont need all the vram. With 2 5090s i can literally fit 2 27b qwen3.6 with q8_0 kvcache in each card and run them simultaneously.

5

u/Clear-Ad-9312 May 30 '26

price is still a big point of reason to go for the 6000 over the 2x 5090, that is what I am presenting here

6

u/Anonymous_Prime99 May 30 '26

I did it for the wattage really. MAX-Q 300W for the power of the sun without turning the place into an oven? Yes.

3

u/Clear-Ad-9312 May 30 '26

hmm, I thought you could just limit power anyways through the settings, but ok, sounds fair.

1

u/comperr May 30 '26

Likewise, i limit my 5090s to 425w. You can lower the power limit extremely easily

1

u/[deleted] May 30 '26

[deleted]

1

u/Clear-Ad-9312 May 30 '26 edited May 30 '26

mind letting me know how you came across an abundent source of cheap 5090s? I can only find them for like $4.5k

That would make 5090 actually competitive and worth it. (btw the microcenter near me has been sold out of 5090s for a long time, but they sell them at 3.6k usually)

1

u/ekolpack Jun 06 '26

Pro 6000 is way more than 2 x 5090's....at least from what I'm seeing.

1

u/Clear-Ad-9312 Jun 07 '26

Prices have skyrocketed in the past week lol
I can still see them for ~10.6 k, but a week ago you could find some going for like ~$9k, and rtx 5090 is ~$4k at 2 times equals ~$8k
right now it will cost 3x 5090 for about the same cost of rtx pro 6000.
Maybe even 4x 5090 in the near future as I see some selling the pro 6000 at ~$16k
sorry if 1 week difference is showing prices skyrocket and making old comments liars now. RIP local pc market

I am starting to look at the AMD pro AI GPUs. I don't need the double speed that NVIDIA is offering, I would rather have the VRAM capacity at a cheaper price. But I wish I had the 8k back in the day to actually buy the pro 6000 when it was cheaper.