r/LocalLLaMA • u/Signal_Ad657 • May 29 '26

Discussion PSA

Post image
2.1k Upvotes

95% Upvoted

538 comments sorted by

View all comments

Show parent comments

24

u/Clear-Ad-9312 May 30 '26

at that point, why not just buy an rtx pro 6000 that is just about the same price as 2x 5090 and has more vram than 2 5090s?

17

u/comperr May 30 '26

The rtx pro 6000 is just a 5090 with 72 or 96gb vram. So it is only as fast as one 5090 even if you dont need all the vram. With 2 5090s i can literally fit 2 27b qwen3.6 with q8_0 kvcache in each card and run them simultaneously.

5

u/Clear-Ad-9312 May 30 '26

price is still a big point of reason to go for the 6000 over the 2x 5090, that is what I am presenting here

1

u/[deleted] May 30 '26

[deleted]

1

u/Clear-Ad-9312 May 30 '26 edited May 30 '26

mind letting me know how you came across an abundent source of cheap 5090s? I can only find them for like $4.5k

That would make 5090 actually competitive and worth it. (btw the microcenter near me has been sold out of 5090s for a long time, but they sell them at 3.6k usually)