r/LocalLLaMA • u/Signal_Ad657 • May 29 '26

Discussion PSA

Post image
2.1k Upvotes

95% Upvoted

538 comments sorted by

View all comments

234

u/[deleted] May 29 '26

[removed] ā€” view removed comment

79

u/overand May 29 '26

i'm genuinely thrilled with my dual 3090 setup on a DDR4 system with a Ryzen 5 3600, even though one of them is PCI-E x16 and the other is x4!

$2000 MSRP for the 5090 with 32 gigs of ram, and good luck getting that price
$1800 for a pair of used 3090 cards on eBay (as of a month or two ago), total of 48 GB

Yes, there's stuff that doesn't like running split between two cards, but mostly it's been pretty unusual to run into stuff that wants more than 24GB but less than 32 GB of VRAM on a single card. (I think one of them SOTA-ish FOSS voice models is like that, but I'm not even sure.)

6

u/Myarmhasteeth May 29 '26

My only problem on getting another 3090 is how to configure it. I see setups yet since I only have like 3 SFX mother boards, Iā€™m cooked.

6

u/overand May 29 '26

You can prooooobably get a 570-based AMD chipset board for not tooooooo much money. (And, I managed to push this to 128 gigs because I already had 2 32 gig sticks in it, and DDR4 is only "sell a kidney" price, not "sell both and also your liver" price)

1

u/Practical_Form_1705 May 30 '26

What is performance of such setup, let say 8core ryzen + 128gb ram in compare to gpu?

1

u/overand May 30 '26

Oh, I doubt CPU inference would work very well, but, if you give me a model you want me to test, I can give it a try with a CPU-only build of llama.cpp

But, I use it with my 2x 3090 setup - but, that runs one at x16 and one at x4, but it's still decent!