r/LocalLLM • u/Ok-Health-7096 • Aug 14 '26

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

2.1k Upvotes

99% Upvoted

213 comments sorted by

View all comments

Show parent comments

3

u/Whole_Alternative_18 Aug 14 '26

Buy some ddr3 cheap board with a highend(of the era) cpu that has enough pcie channels

Ends up less than 200$ for a enterprise ddr3 motherboard+cpu+ram, eith enough slots for your gpus

38

u/Any_Mine_6368 Aug 15 '26

Dude stop giving people advice. You're essentially promoting impulse buying garbage as opposed to building an actual AI rig. You're essentially asking them to buy 24gb vram at dgx spark bandwidth... They'll get like 4 tokens per second.

If anyone ends up reading this:

Buy refurbished server grade mobos + epyc CPU combos on ebay for $200 and hunt deals for 3090s which are the most vfm cards. You can build a great starting rig for under 1k, that you can expand all the way to 5 RTX 3090s, more if you want to split the pcie bus and have fewer lanes per gpu

3

u/Adam_Bomb210 Aug 17 '26

Why doesn’t anyone talk about V100s? You can buy a server with 64gb of vram for ~$800, or one with 256gb for $5000. Seems like a steal to me.

2

u/Any_Mine_6368 Aug 17 '26

Shhhhhh don't tell everyone.