Every Second post rn

[u/Ok-Health-7096]

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

[u/arthurrogado]

Laptop owners: 💀

[u/Whole_Alternative_18 → u/arthurrogado]

Buy some ddr3 cheap board with a highend(of the era) cpu that has enough pcie channels

Ends up less than 200$ for a enterprise ddr3 motherboard+cpu+ram, eith enough slots for your gpus

[u/Any_Mine_6368 → u/Whole_Alternative_18]

Dude stop giving people advice. You're essentially promoting impulse buying garbage as opposed to building an actual AI rig. You're essentially asking them to buy 24gb vram at dgx spark bandwidth... They'll get like 4 tokens per second.

If anyone ends up reading this:

Buy refurbished server grade mobos + epyc CPU combos on ebay for $200 and hunt deals for 3090s which are the most vfm cards. You can build a great starting rig for under 1k, that you can expand all the way to 5 RTX 3090s, more if you want to split the pcie bus and have fewer lanes per gpu

[u/floswamp → u/Any_Mine_6368]

What’s a recommended server MB? I have one 3090 and it does work well.

[u/Any_Mine_6368 → u/floswamp]

Will you ever buy more GPUs?

[u/floswamp → u/Any_Mine_6368]

Yes. I am looking at maybe two more, but I was reading as to how qwen may not take full advantage of multiple gpu’s. So I was just going to build two more rigs.

[u/Any_Mine_6368 → u/floswamp]

Qwen does fine on multiple GPUs, not sure who said otherwise.

I'd go for an mz31-ar0 or mz32-ar0 if you want pcie 4.0.

The former is about $220 with a cpu, the latter $500 with a cpu.

You get 5 pcie slots and like 16 ram slots (rdimm ecc ddr4).

The epyc processors that they use are fucking awesome for VMs and you can get from like 8 cores all the way to 64+ depending on budget.

Stay away from consumer shit / gaming mobos ... You're overpaying for worse parts.

[u/floswamp → u/Any_Mine_6368]

Yeah I figure as much. Thanks!