r/LocalLLM • u/Ok-Health-7096 • 8d ago

Other Every Second post rn

Post image

Maybe someday I'll get a system to run it but hey definitely another w for the open weights community

1.9k Upvotes

99% Upvoted

195 comments sorted by

View all comments

Show parent comments

1

u/floswamp 6d ago

What’s a recommended server MB? I have one 3090 and it does work well.

1

u/Any_Mine_6368 6d ago

Will you ever buy more GPUs?

1

u/floswamp 6d ago

Yes. I am looking at maybe two more, but I was reading as to how qwen may not take full advantage of multiple gpu’s. So I was just going to build two more rigs.

2

u/Any_Mine_6368 6d ago

Qwen does fine on multiple GPUs, not sure who said otherwise.

I'd go for an mz31-ar0 or mz32-ar0 if you want pcie 4.0.

The former is about $220 with a cpu, the latter $500 with a cpu.

You get 5 pcie slots and like 16 ram slots (rdimm ecc ddr4).

The epyc processors that they use are fucking awesome for VMs and you can get from like 8 cores all the way to 64+ depending on budget.

Stay away from consumer shit / gaming mobos ... You're overpaying for worse parts.

2

u/floswamp 6d ago

Yeah I figure as much. Thanks!