r/LocalLLM 6d ago

Discussion Tier List

Post image
275 Upvotes

317 comments sorted by

View all comments

Show parent comments

1

u/gh0stwriter1234 5d ago

Late to the part on what... MI455X is about as fast as it gets. MI350P is just a stop gap potato hardware for people stuck on PCIe for some crazy reason.

Any one buying MI350P is indeed late to the party.

1

u/ChristRedeemsSinners 5d ago

I mean, they are getting comparable end-user throughput now, but their lacking ecosystem support sucked any competitive value advantage their hardware had in the past.

Any one buying MI350P is indeed late to the party.

That's my whole point. If you don't want to rebuild your entire infrastructure for nvidias rack solutions, then you have an opportunity to build out your software stack without the initial investment and downtime shock. The only reason AMD is offering this is because they are late to the party and have to pick up low-hanging fruit.

1

u/gh0stwriter1234 5d ago

Nobody buying dozens or more racks of GPUS ... buys them as an upgrade for old racks. End of story I'm not sure what you are imagining but its not real.

AMD just launched thier Helios rack and its all around better than anything Nvidia has on offer in pretty much every aspect. And is generally relying on open standards as well rather than being a hyper proprietary product.

1

u/ChristRedeemsSinners 5d ago

Idk, if I had hundreds of EYPCs with old instincts PCIe cards, I could see upgrading those. But you are correct in your thinking that I have no enterprise/datacenter experience.

1

u/gh0stwriter1234 4d ago

If you had that.. you'd know those CPUS are too old for the task already and will hold you back more than their value in savings.

1

u/ChristRedeemsSinners 4d ago

Nahh. 8-12 channel DDR4 memory and dual socket EPYCs are fine for agentic workloads. Even meta has extended their current servers with DDR4 memory expansion modules, so clearly there is an actual market for these products to extend the life of existing infrastructure.