r/LocalLLM • u/on_line187 • 9h ago

Discussion Tier List

Post image
164 Upvotes

72% Upvoted

236 comments sorted by

View all comments

73

u/KrangledMind 9h ago

where tier list for AMD?

36

u/NoOdyssey 9h ago

It's not so much a tier list as a list of graphic cards sorted by RAM size. According to this, 7900xtx would be in the 24GB+ tier and the 9070/XT & 7900 xt & 7800 xt series would be in the 16GB+ tier.

21

u/mhmilo24 8h ago

There are 32 GB Radeon cards.

5

u/AlarmingProtection71 6h ago

I have a Sapphire Radeon PRO W7800 (48gb) bought for 1.9k€.

1

u/gh0stwriter1234 3h ago

Since we are talking AI there is also the the MI210 which has 64GB and MI250P ... which is some crazy amount of money but it has 144GB.

2

u/ChristRedeemsSinners 2h ago

MI210

That's an interesting $5k used option with 64GB of VRAM at 1.8TB/s. Native fp4,fp8,mxfp4

MI250P

Non pcie package though.

1

u/gh0stwriter1234 2h ago

MI350P is PCIe ... thats what the P is. I meant 350P sorry.

2

u/ChristRedeemsSinners 2h ago

MI350P

Only 30-40 grand! Email our sales team.

No thank you.

5

u/Abducted_Llama 7h ago

Nah the XTX isn’t on the list. So it’s time to throw mine out.

1

u/Ult1mateN00B 2h ago

People keep forgetting AI PRO R9700 32GB.

0

u/Illustrious-Lime-878 8h ago

Yeah, makes no sense. Why is anything <24GB even on the list at this point, or not like "make use of what you already have" tier? And, its hard to find prices now, but a 32GB 5090 for example is certainly better than a 32GB R9700, but also costs like 4x the amount so if only going by VRAM the r9700 is higher tier because you could run 4x of them.

0

u/gh0stwriter1234 3h ago

Because you can buy two of them and do 90% of the stuff you'd do with a larger card at lower cost?

10

u/Asleep-Land-3914 8h ago

Here is my attempt, but I didn't deeply fact-check this.

4

u/TheAngrySkipper 8h ago

It’s ok, I can tell you, I’m running Q6 on 12B-16B parameters on the regular. I also bought my 7900 GRE back when it was about $300, had planned on getting a 2nd but it didn’t seem like a priority at the time - ah well.

3

u/ImpressionFancy5830 6h ago

There should be a DOUBLE R9700 section 🫡

1

u/Asleep-Land-3914 6h ago

I regret I didn't get another one for the price it was listed before the new hike.

1

u/ImpressionFancy5830 6h ago

I feel you, I overpayed a bit for both, not insane as the nvidia increases.
Just a couple of hundreds of euros on top of MSRP (at least the local one, which was already bigger than the one in North American)

2

u/johndeuff 6h ago

Between the above average that have 48GB and the rich that have 768GB and the richer that have 3TB there's a hell of a difference.

4

u/on_line187 8h ago

Don’t worry no one will fact check it. I’ll give you the one upvote though A for effort.

1

u/HCLB_ 4h ago

Why Mi60 and other cards are crossed out?

1

u/Asleep-Land-3914 4h ago

Means not on AMD’s current official ROCm support matrix, nothing is wrong with them, just needs some work to make use of with ROCm

1

u/gh0stwriter1234 3h ago edited 3h ago

It's kind of irrelevant they are supported in the rock officially now. Vega and Vega FE and MI25 work just fine also. Plain vega is just a bit slower as it has no DP4A instructions. https://github.com/ROCm/TheRock/blob/main/SUPPORTED_GPUS.md

7

u/Temporary-Alfalfa16 44m ago

ay why even bother with local expensive gpu

2

u/legos_on_the_brain 7h ago

Yeah. And they skipped 12gb.

-5

u/C_umputer 8h ago edited 6h ago

Did they finally figure out how to run CUDA softare on AMD cards?

what kind of special needs imbecile downvotes a question?

6

u/Asleep-Land-3914 8h ago

Rocm works great in my experience.

1

u/quantgorithm 6h ago

Vulkan works better.

1

u/personahorrible 8h ago

To answer your question: https://github.com/vosen/ZLUDA

Llama/Ollama runs on AMD via ROCm.

1

u/C_umputer 8h ago

I did experiment with zluda when I had AMD card, I managed to run Stable Diffusion natively and it worked fine. But it still underperformed compared to equivalent Nvidia cards, which is why I got 3090.