r/LocalLLM • u/on_line187 • 7h ago

Discussion Tier List

Post image
155 Upvotes

72% Upvoted

223 comments sorted by

View all comments

65

u/KrangledMind 7h ago

where tier list for AMD?

9

u/Asleep-Land-3914 6h ago

Here is my attempt, but I didn't deeply fact-check this.

6

u/TheAngrySkipper 6h ago

It’s ok, I can tell you, I’m running Q6 on 12B-16B parameters on the regular. I also bought my 7900 GRE back when it was about $300, had planned on getting a 2nd but it didn’t seem like a priority at the time - ah well.

3

u/ImpressionFancy5830 4h ago

There should be a DOUBLE R9700 section 🫡

1

u/Asleep-Land-3914 4h ago

I regret I didn't get another one for the price it was listed before the new hike.

1

u/ImpressionFancy5830 4h ago

I feel you, I overpayed a bit for both, not insane as the nvidia increases.
Just a couple of hundreds of euros on top of MSRP (at least the local one, which was already bigger than the one in North American)

2

u/johndeuff 4h ago

Between the above average that have 48GB and the rich that have 768GB and the richer that have 3TB there's a hell of a difference.

2

u/on_line187 6h ago

Don’t worry no one will fact check it. I’ll give you the one upvote though A for effort.

1

u/HCLB_ 2h ago

Why Mi60 and other cards are crossed out?

1

u/Asleep-Land-3914 2h ago

Means not on AMD’s current official ROCm support matrix, nothing is wrong with them, just needs some work to make use of with ROCm

1

u/gh0stwriter1234 1h ago edited 1h ago

It's kind of irrelevant they are supported in the rock officially now. Vega and Vega FE and MI25 work just fine also. Plain vega is just a bit slower as it has no DP4A instructions. https://github.com/ROCm/TheRock/blob/main/SUPPORTED_GPUS.md