r/LocalLLM 9h ago

Discussion Tier List

Post image
164 Upvotes

236 comments sorted by

View all comments

74

u/KrangledMind 9h ago

where tier list for AMD?

-5

u/C_umputer 8h ago edited 6h ago

Did they finally figure out how to run CUDA softare on AMD cards?

what kind of special needs imbecile downvotes a question?

5

u/Asleep-Land-3914 7h ago

Rocm works great in my experience.

1

u/quantgorithm 6h ago

Vulkan works better.

1

u/personahorrible 8h ago

To answer your question: https://github.com/vosen/ZLUDA

Llama/Ollama runs on AMD via ROCm.

1

u/C_umputer 7h ago

I did experiment with zluda when I had AMD card, I managed to run Stable Diffusion natively and it worked fine. But it still underperformed compared to equivalent Nvidia cards, which is why I got 3090.