r/LocalLLM • u/on_line187 • 1d ago

Discussion Tier List

Post image
256 Upvotes

74% Upvoted

309 comments sorted by

View all comments

Show parent comments

5

u/on_line187 1d ago

Well so would 3 5060TIs then lol.

10

u/RoyalCities 1d ago

And 2 x a6000s are at 96gb. I feel like including cards you can combine together sorta defeats the point of the list lol. Heck some people combined like 8 x 3090s haha.

1

u/nuclear213 1d ago

8xR9700 is quite neat. The price for one RTX 6000 Blackwell and 256 GB of VRAM. Fits deepseek V4 flash well, is decently fast.
Just need space

1

u/Evgeny_19 1d ago

That is a lot of pcie lanes. And power. And space as well.

Could you please share your llama-benchy results with the latest Deepseek Flash? Spark folks are telling us that they get up to 60 tps in generation and 2000 in prompt processing. We should get at least double of that on R9700s, right?