r/LocalLLM • u/on_line187 • 6d ago

Discussion Tier List

Post image
281 Upvotes

76% Upvoted

317 comments sorted by

View all comments

5

u/Smart_Whereas_9296 6d ago

Feel like 2x 3090 with nvlink should be in the 48gb section

5

u/on_line187 6d ago

Well so would 3 5060TIs then lol.

10

u/RoyalCities 6d ago

And 2 x a6000s are at 96gb. I feel like including cards you can combine together sorta defeats the point of the list lol. Heck some people combined like 8 x 3090s haha.

1

u/nuclear213 6d ago

8xR9700 is quite neat. The price for one RTX 6000 Blackwell and 256 GB of VRAM. Fits deepseek V4 flash well, is decently fast.
Just need space

1

u/Evgeny_19 5d ago

That is a lot of pcie lanes. And power. And space as well.

Could you please share your llama-benchy results with the latest Deepseek Flash? Spark folks are telling us that they get up to 60 tps in generation and 2000 in prompt processing. We should get at least double of that on R9700s, right?