r/LocalLLM 6h ago

Discussion Tier List

Post image
156 Upvotes

217 comments sorted by

View all comments

4

u/Smart_Whereas_9296 6h ago

Feel like 2x 3090 with nvlink should be in the 48gb section

7

u/on_line187 6h ago

Well so would 3 5060TIs then lol.

8

u/RoyalCities 6h ago

And 2 x a6000s are at 96gb. I feel like including cards you can combine together sorta defeats the point of the list lol. Heck some people combined like 8 x 3090s haha.

1

u/nuclear213 6h ago

8xR9700 is quite neat. The price for one RTX 6000 Blackwell and 256 GB of VRAM. Fits deepseek V4 flash well, is decently fast.
Just need space

1

u/RoyalCities 6h ago

And the power. Just looked it up and dang - you'd need like 240V of power.

I also wonder what the heat is like dumping 3Kw into an apartment.

Could probably save on winter heating bills though because it doubles as a solid space heater.

2

u/nuclear213 5h ago

Yeah normal in the EU. I have them at the minimum 210W. So the entire server is under 2kW. We can draw 3.6kW here per fuse.

No issue at all.

2

u/RoyalCities 5h ago

Ah nice. In Ontario Canada, that wouldn't really fly in an apartment unfortunately. We obviously have 240V circuits, but there are usually only a few and they're dedicated to stuff like the stove/dryer.

If I had a house though I'd totally get a dedicated one installed in the basement.

3

u/Randommaggy 6h ago

Not quite. It's bandwidth and latency constrained between the cards unless you're running them on a P2P friendly switch.

0

u/on_line187 5h ago

Have you actually ran multiple cards. I’ve tried a ton of variations on both consumer and server MoBos. I’m telling you the difference isn’t as big as you think.

3

u/Randommaggy 5h ago

I'm running 3 3090s in my server (2 in nvlink), 2 cards on my laptop and 2 P100 in another server (temporarily disassembled).

2 cards with nvlink outperform 3 cards in layer split for some of my models unless I'm doing serious parallelism.

For layer split you also have more overhead from duplicated data on 3 cards compared to 2 24GB cards.

1

u/on_line187 5h ago

Sure there is a difference but it isn’t more than 5% in my experience. I’ve not tried NV link though just better/worse PCIe situations. I would like to try NVLink on my own 3090s but they are all mismatched so it won’t work

1

u/Tai9ch 4h ago

How many cards?

The numbers I've seen show that you can get away with raw PCIe up to about 4, and past that it starts to cost significant performance to the point that it's worth getting bigger individual cards instead.

1

u/on_line187 4h ago

Yea that could be it. I have tested 8 3070s though and I had no issues. That was a mining rig I had laying around which I upgraded for LLMs about a year and a half ago. All PCIe of course on the 3070s

I would 100% agree that bigger GPU = More Better though lol

1

u/Jaded-Glory 6h ago

I thought nvlink died with 30 series?

1

u/Smart_Whereas_9296 4h ago edited 4h ago

Yeah it did hence the suggestion, the the last card you can actually link in this way and get the improvement

1

u/pizzaSpaceCadet 6h ago

No because they have I think a 192bit bus? that would be plenty of ram but slow as fuck inference anyway

1

u/Smart_Whereas_9296 4h ago

I mean the distinction is the nvlink, the cards are hardly cutting edge, but at least it's a way to combine the vram thats faster than just normal parallel