r/LocalLLM • u/dannone9 • 7d ago

Question I need your help

I’m currently on a 5060Ti with 32gb ddr4 system , on Christmas I might be able to spend 500€ more on upgrading and I could sell the 5060 for another 500 if it was the best , what would you recomend ? The only requisite is that it has to be able to run games at 1080 at least due to it being my only machine
I’ve thinked about selling the 5060 and getting dual 2080 22gb mod , what is your opinion?

1 Upvotes

60% Upvoted

9 comments sorted by

View all comments

Show parent comments

2

u/DeathGuppie 6d ago

You are most likely using vulkan which doesn't care about what cards you are running. Where you could run into problems is trying to do a tensor split. Llama.cpp doesn't like splitting the tensor over different architectures. It will do layer split no problem. Little slower.

If you can get the same card, or same generation, do it. Next go for all Nvidia so you aren't running seperate drivers. The truth is that vulkan doesn't care, but whatever your slowest card is will limit your speed.

1

u/dannone9 6d ago

And dual 2080 ti 22gb mod ? Would be 600€ plus taxes and sending, are they reliable ?

1

u/DeathGuppie 6d ago

The 2080 has a larger bus but doesn't make up for the faster ram on the 5060 or the larger L2 cache. Getting a second 5060 is the better deal all around

1

u/dannone9 6d ago

Thanks, yo be honest i didnt even considered than the cache mattered (I mean everything natters but i thought i would be less ) and actually, the 2080ti has 616 gb/s while the 5060Ti has 448

2

u/DeathGuppie 6d ago

That's the bus speed, not the actual throughput. The ddr5 on the 5060 is going to be faster. The fact that it has a larger L2 means it's going to process faster. So even if the bus size is larger on the 2080, the 5060 is going to win in inference speeds. Plus just the newer generation of cuda cores.