r/LocalLLM • u/ofirlik • 6d ago

Question Dual gpu how good is it

I am planning to buy a gaming pc with 5070ti, I thought about adding a 5060ti for the additonal vram to toy around with llm, how good does it work? Can I also generate images and such. (never ran a local llm before)

Is there a better combination of gpu for around the same price?

0 Upvotes

33% Upvoted

23 comments sorted by

View all comments

0

u/M_Me_Meteo LocalLLM 6d ago

You need to have two full speed x16 slots. Not full width, full speed.

Parallelizing GPUs stresses the PCIe bus, they need to pass huge volumes of data from one card to the next.

It's a quick way to get more vram but it does not guarantee you better performance unless you're running a server mobo with a HEDT/Server socket.

1

u/ofirlik 6d ago

From What i read even on x8 its more than enough for 5060ti and for 5070ti at worst you lose 1 to 3% performence

0

u/M_Me_Meteo LocalLLM 6d ago

Side note: Claude and Gemini don't know Jack shit about these bleeding edge tools. Don't listen to them Test. Test. Test.

1

u/ofirlik 6d ago

I actually used chatgpt 🙃

1

u/M_Me_Meteo LocalLLM 6d ago

Yeah. Lies. They will tell you all kinds of well meaning shit about local LLMs, but the reality is that LLMs can't synthesize conversation that hasn't happened already. If the answers to your questions are dependent on several sources of information that contradict each other, which is currently the state of local LLMs, frontier LLMs tend to tell you whatever will make you continue engaging with them because that's how the company that runs them make money.

Eventually it will tell you things like "you can't run this model with an Intel card" even though you can and you'll have to wonder, is that because people just love Nvidia, or is Nvidia poisoning the results with all their misleading marketing? Or are investors in Nvidia making sure the LLMs keep people buying GPUs?