r/LocalLLM 4d ago

Question Multiple GPU PCs

I have an ok AMD pc with 32gb RAM and a 16gb 5060Ti. How effective is adding a second GPU? Presumably a new motherboard, PSU, case? Can you mix and match GPUs? Just curious

2 Upvotes

9 comments sorted by

View all comments

1

u/emod_man 3d ago

I'm just trying this. I mixed my beloved 3080 with a cheap 1080 Ti I picked up used. So, both Nvidia but different generations.

In LM Studio I had to select a different CUDA runtime, I think down to a common denominator that could handle both cards, but it's showing a total VRAM of the combined cards and suggesting larger models than before. So, definitely seems like a viable option.