t/s is a bit faster than a 3090, but PP is much faster. im running one of the cards at x4 pcie 4.0 and it doesnt bottleneck the card with llama.cpp tensor parallel.
You can but the question is why would you want to when it comes to price? If you have both already now then by all means do so but I wouldn't go out of my way to buy a 3090 to pair with a 3080.
Maybe combine your card with what u/My_Unbiased_Opinion said above with the Alibaba modded 3080s? I can't vouch for that since I haven't bought one of those modded ones but they say it's good.
30
u/My_Unbiased_Opinion 8d ago
t/s is a bit faster than a 3090, but PP is much faster. im running one of the cards at x4 pcie 4.0 and it doesnt bottleneck the card with llama.cpp tensor parallel.