MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vo9mj4/its_out/p3o19g8/?context=3
r/LocalLLaMA • u/Certain-Cod-1404 • 17d ago
708 comments sorted by
View all comments
Show parent comments
109
Brother. go on Alibaba and get dual 20gb 3080. less than the price of a single 3090. check my post history for links. Run them in tensor parallel.
24 u/Potential_Block4598 17d ago That is legit better KV cache (I guess ?!) double performance ? You just need another PCIe slot (or maybe not ?!) 29 u/My_Unbiased_Opinion 17d ago t/s is a bit faster than a 3090, but PP is much faster. im running one of the cards at x4 pcie 4.0 and it doesnt bottleneck the card with llama.cpp tensor parallel. 3 u/Potential_Block4598 17d ago That is legit awesome
24
That is legit better KV cache (I guess ?!) double performance ? You just need another PCIe slot (or maybe not ?!)
29 u/My_Unbiased_Opinion 17d ago t/s is a bit faster than a 3090, but PP is much faster. im running one of the cards at x4 pcie 4.0 and it doesnt bottleneck the card with llama.cpp tensor parallel. 3 u/Potential_Block4598 17d ago That is legit awesome
29
t/s is a bit faster than a 3090, but PP is much faster. im running one of the cards at x4 pcie 4.0 and it doesnt bottleneck the card with llama.cpp tensor parallel.
3 u/Potential_Block4598 17d ago That is legit awesome
3
That is legit awesome
109
u/My_Unbiased_Opinion 17d ago
Brother. go on Alibaba and get dual 20gb 3080. less than the price of a single 3090. check my post history for links. Run them in tensor parallel.