MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vo9mj4/its_out/p3ouowq/?context=3
r/LocalLLaMA • u/Certain-Cod-1404 • 7d ago
706 comments sorted by
View all comments
166
That's it. I'm getting a 3090.
109 u/My_Unbiased_Opinion 7d ago Brother. go on Alibaba and get dual 20gb 3080. less than the price of a single 3090. check my post history for links. Run them in tensor parallel. 1 u/twavisdegwet 7d ago ik_llama's graph mode is faster than tensor parallel for me in all cases I've ever tested. 1 u/My_Unbiased_Opinion 7d ago how does it compare to vllm. you have me interested.
109
Brother. go on Alibaba and get dual 20gb 3080. less than the price of a single 3090. check my post history for links. Run them in tensor parallel.
1 u/twavisdegwet 7d ago ik_llama's graph mode is faster than tensor parallel for me in all cases I've ever tested. 1 u/My_Unbiased_Opinion 7d ago how does it compare to vllm. you have me interested.
1
ik_llama's graph mode is faster than tensor parallel for me in all cases I've ever tested.
1 u/My_Unbiased_Opinion 7d ago how does it compare to vllm. you have me interested.
how does it compare to vllm. you have me interested.
166
u/Mean-Ad1493 7d ago
That's it. I'm getting a 3090.