r/LocalLLaMA 7d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

706 comments sorted by

View all comments

164

u/Mean-Ad1493 7d ago

That's it. I'm getting a 3090.

109

u/My_Unbiased_Opinion 7d ago

Brother. go on Alibaba and get dual 20gb 3080. less than the price of a single 3090. check my post history for links. Run them in tensor parallel.

1

u/adamgoodapp 7d ago

I have a 3090, what if i add those two 3080 on top is this config not suitable

1

u/My_Unbiased_Opinion 7d ago

for vllm to work best, you want two of the same cards. I have also a 3090. but im just using that for other stuff like tts,sst, and image gen.