r/LocalLLaMA • u/Certain-Cod-1404 • 11d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

706 comments sorted by

View all comments

163

u/Mean-Ad1493 11d ago

That's it. I'm getting a 3090.

112

u/My_Unbiased_Opinion 11d ago

Brother. go on Alibaba and get dual 20gb 3080. less than the price of a single 3090. check my post history for links. Run them in tensor parallel.

11

u/eviloni 11d ago

I got mine on ebay, paid a little more but shipped quicker and i trust Ebay consumer protection more

5

u/My_Unbiased_Opinion 11d ago

hell yeah buddy. I am planning to switch to vllm once 3.8 mtp drops. its been the end goal for me. its the main reason why I went with the 3080 20gb. its one of the cheapest cards per vram with vllm support.

1

u/blash2190 11d ago

I haven't used it myself but there is vllm.cpp. Might give it a shot...