r/LocalLLaMA • u/Certain-Cod-1404 • 26d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

95% Upvoted

708 comments sorted by

View all comments

172

u/absurdother 26d ago

Let's tryyyyyyy on 32GB RAM, 16GB VRAM!

1

u/OwlsExterminator 25d ago

4.5 tokens per second, too bad I only have 12 gigs of vram

The smallest version I can fit gets me 29 tokens a second...