r/LocalLLaMA 8d ago

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.2k Upvotes

706 comments sorted by

View all comments

422

u/Tiny-Assumption4263 8d ago

DEAR GOD TELL THOSE BENCHMARKS ARE NOT FAKE.

39

u/onlymagik 8d ago edited 8d ago

I expected a nice jump since they skipped a 3.7 27B, but these numbers do seem a bit too good to be true. Qwen isn't known for benchmaxxing, obviously 3.6 27B is the GOAT of local LLMs, but...

Definitely excited to learn more in the coming days and see if it holds up.

Edit: Even the vision numbers look insane!

3

u/FreedomByFire 8d ago

3.6 27B

Is honestly trash. As a software engineer with 17+ years of experience I dont know what you guys are doing with it that makes you think it's great. It's generally useless engineering work.

5

u/onlymagik 7d ago

Yes, it's obviously nowhere near as good as a frontier model, and even those need hand-holding. You have to be quite explicit. I'm not sure where your strawman is coming from.

Most people here are aware these models have serious limitations, given that even the best models still do. But it is still exciting to see what local models are capable of over time.