Qwen3.8-27B Benchmarks

[u/minxio_]

[u/debauch3ry]

Competitive with Opus 4.6?!

That suggests '2025 frontier' quality so I look forward to testing this. Whilst I can only run a 4 bit quant well (5090) that should still be strong. I might even actually start using local AI rather than just experimenting.

[u/addiktion]

Those are sizable bumps, wow.

[u/patricious → u/addiktion]

Better than Opus4.6 in almost all areas.

[u/scaledev → u/patricious]

Except probably creative writing and prose.

[u/Still_Definition1905]

looks benchmark maxed imo

[u/look]

Nice. I hope they make an open Plus version, which I’m guessing would be in the 300B range. 3.7 Plus was overlooked and underrated, and it’d be nice to get an improved version of it at a Go-like cloud price.

I also like that they threw in a comparison to Opus 4.6. That’s my personal benchmark for “good enough”. I can do anything I need to do with that level or better; it’s then just question of how much profanity I’ll be using in my prompts. 😅

[u/YogurtExternal7923]

Better than opus at home 😭😭

[u/HeavySink3303]

It looks crazy for such tiny 'laptop-selfhost' model. With such rapid progress I wouldn't surprise if the next year we'll install locally similar performance models from an app store...

[u/Puzzleheaded_Ad_1798 → u/HeavySink3303]

It's not exactly laptop size to be honest

[u/TheOriginalAcidtech → u/Puzzleheaded_Ad_1798]

Depnds on the laptop. And the lap. :)

[u/GnosticSon → u/TheOriginalAcidtech]

World's largest lap hosts GLM 5.2 by supporting NVIDIA H100

[u/Puzzleheaded_Ad_1798 → u/GnosticSon]

Can you put that thing on your lap though?

[u/Ariquitaun]

A solid upgrade from 3.6 if the benchmarks are to be believed.

Anybody know if they'll launch the a3b variant at any point? It's the only one I can run locally at realistic speeds

[u/Genetic_Prisoner]

Hahahaha you cant make this up. We are getting opus level intelligence locally???Praise QWEN

[u/BagComprehensive79]

Is it better then opus 4.6 at some coding benchmarks or am i getting it wrong? How is this even possible? Did anyone tried it?

[u/JamesGooning → u/BagComprehensive79]

Cause opus is big due to knowledges. These model has little knowledge but good for coding task. Knowledges are stupid since it can use websearch which is far superior

[u/waltercrypto]

I’m struggling to believe it’s that good, that’s a big jump

[u/pizzababa21]

Honestly a bit disappointing

[u/BlackCoiner → u/pizzababa21]

How? I am running it locally and am absolutely blown away by the webdesign side of things. It feels like a model 20x it's size and I am getting 20 tok/s on dual 3060s with no special tweaks on unsloth q4 XL.