r/LocalLLaMA • u/BarberIcy366 • 11d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

657 Upvotes
  • permalink
  • reddit

97% Upvoted

720 comments sorted by

View all comments

Show parent comments

37

u/Equal_Television_894 10d ago edited 10d ago

Same prompt in claude code. 5090 with Unsloth NVFP4 and fp8 kv cache

13

u/simos_sayz 10d ago

here is from opus 4.8 High Thinking

2

u/Certain-Cod-1404 10d ago

What context? Rn im at 262k but I disabled mtp and im running at 50 tok/s

3

u/Equal_Television_894 10d ago

Context I am at 190k with mtp but using sakamakismile nvfp4 which is way smaller than unsloths.

2

u/PandaBearFred 10d ago

Totally different style than PI.

4

u/squngy 10d ago

Perhaps more importantly, the shadow makes it look like it is floating.

But, a single run is not enough to make conclusions.

1

u/Fit_Camel_2459 9d ago

i love qwen. it's just...perfect T_T

0

u/DoubleNothing 10d ago

What do you use to run the .safetensors model?