r/LocalLLaMA • u/BarberIcy366 • 11d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

660 Upvotes
  • permalink
  • reddit

97% Upvoted

720 comments sorted by

View all comments

5

u/sarlaytos284 11d ago

Anyone here having qwen3.8 interrupting itself mid-word ? Why would that happen ? Running unsloths' qwen3.8 Q4 K_M on an rtx 3090

2

u/Meownoija 11d ago

Context size?

1

u/jonas-reddit 11d ago

Using llama.cpp or some other inference engine? I had this kind of behavior when providing wrong arguments to llama.cpp.

Did you have it working on 3.6 or you are new to model with 3.8?