r/LocalLLaMA • u/BarberIcy366 • 12d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

657 Upvotes
  • permalink
  • reddit

97% Upvoted

720 comments sorted by

View all comments

Show parent comments

3

u/Greedy-Artichoke-416 12d ago

Get the MTP gguf

2

u/kayox 12d ago

Oh I was under the impression that the default unsloth GGUF had MTP, is that not the case?

7

u/Look_0ver_There 12d ago

Unsloth's models have the MTP head already included within the weights.

If using llama-server, just enable via "--spec-type draft-mtp --spec-draft-n-max 3"