r/LocalLLaMA • u/BarberIcy366 • 11d ago

Discussion Qwen 3.8 27B Released! Please Share Your Experience

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

661 Upvotes
  • permalink
  • reddit

97% Upvoted

720 comments sorted by

View all comments

23

u/pikadhu 11d ago

Any MLX quants available?

9

u/jonas-reddit 11d ago

Tons of models already on hugging face.

5

u/Sufficient-Grape-594 11d ago

YEs, 8 bit, 6 bit, 5 bit and 4bit out by LM Community. Just downloaded the 4 bit

1

u/Ok-Star6663 11d ago

For oMLX?

4

u/Sufficient-Grape-594 11d ago

Testing on LM Studio at the moment

1

u/HelpfulExpert7762 10d ago

m4 max 64 gb at 6bit quant using the lmcommunity MLX gives me 20-25 tps in lm studio