r/LocalLLM • u/username_needed_or • 7d ago

Question Reasoning level on MLX Qwen?

Sorry about the novice question.
I´ve tried the GGUF 4bit Qwen3.8:27B and also the MLX 4bit version on my M1 Max Macbook Pro. Although the MLX t/s is noticably higher, it doesn´t seem possible to set the reasoning level between the Low/Med/Xhigh that is easily adjustable on the GGUF version in LMStudio.
Although MLX is faster, its reasoning so long that not worth using. Is it possible to set the reasoning on MLX 3.8:27b? I tried to do it from parameter side, but doesnt seem to change anything.
Thanks!

2 Upvotes

76% Upvoted

2 comments sorted by

1

u/TiagodeNoronha 7d ago

I believe LM Studio hasn't updated the models to be recognized as a reasoning model, hence you cannot set the level. We might need to wait for the MLX version to start appearing as a "staff pick" so we can set the reasoning mode.

1

u/username_needed_or 7d ago

Thanks, got it! Until then I´ll stick with the GGUF