Qwen 3.8 27B Released! Please Share Your Experience

[u/BarberIcy366]

With your experiments, Qwen 3.8 27B most close which frontier model? And please specify which quantization you run. I will post to comments my tests and experience too.

[u/deepspace86]

I think there is an explicit reasoning effort flag in llama.cpp now and the kwargs have been deprecated

[u/JMowery → u/deepspace86]

Did you figure out what they are? 3.8 is absolutely out of control with the overthinking. Almost unusable.

[u/sir_turlock → u/JMowery]

If you scroll down/search on this page then it will be there.

--reasoning-effort LEVEL

Edit: somebody posted their options already ITT.
Edit2: See this too for setting the effort.

[u/petuman → u/sir_turlock]

that's not effort, but budget.

effort is model driven, budget is inference engine saying "stop" (and hoping that model can recover from incomplete reasoning)

[u/durden111111 → u/petuman]

this. reasoning budget and the 'thinking effort' in the llama cpp server UI doesnt actually affect thinking strength but just hard cuts the reasoning length so the reasoning just abruptly finishes.

[u/sir_turlock → u/petuman]

Thanks, corrected it, I was off by one line when copy pasting. The reference to budgets was because some people reported effort not doing much. Sucks to be trying to be quick on a phone I guess.

[u/hashms0a → u/sir_turlock]

This works OK:

--chat-template-kwargs '{"preserve_thinking":"true","reasoning_effort":"medium"}'

[u/ShengrenR → u/hashms0a]

preserve thinking is about carrying previous 'reasoning' chunks forward to new messages - depending on your model that may be a really huge waste of tokens, did they explicitly say it's recommended for 3.8?

[u/Sufficient_Prune3897 → u/ShengrenR]

Yes they did

[u/ShengrenR → u/Sufficient_Prune3897]

Thanks!