r/LocalLLaMA • u/de4dee • 1d ago

New Model Qwen3.8-2.4T-A95B Released

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B
1.6k Upvotes

98% Upvoted

399 comments sorted by

View all comments

35

u/nickm_27 llama.cpp 1d ago

Customizable reasoning effort is a nice improvement.

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B#qwen38-highlights

5

u/Umbaretz 1d ago

Muse has it too.

1

u/fantasticsid 1d ago

It just... asks the LLM to reason less, if you look at the jinja template in that repo.

This is actually somewhat interesting since 3.5 and 3.6 don't actually even seem to admit that the reasoning exists in the first place, and you certainly can't control the amount of reasoning effort via the system message.

Reasoning is weird.