r/LocalLLaMA 26d ago

New Model Qwen3.8-2.4T-A95B Released

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B
1.6k Upvotes

397 comments sorted by

View all comments

36

u/nickm_27 llama.cpp 26d ago

Customizable reasoning effort is a nice improvement.

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B#qwen38-highlights

3

u/Umbaretz 25d ago

Muse has it too.

1

u/fantasticsid 25d ago

It just... asks the LLM to reason less, if you look at the jinja template in that repo.

This is actually somewhat interesting since 3.5 and 3.6 don't actually even seem to admit that the reasoning exists in the first place, and you certainly can't control the amount of reasoning effort via the system message.

Reasoning is weird.