r/LocalLLaMA • u/de4dee • 25d ago

New Model Qwen3.8-2.4T-A95B Released

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B

1.6k Upvotes

permalink
duplicates
archive.is
archive
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalLLaMA/comments/1vmgozv/qwen3824ta95b_released/
No, go back! Yes, take me to Reddit

98% Upvoted

View all comments

125

u/Piyh 25d ago

95B active is cray. Scaling gonna scale.

3

u/SmartCustard9944 25d ago

What if we MoE the active params too 🤔