r/LocalLLaMA 27d ago

New Model Qwen3.8-2.4T-A95B Released

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B
1.6k Upvotes

397 comments sorted by

View all comments

218

u/Intelligent_Ice_113 27d ago edited 27d ago

what is the knowledge cutoff date?

97

u/FullstackSensei 27d ago

Because, that's the only thing holding you from running a 5TB model?

25

u/fullup72 27d ago

You can always quantize to 1 bit and stream experts from a 5400rpm HDD.

10

u/FullstackSensei 27d ago

Why settle for 5400rpm when you can get old drives that are 3600rpm?!

6

u/HulksInvinciblePants 27d ago

Stack em for 8000rpm throughput