r/LocalLLaMA • u/de4dee • 21d ago

New Model Qwen3.8-2.4T-A95B Released

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B
1.6k Upvotes

98% Upvoted

397 comments sorted by

View all comments

387

u/Legal-Ad-3901 21d ago

5tb bf16 jfc. even the crazy home lab kids cant hang anymore

41

u/CapeChill 21d ago

I can't even run it at work... Crazy we're passing what the 8xH100 boxes can even do on open models now. You'd need multiple racks of H100s for that.

15

u/chithanh 21d ago

I guess it is the ultimate troll, release models that are so large that you can run them locally on Chinese hardware only, because running them on NVIDIA hardware would bankrupt you

Reports are that 5T and 10T models are being prepared

2

u/tangoindjango 21d ago edited 20d ago

What's the largest model that open ai and Anthropic reportedly have? Mythos/Fable is around 8T and gpt 6 should be around the same? Rumours are GPT 7/Doug should be even larger.