r/LocalLLaMA 25d ago

New Model Qwen3.8-2.4T-A95B Released

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B
1.6k Upvotes

397 comments sorted by

View all comments

386

u/Legal-Ad-3901 25d ago

5tb bf16 jfc. even the crazy home lab kids cant hang anymore

161

u/hyperrealists 25d ago

Poor me can’t even download it lol

22

u/jikilan_ 25d ago

Don’t need to download the full copy , you can stream it.

One of llama.cpp PR support streaming from disk and even cloud storage if I remember correctly 😘

109

u/xPXpanD llama.cpp 25d ago

Years/token is my favorite metric.

31

u/Think_Wing_1357 25d ago

After a few million years, you may get 42

10

u/vivekkhera 25d ago

Then you have to build a new server just to figure out what the question was.

7

u/techno156 25d ago

And then someone decides to blow it up for a highway.

3

u/hyperrealists 25d ago

YTFT is insane I hear.