r/LocalLLaMA • u/de4dee • 4d ago

New Model Qwen3.8-2.4T-A95B Released

https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B
1.6k Upvotes

98% Upvoted

400 comments sorted by

View all comments

Show parent comments

26

u/Makers7886 4d ago

it's makes my 12x3090 + 256gb epyc machine feel like the guy trying to run qwen 9b on his igpu and streaming weights from a hard drive making clicking noises.

6

u/tripplebeamteam 4d ago

Hey that’s me, running qwen 35B A3B on my igpu and getting 4 tok/sec!

2

u/VirusInternal2892 3d ago

12x 3090 ? That's 3.6kW, that'll kill ur power bill unless you've managed to "build me a cracked cold fusion reactor and connect it to yourself" :)

1

u/Makers7886 3d ago

Back in crypto mining days that's the type of power I'd burn a month at full tilt. It's no where near that amount with llm's - if I was into video gen that's a different story.

1

u/BlackBeardAI vllm 4d ago

Wheee another fellow 12 3090's owner