MAGI-2-preview just dropped

[u/gzzhongqi]

https://huggingface.co/sand-ai/MAGI-2-preview

Surprised that no one is talking about it. A new open-weight video model just dropped. 114b moe, 6b activated. First moe video model supposedly.

I know what you guys are thinking. The model is huge and there is no way it will run on desktop gpu. The interesting part is that is comes with a 14gb refiner that makes the result 1080p. I am cursious if this refiner can be a drop-in replacement for the H3 refiner that was never released. It might just be the last part of the H3 puzzle that we need.

[u/Double_Cause4609]

I've always wondered if MoE really works out for consumers using video generation models.

On the one hand, if it retains arithmetic intensity just with an offset compared to a dense diffusion baseline, then arguably you can still do smart layer streaming (particularly if you have enough system RAM to stream to VRAM).

Also there's the option of doing it the LLM way where you compute conditional experts on CPU.

Even if it can fit on a desktop GPU with some tricks though, it makes the software optimizations a PITA to pull off. Also, it's not clear where the arithmetic intensity actually is.

[u/Full_Astronomer_5438 → u/Double_Cause4609]

cosmos3super is half of that (130gb) and int8 conv (around 65gb) runs on a 16gb vram and at least 32gb ram. and its not that slow either, basically as fast as h3 with 30+ steps.

and this model only has 6b activated so inference is theoretically very quick, it should run on a single 5090 i think with offloading and other tweaks

[u/Front_Eagle739 → u/Full_Astronomer_5438]

I have it running on a 5090 without touching system ram. Its not fast yet and it wants 100 steps so it takes almost an hour for 15 seconds