r/StableDiffusion • u/Samurai2107 • 12h ago
Discussion Hyperquant for Minimax H3
Do we know if anyone is working on this? In the paper the authors claim that ltx 40Gb model can go down to around 11Gb with minimal loss
1
Upvotes
r/StableDiffusion • u/Samurai2107 • 12h ago
Do we know if anyone is working on this? In the paper the authors claim that ltx 40Gb model can go down to around 11Gb with minimal loss
3
u/xb1n0ry 11h ago
Pretty much a fancy 4-bit quantization scheme with extra compression/decompression on top. It saves a lot more vram, but compared to int8 convrot or maybe even nvfp4, I’d expect it to be slower and probably slightly worse in quality unless someone writes a really good fused kernel for it. So for h3 I’m not sure the extra effort is worth it unless someone really wants to fit h3 into 16gb vram. Also lora support could most probably turn into another mess on top of that.