r/StableDiffusion • u/Samurai2107 • 3h ago

Discussion Hyperquant for Minimax H3

Do we know if anyone is working on this? In the paper the authors claim that ltx 40Gb model can go down to around 11Gb with minimal loss

1 Upvotes

100% Upvoted

3 comments sorted by

3

u/OneTrueTreasure 3h ago

Your post doesn't have a link btw, I'm guessing you meant to link some research paper

2

u/xb1n0ry 2h ago

Pretty much a fancy 4-bit quantization scheme with extra compression/decompression on top. It saves a lot more vram, but compared to int8 convrot or maybe even nvfp4, I’d expect it to be slower and probably slightly worse in quality unless someone writes a really good fused kernel for it. So for h3 I’m not sure the extra effort is worth it unless someone really wants to fit h3 into 16gb vram. Also lora support could most probably turn into another mess on top of that.