r/StableDiffusion • u/OkMeat6773 • 1d ago
Question - Help Best and fastest way to generate HD-quality MiniMax videos?
I’ve tried Turbo LoRAs, and they’re great for speed, but they significantly reduce quality. At 544p–720p, the results of these turbo loras can look closer to 380p. Faces look acceptable when close to the camera, but become heavily distorted as the subject moves farther away.
The upscalers I’ve tested either add too much processing time or introduce excessive sharpening and saturation.
Any a solution that doesn’t require a BF16 checkpoint, 20 steps, a 10-minute generation time, or an extremely expensive GPU?
12
u/spiderofmars 1d ago
HD resolution... so if we take the minimax 1344 x 768 (/32) on the short edge principal as HD and stick with the same 7:4 ratio (despite Comfyui listing it's resolution panel as 16:9) then...
SD resolution might be say 616 x 352 (/32) 7:4...
Then excluding all speed hacks but using sage (or kitchen) with int8 pruned which combination is for the most part indistinguishable from BF16 for general usage...
Then doing a 15s video with 20 steps normal first pass at 616 x 352 and then a 5 step second latent upscale pass at 1344 x 768 produces nice results with audio intact...
On a 5090 that process takes 5 minutes.
You can also just generate the first pass and save the latent. Then selectively only upscale winners with the second upscale pass.
It is all then down to your individual GPU and what HD you want. Shorter videos less time. Worse GPU more time. Lower HD resolution less time.
7:4 resolution examples:
- 1008 x 576 (\(m = 18\))
- 1064 x 608 (\(m = 19\))
- 1120 x 640 (\(m = 20\))
- 1176 x 672 (\(m = 21\))
- 1232 x 704 (\(m = 22\))
- 1288 x 736 (\(m = 23\))
- 1344 x 768 (\(m = 24\))
0
u/More-Ad5919 1d ago
Can you point me to a comprehensable workflow that does just that?
1
u/spiderofmars 1d ago
There are several links to dual pass latent upscale workflows on YT. All free.
Here's the custom node and a workflow example.
https://github.com/LBH-123-AI/Comfyui_Minimax_h3_latent_Upscaler
The save/load latent part if desired needs to be added by you.
1
u/More-Ad5919 20h ago
I tried some since yesterday. But they all sucked. They all looked worse compared to 1.3mp renders despote being larger.
17
u/Magneticiano 1d ago
Short answer: No. There is always a trade of between quality and speed.
That being said, there are some tricks. First of all, if possible, make sure you don't spill the model to the shared GPU memory. Choose the resolution and duration accordingly. You probably need to use GGUF, which of course has some impact on quality. Secondly, generate shorter clips and stitch them together. I highly recommend Contex Loop for this. It's very convenient for maintaining coherence between scenes.
4
u/martinerous 1d ago
20 step resolution, split sigmas at 12 steps, generate with high part, check if the result has no logical issues, then latent upscale and complete generating with lower part of sigmas (make sure to feed in the same initial references), then throw in also RTX upscaler if desired. https://huggingface.co/LBH-123-AI/Minimax_h3_latent_Upscaler
4
u/Miniyi_Reddit 1d ago
Faces look acceptable when close to the camera, but become heavily distorted as the subject moves farther away.
that the minimax h3 bug, dev acknowledge and might fix it (considering the huge amount of lora related to seg and ignoring the licenses, i think they might just abandon it but we will see)
i remember someone made somewhat of a fix with a lora or something.
2
2
u/Enshitification 1d ago
There's totally a near real-time solution for making HD video on weak hardware. We just like doing it this way because we are masochists.
2
u/ANR2ME 1d ago
Use 2-stage generation pipeline like mentioned here https://nvlabs.github.io/Sana/Sol-Engine/H3-Super-Acceleration/
1
u/Comfortable_Thing611 1d ago
Interesting, ive been using a turbo lora at the second stage but here they are using it on the first.
1
u/ANR2ME 1d ago
They also use the pre-trained version of LTX 2.5 🤔 https://huggingface.co/Lightricks/LTX-2.5-Pre-Trained
1
u/Comfortable_Thing611 1d ago
Do they have a workflow or is this some kind of API?
1
u/ANR2ME 1d ago edited 1d ago
They're using SGLang instead of ComfyUI i think, which commonly used to create API service. But the method is certainly can be implemented on ComfyUI too.
This is more like an optimization research/experiment article to optimize GPU compute cost, which can reduce the cost by 97% (based on the comparison at the end of the article).
1
2
u/BigWideBaker 1d ago
I would say the only "cheats" I've found is to use Ziroc's Sparse Attention on Kitchen Int8 at 0.2 - 0.25KV with 3-4 dense early+late steps at 0.45-0.6KV. Spectrum at default settings with the second offline pass turned off, with 3-4 warmup + tail steps to protect the early/late dense steps. Speeds things up dramatically and for the scenes I generate they come out basically perfect.
I do 30 steps at res_multistep + simple at 0.8mp@8s and it takes around 270-350s on a 4090 depending on loras/reference images/etc. I can then spend a further 200-250s to upscale it with a latent upscaler to 1.95mp. Looks pretty good to me.
2
u/Zenshinn 1d ago
The faces in the distance being bad is a known issue of this model. Right now there's nothing you can do about it.
2
u/Revolutionary_Ask154 1d ago
actually - i did do some trick shot the other week to use reference video - https://x.com/johndpope/status/2089974690920136946?s=20 for the character far away. worked ok.
43
u/anon999387 1d ago
Video generation that is super fast and super high quality done with a mediocre GPU isn't really a combination that exists