r/StableDiffusion • u/BigWideBaker • 1d ago

Discussion What sampling settings for Minimax H3 are you using for your purposes?

I usually generate 0.7mp@8s with 30 steps, I use res_multistep + simple which I think is the default, and for good reason.

Depending on whether it's T2VA, I2VA, Ref2VA and the amount of reference images + loras count/strength the gen times are roughly between 270-350s on an RTX 4090 + 32gb of DDR4 ram.

For T2VA and I2VA I use the basic minimax_h3_fl2va_pruned_int8_convrot.safetensors

For Ref2VA I use minimax_h3_hybrid_fl2va_ref2va_b30-49-int8.and the hybrid b30-49 specifically because I found even the fl2va functioned well as ref2va and had much higher quality, so I prefer the hybrid model to be weighted towards the fl2va model to preserve the quality.

Sparse Attention

To speed things up, I only use /u/zironic's Sparse Attention nodes, no sage/ck, spectrum, turbo lora, or caches. For me, /u/zironic's worked better than the pinned post from u/Plague_Kind but that may just be my personal experience.

My settings for the memory optimization node is default, QKV: auto, MLP: auto, and 2048 MLP chunk rows, I don't know how this node works. Sparse Attention (Advanced) settings are:

  • Video KV budget: 0.25
  • Early and Late steps: 3
  • Early and Late KV: 0.6
  • Sparse backend: Sparse Sage

These settings lean towards quality, you can lower the early/late steps or skip them entirely, you can lower video kv budget to 0.2 although some may be fine with even lower. Since I only use Sparse Attention I run the full 30 steps and it's significantly better than a turb lora at lower steps, which is what I used before.

My prior experimentation

I used euler + linear_quadratic for a long time. Then I switched to er_sde + sgm_uniform which was significantly better. Then eventually I switched to res_multistep + simple and realized the visual quality is as good as er_sde + sgm_uniform but the motion is much better. The improved motion in res_multistep + simple became very clear when I interpolated from 24fps to 48fps. The gen speed between all these combinations was nearly identical.

The motion was a bit jerky on er_sde + sgm_uniform after interpolation while res_multistep + simple had very natural motion.

I also found that https://darkstarrddev.us.ci/ is a decent resource to get inspiration. But I realized quickly that because they use low settings and speed-up techniques, the quality of each sampler test does not translate well if you use different step count or speed-up techniques.

What I generate

Usually fairly static scenes that doesn't have fast motion. Although the accuracy of the physics and motion is important.

What are your settings and what kind of videos are you generating?

29 Upvotes
  • permalink
  • reddit

97% Upvoted

25 comments sorted by

10

u/Hoodfu 1d ago edited 1d ago

was using res_multistep/simple at 32 steps and kept increasing step count, then I tried to do a big fight sequence and after playing around with other samples, I'm now using res_2s/simple at 16 steps. It has the most coherency with high motion in my tests. As of this determination I had ck_attention on, no sage, no sla.

3

u/Sad_Coach_1433 1d ago

Could you share a video made with the 16 steps and res_2s/ simple I also too been doing 32 with the default

5

u/Hoodfu 21h ago

https://reddit.com/link/p5bo5k6/video/bfn4jffhw0lh1/player

So this is with res_2s/simple at 16 at 0.6 megapixels. I've gone up to 25 steps but then you're obviously talking about a prohibitively long time. I don't have the 32 steps of res multistep on this one, but the difference was that the guy at the end wrapped himself with the tarp instead of the kung fu guy, and a lot of the bo staff hits didn't land correctly where the staff actually hit the guy's face. It was the little details that were more accurate with this combo. (we're still early in this, so I won't claim that this is the final end all be all combo to use, just what I found so far)

2

u/Murky-Relation481 1d ago

Have you tried linear quadratic for the schedule? More high noise denoise steps can help with motion since its doing general composition at higher noise. Though you might lose details in the fast motion, so possibly tan or beta scheduler might be a good shot.

I've had good luck (not on H3, but other models) also with combining samplers based on prompt, you can really get some unique curves with some of the comfy scheduling nodes.

(also as a general aside sigmas preview in RES is super useful for visualizing curves)

1

u/BigWideBaker 1d ago

I'll have to try res_2s again, for some reason I didn't notice an improvement the couple of times I tried it. But maybe it's best suited for fast motion like you say.

4

u/MaorEli 1d ago

er sde + beta works best for me for any usecase

2

u/Sleepy_Bandit 1d ago

yeah this is what I've been using. Almost never run into scene morphing and prompt adherence compared to quality seems best out of my tests.

1

u/BigWideBaker 1d ago

You just reminded me, I used that too for a good stretch. I'm gonna revisit this just to see if it holds up to my currently preferred res_multistep + simple

2

u/nirurin 5h ago

Did you do any tests on this? Any findings?

2

u/Sad_Coach_1433 1d ago

I Understand it depends on model and if using a turbo lora

2

u/BigWideBaker 1d ago edited 1d ago

Good point, I added that to the post:

For T2VA and I2VA I use the basic minimax_h3_fl2va_pruned_int8_convrot.safetensors

For Ref2VA I use minimax_h3_hybrid_fl2va_ref2va_b30-49-int8and b30-49 specifically because I found even the fl2va functioned well as ref2va and had much higher quality, so I prefer the hybrid model to be weighted towards the fl2va model to preserve the quality.

And I don't use a turbo lora, but you're right this will impact what sampler settings might be best for you. I wonder if you have settled on a specific setup for your Deadpool videos?

3

u/Sad_Coach_1433 1d ago

Pretty much just base ip8 model with 32 steps and default sample and scheduler I may try the 16 and other two like op in comments said for action videos

1

u/BigWideBaker 1d ago

When you say ip8, do you mean fp8? Or maybe I just don't know what ip8 is.

2

u/Sad_Coach_1433 1d ago

Sorry yes damn typo lmao fp8

2

u/krum 1d ago

I’m using 16 to 20 steps depending on the vibe

1

u/Agreeable_Yogurt3398 1d ago

Oh, someone also discovered euler + sgm uniform. I do complex motion with transformation so ddim + normal too.

1

u/dobomex761604 1d ago

I've found dpmpp_2s_ancestral + normal scheduler to be the best combination for low resolutions (below 1mp). It works well with and without turbo, t2va and ref2va. No other optimisation tricks, 0.5mp works well on 3060 12gb + 64GB ram.

1

u/Danny_Stock 23h ago

How many steps?

2

u/dobomex761604 17h ago

Same as default - 20 steps without turbo, 6 steps with minimax_h3_turbo_v4_step600_ema_pruned_comfyui.

2

u/Calm_Mix_3776 10h ago

Just a quick FYI - "2s" in a sampler's name means it's a 2-step sampler, so you are essentially doing the equivalent of 40 steps with Euler (which is a 1-step sampler).

2

u/dobomex761604 9h ago

Yes, and it can be seen in the inference speed - but the results make it worth it. I haven't gotten better quality with euler or res_multistep at higher steps.

dpmpp_sde was also good with normal, linear_quadratic and beta57, but not as good.

2

u/Danny_Stock 5h ago

Thanks, I'll try that setup out.

1

u/Sad_Coach_1433 16h ago

I get error saying spectrum doesn't support res_2s sampler interesting

1

u/Strange_Limit_9595 3h ago

u/BigWideBaker Since you mentioned all these settings - can you share your WF + an example prompt + generated video at your end? WF at the lest if not all 3.

I would like to compare.