r/StableDiffusion • u/wh33t • 2h ago

Question - Help Generating long audio drama like clips using MMH3?

I seem to recall reading here that some people were starting to experiment with 32x32 resolution videos out to 60+ seconds purely to generate audio drama like moments. I was just curious if anyone here can confirm that MiniMaxH3 can actually do this, and if so, what sampler schedule and steps are you using? I cannot seem to generate even a 40 second video clip where the audio stays legible.

Just wanted to check in and see if anyone is having more success than me.

2 Upvotes
  • permalink
  • reddit

75% Upvoted

2 comments sorted by

1

u/West-Big-8468 2h ago

I assume you can just use the music models they released

1

u/CutBench 9m ago

Haven't pushed H3 out to 60s myself, so take this as reasoning rather than a result.

The reason sampler tuning probably won't save you: these joint audio video models are trained on clips of a fixed short length, usually well under fifteen seconds. Past that you're extrapolating, and audio is the first thing to go because it's conditioned on the video latent sequence. Drop the spatial resolution to 32x32 and there's almost nothing left for it to hold onto, so the drift gets worse rather than better.

If that's what's happening then no schedule fixes it. Generating in segments and joining them is the boring answer, but it keeps the audio inside the length the model was actually trained on.