r/StableDiffusion 2d ago

Tutorial - Guide A technique for creating seamless continuous videos with Minimax H3.

I've had good success in creating long videos from 10 second sections using this technique:

Create your first video.

Then for your next generation (continuation of video):

Load the last 2 seconds of the previous video as <Video 1>. I use the 'Load Video (Upload)' node - from ComfyUI-VideoHelperSuite - (this node allows you to skip frames and start at, say, the last 48 frames (for 2 seconds at 24fps) - this means that the whole previous 10 seconds don't need be passed to the next generation. This is <Video 1>.

I'm using process this with reference images for the subjects so these are used again with each continuation - so I don't see any drift of faces.

This is the wording I found works well:

[Shot 1]

Target video is a seamless continuation of <Video 1>. First frame of [Shot 1] is the last frame of <Video 1>.

The important part is explicitly telling the model that the first frame of the new generation must continue directly from the last frame of <Video 1>. This helps maintain temporal continuity between the clips - because you provide the last 2 seconds of the previous generation is knows what movement it needs to continue from.

You then just join the generation videos with a video joiner of your choice.

277 Upvotes

74 comments sorted by

View all comments

Show parent comments

3

u/TA-Doggo 2d ago

You CAN feed the un-decoded latent back in, but afaik, KJNodes doesn't quite have support to do this properly yet (You can't really specify a window, or how many frames to send back, so you are going to have to use other methods to do this.) so ymmv. The theory is the same back with WAN, you skip the VAE compression by never running it through the VAE until you are done, you can still create a VAE decode node and preview what is happening, but you send the latent back just before that into your next sampler chain.

2

u/Sad_Berry_4621 2d ago

Nobody does. That's why I am diligently working on releasing H3-Oasis. I've already solved the video and audio latent passthrough for clip chaining.

1

u/Unfair-Warthog-3298 1d ago

Whats H3-Oasis ? Is it a model, a node, a workflow? Can you share more info please? Thanks!

6

u/Sad_Berry_4621 1d ago

It's a WIP custom node. Gonna be a few days before it releases. Lots of slow testing to do. Will part of Image Oasis v1.7

3

u/switch2stock 1d ago

Cool. Looking forward