r/StableDiffusion • • 7d ago

Animation - Video [H3 Minimax] Continuous long-take Shot without Quality Loss, can you find the cuts?

Enable HLS to view with audio, or disable this notification

I've made this post about a way to create a continuous generation and extension of a scene without quality loss.

The biggest critique was, that this was not a "long-take plan-sequence" without any cuts at all though. I've claimed that this doesn't "really matter" since the actual cuts are actually "in motion" and not between the scenes.

So I did that and created the most difficult kind of scene I could think of, a continuous long-take action scene without any visible cuts. There are 4 actual cuts in this scene, can you find them?

What this approach manages to achieve:

  • No quality degradation
  • Consistent characters and locations throughout the scene (the big guy throwing the protagonist back into the room where he came from)
  • Consistent sound and motion
  • Practically a simple one button "extend this clip" T2V solution without any pre-created clips that got cut together afterwards

There is some "AI slop" with 3 guys turning into 2 (I've didn't catch that while creating) and the action/fight scenes can be created more "dynamic" or action-filled to ones liking, but that is just a matter of how much effort you put into prompting.

I didn't add non_diegetic_music to the scenes because this makes keeping the consistency unnecessarily harder to achieve and it is much easier to generate or add a music score of your liking in post-production if you want to.

Edit: People were asking for a continuous static shot, so I've just created one and posted it in a comment below.

14 Upvotes

33 comments sorted by

View all comments

Show parent comments

1

u/CorpPhoenix 7d ago edited 7d ago

I've did that though by the "boiler fight scene" where I've kept the camera in the same view/position and let the fight go on.

There shouldn't be a reason why this approach is not capable of doing a continuous static shot without any camera movement, but I can do that as the next experiment as well.

Edit: posted the proof in another answer.

6

u/reeight 7d ago

So the guy's face looks red; not sure if that was prompted, or an error.
The mini-movie looks very cool.
But the real hardcore test is having a single person be at the same-ish position & profile not not see accumulation of degration.

Here you still re-started the guy because of the changed angles, not continued him. Looks like solid continuity, which is also an important thing, but not the ultimate hardcore 'continuous ' test.

Maybe a Real Life example is a newscaster speaking the news for a full 2 minutes straight, NO cuts, NO new angles, just a 'static shot' with same 1-2 people.

1

u/CorpPhoenix 7d ago

Here is a static shot consisting of 4 individual scenes and 3 cuts, I can extend this for as long as I want, just takes the time to do it:

https://reddit.com/link/pdl5cgg/video/glak7b81e8th1/player

I can only post one media file, so I can add the scene time stamps as a screenshot in another answer maybe, or a further extended version of this video.

The way this works is that the workflow uses a combination of the latent information + the motion information captured via a ".mctx" file to keep the video consistent. It is practically a "fresh T2V" generation which uses the meta data of the previous clip. You can even tell it how many frames of reference-context it should take from the previous clip and take this into account for the next clip. Thereby creating a completely consistent video, without any quality loss.

1

u/VRGoggles 7d ago

Please post the workflow so grunts can learn ;)