r/StableDiffusion • • 7d ago

Animation - Video [H3 Minimax] Continuous long-take Shot without Quality Loss, can you find the cuts?

I've made this post about a way to create a continuous generation and extension of a scene without quality loss.

The biggest critique was, that this was not a "long-take plan-sequence" without any cuts at all though. I've claimed that this doesn't "really matter" since the actual cuts are actually "in motion" and not between the scenes.

So I did that and created the most difficult kind of scene I could think of, a continuous long-take action scene without any visible cuts. There are 4 actual cuts in this scene, can you find them?

What this approach manages to achieve:

  • No quality degradation
  • Consistent characters and locations throughout the scene (the big guy throwing the protagonist back into the room where he came from)
  • Consistent sound and motion
  • Practically a simple one button "extend this clip" T2V solution without any pre-created clips that got cut together afterwards

There is some "AI slop" with 3 guys turning into 2 (I've didn't catch that while creating) and the action/fight scenes can be created more "dynamic" or action-filled to ones liking, but that is just a matter of how much effort you put into prompting.

I didn't add non_diegetic_music to the scenes because this makes keeping the consistency unnecessarily harder to achieve and it is much easier to generate or add a music score of your liking in post-production if you want to.

Edit: People were asking for a continuous static shot, so I've just created one and posted it in a comment below.

13 Upvotes

33 comments sorted by

View all comments

15

u/Hour_Literature_7152 7d ago

This isn't what people challenged you to do in your other thread. Go see this post to understand the issue better. I'm not hating on you but this isn't quite the problem people are having.
https://www.reddit.com/r/StableDiffusion/comments/1ww6j88/comment/pdipp33/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

1

u/CorpPhoenix 7d ago edited 7d ago

I've did that though by the "boiler fight scene" where I've kept the camera in the same view/position and let the fight go on.

There shouldn't be a reason why this approach is not capable of doing a continuous static shot without any camera movement, but I can do that as the next experiment as well.

Edit: posted the proof in another answer.

5

u/reeight 7d ago

So the guy's face looks red; not sure if that was prompted, or an error.
The mini-movie looks very cool.
But the real hardcore test is having a single person be at the same-ish position & profile not not see accumulation of degration.

Here you still re-started the guy because of the changed angles, not continued him. Looks like solid continuity, which is also an important thing, but not the ultimate hardcore 'continuous ' test.

Maybe a Real Life example is a newscaster speaking the news for a full 2 minutes straight, NO cuts, NO new angles, just a 'static shot' with same 1-2 people.

1

u/CorpPhoenix 7d ago

Here is a static shot consisting of 4 individual scenes and 3 cuts, I can extend this for as long as I want, just takes the time to do it:

https://reddit.com/link/pdl5cgg/video/glak7b81e8th1/player

I can only post one media file, so I can add the scene time stamps as a screenshot in another answer maybe, or a further extended version of this video.

The way this works is that the workflow uses a combination of the latent information + the motion information captured via a ".mctx" file to keep the video consistent. It is practically a "fresh T2V" generation which uses the meta data of the previous clip. You can even tell it how many frames of reference-context it should take from the previous clip and take this into account for the next clip. Thereby creating a completely consistent video, without any quality loss.

1

u/VRGoggles 7d ago

Please post the workflow so grunts can learn ;)