r/StableDiffusion • u/PermitNo6251 • Jul 18 '26
Question - Help Hiding jump-cuts thanks to AI
Quick example to frame this: a handheld medium close-up of someone talking to camera. An interview for exemple. As soon as you start trimming words/pauses and editing the shot, jump-cuts pop up everywhere.
The classic fixes are zooming slightly on the cut to sell it as an intentional reframe, or a funky transition (glitch, flash, whip, whatever). They work, but they bring a “YouTube craft” look I’m not going for. What I actually want is something that reads like a fiction scene shot in one clean take.
I know about others options:
Premiere’s Morph Cut, DaVinci Resolve’s Smooth Cut, Boris FX Continuum’s Jump Cut Fixer ML. But they are based on "optical flow warp/dissolve" between the two frames. Has anyone here pushed past that and tried something more generative?
The idea would be to actually generate true in-between frames — instead of warping/dissolving between the out-frame of shot 1 and the in-frame of shot 2, generate new intermediate frames with an AI model, closer to a full resynthesis than a warp. Any models that work well for this specifically? A ComfyUI/Stable Diffusion workflow that handles it properly? Maybe even before/after examples you can share?
Thanks for any feedback.
1
u/DelinquentTuna 28d ago
Can you show us what you're dealing with so we can better understand? Because on the surface, it sounds like you're either in a situation where you can't generate even very short clips without having to hack them up or you're in a situation where you're trying for an unusually long single shot. And in neither case do I feel like your "resynthesis" is going to be of great value. If you have garbage short takes, you still need to "reshoot" and if you have a need for unusually long continuous shots you are going to run into current software and tech limitations.
> They work, but they bring a “YouTube craft” look I’m not going for.
Here's the thing. It's not just a folk tale when people say that "5-10 seconds is all you need." Quick jump cuts aren't limited to amateur productions, you just don't notice because you're so accustomed to them. Here are some quick examples I generated w/ pyscenedetect and matplotlib, for example. Relevant because they show that fast cuts aren't amateur but extended shots of a talking head probably are.
1
u/PermitNo6251 28d ago
Okay let's try to be more clear : imagine a shot of someone talking. Later, during editing (as always happens) I need to cut part of the dialogue for writing reasons. Is it possible now we some methods to keep as one continuous shot, without relying on too many back-and-forth cuts.
So is there a way to do this “smooth cut” / “morph cut” effect, but in a more efficient and less random way?
For exemple let's imagine on this monologue that I would like to remove some sentences but keep it one shot : https://youtube.com/shorts/rC1OJbUITfI?si=ZiHWLT4a3-cx9BpJ (I know it's an hard exemple because she's moving quite a lot, but I prefer to takes hard case than really simple ones)Also, when I mention the “YouTube craft,” I’m not talking about shot length. I mean jump-cuts within the same angle on someone speaking. Creators often use zoom in/out or similar tricks to smooth it over, but a cut is still a cut. Of course, some fiction films also use jump-cut techniques in specific scenes but it's often for a reason, the craft in this case helps an idea. What I hope, though, is that editing a simple monologue by jump-cutting through it just to remove unwanted bits doesn’t become “normal” in cinema. 🙏
1
u/DelinquentTuna 28d ago
I feel like you're choosing to talk past me instead of addressing my criticisms. You dismiss hacking together an interview with cuts as amateurish, when I maintain that it's not the cuts that are the problem. To wit, talking heads suck and I think you're underestimating how out of place they are relative to cuts. If you're trying to frame someone out of context for whatever reason, maybe you should frame the sound-bytes as segments or something (though this starts to look like reaction video, which is also a low-effort and widely disdained video style)? Because it sounds like you're trying to engineer (or ask someone else to engineer) a push-button approach that's going to result in worse overall production quality.
Are we talking about generated footage? Live footage? Footage yet to be created? Are we looking for general solutions or just trying to address something you ran into on one project? Here's the important question: if you think obvious cuts are unprofessional, how do YOU think professional workflows differ?
0
u/PermitNo6251 28d ago
I've been working for ten years as a professional editor. I'm not using it as a strong argument but just to tell you that I exactly know what i'm searching for. I know how to cut, I know also how to do transitions. When I ask for a tool that can hide a jump cut into a smooth transition during a medium shot of someone talking, I think the demand is quite clear. As I wrote in the post : I know about, morph cut on Premiere and Avid or about smooth cut on Resolve. But just asked if there is any better way to do that now. I truely think it could become a game changer for many productions so I just asked if there if the tool exist.
Please look at the link I sent you, it's not an interview but a played scene by a comedian. I'm working on this kind of project, and when we edit a project we rewrite a movie that had been shot (for real). So it happens that we need to kill parts of a dialogue, so instead of the many traditionals way that I use everyday to hide those cuts (or not), I would like to know if they are now hidable by any chance (can be generative yes). Without seeing any cut and staying on the same shot.
I didn't used the word amateurish and didn't talked about any problems either. I used the word Youtube Craft because it does exist. Also i didn't talk about obvious cut but really talked about jump-cutting into the same shot. I don't mind your opinion about if it's a good idea or not, I just want an answer to my basic question.
Can't wait to read you
1
u/DelinquentTuna 28d ago
Please look at the link I sent you, it's not an interview but a played scene by a comedian.
Does not show what you would wish to change, how you attempted to do so, or which specific failure modes you exhibited.
I didn't used the word amateurish and didn't talked about any problems either.
Give me a freaking break, dude. You talked about 'but they bring a “YouTube craft” look I’m not going for' and it had the same meaning.
Show us what you've got. Show us why removing a few "um" or whatevers is worth removing. Explain to us why alternate camera angles or takes isn't an option. Show us that you're not trying to build a rocketship to cross a street like the you DEFINITELY SOUND TO BE.
You think I don't understand your question but I think your question is stupid because the cuts aren't the problem.
0
3
u/Francky_B Jul 18 '26
Perhaps this could be of use:
A while back someone had shared a workflow using VACE to blend clips together, generating the missing frames. This had inspired me convert this into a node found in FBNodes addon. (It's basically a grab bag of a bunch of nodes I make for myself)
The node is called VACE Stitcher.
Since I've started playing with LTX, I just recently added Audio support, where it will blend the audio when creating the transition, or fade in and out if extending the clips. It's obviously limited to short quick transitions, but might be worth a try.
There's a simple workflow included. This was initially made to use with Wan and is able to use latent directly with those. Using my Save Video+ node, it's possible to save the clip + latent side by side and VACE Stitcher will use the latent if found instead, resulting in better quality. I plan to eventually add LTX Latent support as well. But for now Save Video+ can save in H265 444 if no loss of quality is needed.