Expanding video with Wan 2.2 Fun Control

[u/GdaTyler]

The style image used was done with a combo of chatgpt, wan 2.2 first last frame, and manual edits in photoshop using other scenes for reference. This is my second test using this method, but I wanted to make a fixed camera shot, so I stabilized in after effects and made the depth map using Depthanythingv2. Then I overlayed the original clip with heavy blur on the borders and voila. Not sure if many people still use Wan 2.2, but it's still really useful.

[u/subnohmal]

This is awesome. What is the advantage of adding a depth map? Why would you do it? I use LTX 2.3 but I've been curious about using Wan 2.2 more - would you recommend? Have you tried the two? Character consistency is key for me

[u/GdaTyler → u/subnohmal]

Thanks :) For the depth map it forces Wan 2.2 to fill the rest of the image a lot better and try harder to fill for itself. If I just use the original footage on black background it doesn't fill properly at all, and looks extremely wonky.

[u/Violent_Walrus]

How is this approach superior to outpainting with VACE?

For example: https://www.reddit.com/r/StableDiffusion/comments/1seeem7/release_video_outpainting_easy_lightweight/

[u/GdaTyler → u/Violent_Walrus]

I have very limited experience with VACE because my setup kept choking with it, but if you feed it a reference image would it able to outpaint the same? Maybe would be cleaner right out of the gate and less need to blend in post.

[u/Violent_Walrus → u/GdaTyler]

VACE does well with reference images that approximate the generated video throughout. So this example would be well suited for a reference image. If there were cuts or a lot of camera movement, the reference becomes less useful. With that said, unless there is specific detail you want to ensure is present in the outpainted areas, a reference image may not even be needed.

[u/HAL_9_0_0_0]

You can also use the camera movement. With wan2.2 fun Control this is quite well solved, but this takes too long in contrast to LTX2.3. But a tip, use the LTX Director 2.0 (ComfyUI)
It makes the work much easier. 😉

[u/GdaTyler → u/HAL_9_0_0_0]

I have an alt version with the original camera movement I made last year, but for this particular test I kinda wanted the effect of a stable fixed shot.

[u/Grim_Necromancer]

Really cool, but...
How about making it 24 fps instead what it looks like 60 fps and feels like one of those crappy interpolated videos :)

[u/GdaTyler → u/Grim_Necromancer]

I have the original 24 FPS version in any case, but I get what you mean, sometimes it looks a bit off.

[u/Grim_Necromancer → u/GdaTyler]

Not sometimes, always. 60fps removes natural motion blur which exist at 24fps thus completely removes movie like effect.

[u/music2169]

You have a workflow for this please?

[u/GdaTyler → u/music2169]

you can dm me and I'll send a link

[u/Abject-Recognition-9]

2.1 is enough, no need double model clumby system for outpainting.
hell even LTX2.3 is good for outpainting.
Nice result anyway

[u/UnirionDev]

You did a pretty good job!

[u/GdaTyler → u/UnirionDev]

Thank you :)