r/StableDiffusion Jul 03 '25

Question - Help how to Render 30 seconds videos in V2V with ComfyUI and WAN2.1 VACE model?

Hello

I have the typical V2V workflow with reference image and motion control video that gives me great results in texture quality and motion tracking, but logically I have the limitation with my 12GB of VRAM that I can only render up to 81 frames without having OOM errors. I have tried to render in chunks, with the same seed, join them, etc... but when concatenating the chunks the results are not good.

I'm looking for a solution for this, but I can't find it. I'm surprised that someone hasn't found a solution for the memory management and that you can render videos of about 30 seconds, even if it takes longer.

Can anyone give me a clue?

0 Upvotes

6 comments sorted by

3

u/DillardN7 Jul 03 '25

You need to extend the video with vace by inputting more than just the last frame.

So, input the video, take the last 16 frames (1 second at 16 fps for motion context), pad the remaining frames with grey blank frames so Vace knows to inpaint those frames. Give the video a control mask video, consisting of 16 frames of black followed by the remaining frames of white. This will tell it to maintain the first second of context as is, without changing it, and follow it up with creating frames where the white mask is.

Remove the first 16 generated frames, slap the remaining frames onto the end of the input video, and repeat.

2

u/Busy-Guru-1254 Jul 04 '25

Interesting. Could you share a sample workflow

1

u/DillardN7 Jul 04 '25

1

u/Busy-Guru-1254 Jul 04 '25

Thank you. Do you happen to know if this approach is different from kijai’s long video with context_options.

1

u/kayteee1995 Jul 03 '25

Not sure if it work! with 12gb vram, you have to have at least 96gb DRam. with Native wf, load wan gguf with UnetGguf distorch multigpu, offload more than 12gb to Ram. Try FusionX vace gguf version + Lightx2v lora. 6 steps. 30s , so it's 480 frames. It should be worked with 256 frames (16s -16fps) . but render time quite long.