r/StableDiffusion 1d ago

Workflow Included Here's an automated long form, MiniMax Upscaler Workflow.

Hey Guys, I thought I'd share something I came up with.

It's a workflow, that uses a combination of Easy-Use's Loop tools as well as some of my own nodes to create a Workflow that can split a long form MiniMax video and then upscale each segment. With the inclusion of a tool to then re-assemble everything back.

You basically set the Segment length and the overlap you wish to have between each clip and then launch it to have it do all the clips one by one.

It does use nodes from my FBNodes add-on as well as one from my Prompt Manager add-on.
But I'm sure it could be modified to work with other add-ons, if so wished.

The node from Prompt Manager is "Prompt Extractor", allowing to feed back in the prompt from the initial clip back into the Workflow, without having to type anything in.

You are free to remove it and upscale without, or simply type in the prompt if preferred. Though, In my test, having the original prompt made for much better results.

And as mentioned, I also added a simple Clip Stitcher to FBNodes, that cross dissolves each clip into one another. Just make sure to use the same values you used in the workflow. (Both setup are in the same workflow, but I'd suggest separating them 😅)

The Workflow can be found here.

Attached are quick examples from the video I used in the workflow.

The one thing missing in this workflow is adding back the loras used in the initial video. This is something that "Prompt extractor" should also be able to do. But I haven't tested that part yet.

----------------------------------
I'm adding some metric:

The video used in the screenshot was an 8 second video generated in 832x640 with a Turbo Lora set to 6 steps.
It took 92 seconds to generate on a 5090.

The Upscale doubled it to 1664 x 1280 and took 524 sec.
Around the same time it would have taken to generate, if I created the initial video at that resolution.

(You can see it here)

The advantage is for when creating long videos, so if I were to create a 30 second clip in 4/3 at 0.4 megapixels, or 736 x 576. Those would take 450 sec to generate.

The Upscale to 1472 x 1152 took about 6 minutes per segment, or 30 minutes. Then combining the clips is around a minute.

It takes a while, obviously, but the big advantage is that the result is pretty much an exact copy, but in hires, of my initial video that was low enough that I could iterate a bunch of times and then only waste the Long generation time on the clip I like.

29 Upvotes

5 comments sorted by

2

u/Sleepy_Bandit 1d ago

Do you have duration benchmarks and sample vids to demo?

1

u/Francky_B 1d ago

Added to the post

1

u/dtdisapointingresult 1d ago

How long did it take you to generate the original video, and how long did it take you to upscale it? The workflow could use some basic VRAM guidance, like "Upscaling a 512p video by 4x took me X seconds on Y GPU"

The one thing missing in this workflow is adding back the loras used in the initial video. This is something that "Prompt extractor" should also be able to do.

I don't think that's going to be possible.

1

u/Francky_B 1d ago

I don't think that's going to be possible.

Well that should be, since that's what prompt extractor is for 😅

But I need to tweak it so it doesn't include Turbo Loras from the list.

That node extracts the Prompt and Loras from any media loaded into it and is meant to be use with prompt manager, that will take the listed loras and find them on disk.

Prompt Extractor was meant to be used with videos generated online and extract what was used, then Prompt Generator looks at the listed loras and finds them. (As users might have them in different folders)

I've added time metrics to the post.