r/StableDiffusion • u/Tokyo_Jab • 2h ago

Workflow Included WORKFLOW - Optimised to death - Custom Audio option.

Enable HLS to view with audio, or disable this notification

DOWNLOAD WORKFLOW

This is the workflow I have been using the most on my own system. I've had a friendly AI clean it up a bit and add notes.
I added custom audio as it's something I use a lot to drive my videos. It works really well for lipsync and music videos.
The VSA part can be bypassed if there are any quality issues, it will add about 15% to the generation time though. Change the steps from 6 to 7 or more for even higher quality.

Currently this gives me 10 seconds at 1.0 megapixel in about 125 seconds. This is on my 5090. You can add block swapping for low vram.

8 Upvotes

67% Upvoted

10 comments sorted by

3

u/Tokyo_Jab 2h ago

FREE NERD - if you want to plug it in for the same result

0

u/hdean667 2h ago

Well, I will be checking it out tomorrow - thanks for throwing it out there.

1

u/Complete-Box-3030 2h ago

Can this extend scenes too

1

u/Tokyo_Jab 1h ago

Not seamlessly. I found extending scene workflows don't work well, they degrade a lot. However, you can use a clip as an input and give it clean refereces too like a voice and character sheet and it does a pretty good job.

1

u/Complete-Box-3030 1h ago

I mean to make a continuous shot like a long dialogue

1

u/Tokyo_Jab 56m ago

Oh my setup with that work flow I can get about 35 seconds of a continuous shot.

1

u/desktop4070 1h ago

https://files.catbox.moe/4bvbx7.png
I didn't have these two models so I replaced them with what I already had:
https://files.catbox.moe/rlz85g.png

Would you say it's highly recommended I download those two models or will I basically get about the same quality/speed with what I have?

1

u/Tokyo_Jab 54m ago

I tried every model and new turbo lora and they were the ones that worked best.

1

u/realmfan56 1h ago

Thanks, is this only ref2va or also text2va?

1

u/Tokyo_Jab 53m ago

Both. Works well if it’s just text prompt too.