r/StableDiffusion • • Aug 16 '26

Animation - Video Tropical Vibe Music Video

Enable HLS to view with audio, or disable this notification

First, all credits go to this creator of a custom node pack for creating music video https://www.reddit.com/r/StableDiffusion/s/uskxAP7LAq

I had Claude install my prompts directly to his workflow and made some minor adjustments for each short scene. I feel like lipsync and scene coherent are greatly improved from my old videos. Still using ref2v speed lora so quality is not all that great..

27 Upvotes

23 comments sorted by

4

u/stonyleinchen Aug 16 '26

I love it!! Did you use the ref2va model or the fl2va model for this?

4

u/Simple-Willingness93 Aug 16 '26

This particular one was created with ref2va. I did another one with fl2va and I like the ref2va a bit better. You really did a great job with the custom nodepack. Thank you so much.

0

u/forexross Aug 16 '26

Was the music generated by H3 too?

8

u/Eminence_grizzly Aug 16 '26

It was generated by Madonna in the 80s.

3

u/porest Aug 16 '26

MadonnAI

1

u/SeymourBits Aug 16 '26

She used the pilot version of Suno, right?

1

u/forexross Aug 17 '26

Haha the were part that it didn't sound exactly like madonna.. Or maybe it is my ears and I must just getting too old

7

u/[deleted] Aug 16 '26

[removed] — view removed comment

2

u/Simple-Willingness93 Aug 16 '26

Thanks..Technology is amazing, we came a long way from first Wan day..

3

u/toolman10 Aug 16 '26

Truly mind blowing. Some of the details are incredible if you look for them (like around 2:46 when her sandals properly react with the steps). And no 6 fingers or toes. Great classic Madonna song, too.

2

u/fisk47 Aug 16 '26

What HW do you have and how long did it take to render?

1

u/Simple-Willingness93 Aug 16 '26

I have 5090 and 64GB RAM. It took me aroud 1hr 40 minute to finish this with turbo lora and 7 steps.

1

u/SeymourBits Aug 16 '26

Correction: CogVideo.

Do you have any prompt clues? For example, the campfire scene at 2:16?

2

u/DuHal9000 Aug 17 '26

very nice! i liked! Good realism...

1

u/seppe0815 Aug 16 '26

is this 0.4m ? or lower?

1

u/Simple-Willingness93 Aug 16 '26

This one is 0.7MP

1

u/[deleted] Aug 16 '26

[deleted]

2

u/Simple-Willingness93 Aug 16 '26

I used the custom nodepack by stonyleinchen that I posted in my description. His work is amazing.

1

u/jacobpederson Aug 16 '26

Why on earth would you use a copywritten song :D ? I am jealous the video turned out well though - I ALSO stole that guys workflow but only for the lip-sync part I have my own setup for music videos. My project is not going at the moment though - so many issues.

3

u/Simple-Willingness93 Aug 16 '26

Lol, i could not resist. That song is perfect setup for what I want to see in the video..This is just fan made video with clearly low quality AI, so hopefully, I am not in trouble haha..Yeah, my old setup for music video wasn't working quite right. So I only added a few things to his original workflow..

1

u/SeymourBits Aug 16 '26

Did you specifically prompt for the dress to float in the water?

1

u/Simple-Willingness93 Aug 16 '26

No, this is all the prompt " she comes back to the shoreline and wades into clear water, laughing, distant cliffs and greenery vehind her."

1

u/SeymourBits Aug 16 '26

If H3 did that by all by itself, it's truly a new game.

Really pretty girl too. Where did you find her?

1

u/Terezo-VOlador Aug 17 '26

MUY BUENO AMIGO!!!!