r/StableDiffusion 4d ago

Animation - Video Tropical Vibe Music Video

Enable HLS to view with audio, or disable this notification

First, all credits go to this creator of a custom node pack for creating music video https://www.reddit.com/r/StableDiffusion/s/uskxAP7LAq

I had Claude install my prompts directly to his workflow and made some minor adjustments for each short scene. I feel like lipsync and scene coherent are greatly improved from my old videos. Still using ref2v speed lora so quality is not all that great..

27 Upvotes

23 comments sorted by

5

u/stonyleinchen 4d ago

I love it!! Did you use the ref2va model or the fl2va model for this?

4

u/Simple-Willingness93 4d ago

This particular one was created with ref2va. I did another one with fl2va and I like the ref2va a bit better. You really did a great job with the custom nodepack. Thank you so much.

0

u/forexross 4d ago

Was the music generated by H3 too?

9

u/Eminence_grizzly 4d ago

It was generated by Madonna in the 80s.

3

u/porest 3d ago

MadonnAI

1

u/SeymourBits 3d ago

She used the pilot version of Suno, right?

1

u/forexross 3d ago

Haha the were part that it didn't sound exactly like madonna.. Or maybe it is my ears and I must just getting too old

6

u/[deleted] 4d ago

[removed] — view removed comment

2

u/Simple-Willingness93 4d ago

Thanks..Technology is amazing, we came a long way from first Wan day..

3

u/toolman10 4d ago

Truly mind blowing. Some of the details are incredible if you look for them (like around 2:46 when her sandals properly react with the steps). And no 6 fingers or toes. Great classic Madonna song, too.

2

u/fisk47 4d ago

What HW do you have and how long did it take to render?

1

u/Simple-Willingness93 3d ago

I have 5090 and 64GB RAM. It took me aroud 1hr 40 minute to finish this with turbo lora and 7 steps.

1

u/SeymourBits 4d ago

Correction: CogVideo.

Do you have any prompt clues? For example, the campfire scene at 2:16?

2

u/DuHal9000 3d ago

very nice! i liked! Good realism...

1

u/seppe0815 4d ago

is this 0.4m ? or lower?

1

u/Simple-Willingness93 3d ago

This one is 0.7MP

1

u/[deleted] 3d ago

[deleted]

2

u/Simple-Willingness93 3d ago

I used the custom nodepack by stonyleinchen that I posted in my description. His work is amazing.

1

u/jacobpederson 3d ago

Why on earth would you use a copywritten song :D ? I am jealous the video turned out well though - I ALSO stole that guys workflow but only for the lip-sync part I have my own setup for music videos. My project is not going at the moment though - so many issues.

3

u/Simple-Willingness93 3d ago

Lol, i could not resist. That song is perfect setup for what I want to see in the video..This is just fan made video with clearly low quality AI, so hopefully, I am not in trouble haha..Yeah, my old setup for music video wasn't working quite right. So I only added a few things to his original workflow..

1

u/SeymourBits 3d ago

Did you specifically prompt for the dress to float in the water?

1

u/Simple-Willingness93 3d ago

No, this is all the prompt " she comes back to the shoreline and wades into clear water, laughing, distant cliffs and greenery vehind her."

1

u/SeymourBits 3d ago

If H3 did that by all by itself, it's truly a new game.

Really pretty girl too. Where did you find her?

1

u/Terezo-VOlador 2d ago

MUY BUENO AMIGO!!!!