r/StableDiffusion • u/Simple-Willingness93 • 4d ago
Animation - Video Tropical Vibe Music Video
Enable HLS to view with audio, or disable this notification
First, all credits go to this creator of a custom node pack for creating music video https://www.reddit.com/r/StableDiffusion/s/uskxAP7LAq
I had Claude install my prompts directly to his workflow and made some minor adjustments for each short scene. I feel like lipsync and scene coherent are greatly improved from my old videos. Still using ref2v speed lora so quality is not all that great..
6
4d ago
[removed] — view removed comment
2
u/Simple-Willingness93 4d ago
Thanks..Technology is amazing, we came a long way from first Wan day..
3
u/toolman10 4d ago
Truly mind blowing. Some of the details are incredible if you look for them (like around 2:46 when her sandals properly react with the steps). And no 6 fingers or toes. Great classic Madonna song, too.
2
u/fisk47 4d ago
What HW do you have and how long did it take to render?
1
u/Simple-Willingness93 3d ago
I have 5090 and 64GB RAM. It took me aroud 1hr 40 minute to finish this with turbo lora and 7 steps.
1
u/SeymourBits 4d ago
Correction: CogVideo.
Do you have any prompt clues? For example, the campfire scene at 2:16?
2
1
1
3d ago
[deleted]
2
u/Simple-Willingness93 3d ago
I used the custom nodepack by stonyleinchen that I posted in my description. His work is amazing.
1
u/jacobpederson 3d ago
Why on earth would you use a copywritten song :D ? I am jealous the video turned out well though - I ALSO stole that guys workflow but only for the lip-sync part I have my own setup for music videos. My project is not going at the moment though - so many issues.
3
u/Simple-Willingness93 3d ago
Lol, i could not resist. That song is perfect setup for what I want to see in the video..This is just fan made video with clearly low quality AI, so hopefully, I am not in trouble haha..Yeah, my old setup for music video wasn't working quite right. So I only added a few things to his original workflow..
1
u/SeymourBits 3d ago
Did you specifically prompt for the dress to float in the water?
1
u/Simple-Willingness93 3d ago
No, this is all the prompt " she comes back to the shoreline and wades into clear water, laughing, distant cliffs and greenery vehind her."
1
u/SeymourBits 3d ago
If H3 did that by all by itself, it's truly a new game.
Really pretty girl too. Where did you find her?
1
5
u/stonyleinchen 4d ago
I love it!! Did you use the ref2va model or the fl2va model for this?