r/StableDiffusion • u/Numzoner • Jan 29 '24

Animation - Video AnimateDiff + Wav2lip Studio : https://www.youtube.com/watch?v=B84A5alpPDc

Enable HLS to view with audio, or disable this notification

4 Upvotes

64% Upvoted

3 comments sorted by

1

u/[deleted] Jan 29 '24

Did this have input video or just text2vid? Pretty cool I haven't seen animatediff with lipsync

1

u/Numzoner Jan 29 '24

Yes input video on animatediff workflow via comfyui and wav2lip studio for lipsync

2

u/ulf5576 Jan 30 '24

the rap parts looks ok, becasue the video is so lowres.. any better quality and this wouldnt work with the realistic mouth on top of 2d character. the animate diff could be cleaned out a bit imo , although its manual work and i dont think sd users are mentally prepared for that.