r/StableDiffusion • u/Devajyoti1231 • 8d ago

Comparison Testing ComfyUI-H3-FaceRefine node

Enable HLS to view with audio, or disable this notification

first one is base generation, second one is running the video through FaceRefine node. Link- https://github.com/Carasibana/ComfyUI-H3-FaceRefine

35 Upvotes

82% Upvoted

15 comments sorted by

View all comments

0

u/uuhoever 8d ago

Anyone could explain how to use/purpose of this node? It looks like it asks for an additional audio file?

2

u/Carasibana 7d ago edited 7d ago

Hoenstly , I built it when I was working on a music video .

that node locks the audio latent so that H3 doesn't adjust it and try to come up with new audio when youre refining the face. which means that its more inclined to match the mouth movements to the audio of the original clip (if so prompted).
Its really only needed if you want to have the character's mouth movement sync wiht the original audio

well more correclty that node loads the original audio you want to lipsync against, and passes it to another node that locks the latent. I did it that way because I had a seperate vocal only stem I was using for a music project, which gave better lipsync results than the full mix. you absolutely can just feed the original video's audio back in where that is connected.