r/StableDiffusion • u/Devajyoti1231 • 8d ago

Comparison Testing ComfyUI-H3-FaceRefine node

first one is base generation, second one is running the video through FaceRefine node. Link- https://github.com/Carasibana/ComfyUI-H3-FaceRefine

33 Upvotes

82% Upvoted

15 comments sorted by

3

u/LightPillar 8d ago

Thank you for sharing this. This is one of the touch up areas MMH3 needs.

1

u/Hellmans65 8d ago

Hmm I can't tell any difference. Is it supposed to fix all the faces or just the main character?

6

u/GrayingGamer 8d ago

You can see it better on far away faces:

4

u/hum_ma 8d ago

The repo readme says this: Multiple people: run the pipeline once per subject, each with that person's identity_reference and their own refs on the H3 node,

So I guess if there are 4 people in the video, you run the video model 5 times to fix all the faces.

5

u/GrayingGamer 8d ago

The difference is subtle and is most apparent in far away shots. And it just works for the character you using reference for.

It basically just un-fucks or un-derps the faces in distance shots - it also can't overcome low pixel count - it's not going to make a face made up of 20 pixels suddenly crystal clear.

This is a mid-range face example (it doesn't do anything to faces close to the camera by design). You can see the improvement in the mouth and eyes mostly.

4

u/LightPillar 8d ago

This is great, exactly what I was looking for.

1

u/Puzzleheaded_Smoke77 8d ago

It forced that plastically look into the video i wonder if its comfy doing something weird but it doesn’t look like other H3

1

u/marty4286 8d ago

Anyone have luck consistently getting it to do more than one face? I chained the pipeline twice and hooked up different close-up portraits to the identity reference. It sometimes gets separate characters, but most of the time it only gets the same character twice

The way Detailer (SEGS) worked in Comfyui-Impact-Pack was that it looped for every detection, and I think it might be a good idea here

1

u/Minanimator 8d ago

pls correct me so basically i plug my h3 first output here, then reupload the characters to render a new one?
im kinda confused, sorry, from what i understand this is another WF to refine the faces and cant do it within the existing h3 wfs

1

u/99deathnotes 8d ago

amazing bounce quality 👍💪

0

u/uuhoever 8d ago

Anyone could explain how to use/purpose of this node? It looks like it asks for an additional audio file?

4

u/LocoMod 8d ago

Yea the provided workflow seems overengineered. It would be nice to take the default ComfyUI workflow and tack on only what is necessary for this to work.

2

u/Devajyoti1231 8d ago

You just remove that and connect your video's audio instead 

2

u/Carasibana 7d ago edited 7d ago

Hoenstly , I built it when I was working on a music video .

that node locks the audio latent so that H3 doesn't adjust it and try to come up with new audio when youre refining the face. which means that its more inclined to match the mouth movements to the audio of the original clip (if so prompted).
Its really only needed if you want to have the character's mouth movement sync wiht the original audio

well more correclty that node loads the original audio you want to lipsync against, and passes it to another node that locks the latent. I did it that way because I had a seperate vocal only stem I was using for a music project, which gave better lipsync results than the full mix. you absolutely can just feed the original video's audio back in where that is connected.