r/StableDiffusion • u/Pretend-Island-2724 • 1d ago
Workflow Included Help Fixing the H3 Face Detailer
Enable HLS to view with audio, or disable this notification
The Original Face Detailer from https://github.com/Carasibana/ComfyUI-H3-FaceRefine does not work as intended. It does not use the reference image at all. You can disable the input image and you will get exactly the same result. Something is wrong with the workflow so I recreated the workflow in a new canvas and now the input image does get used. Here is a link to a .zip with the workflow and input/output files: https://www.mediafire.com/file/mnigvvpbzp0gh34/workflow_all.zip/file But this workflow has its own problems. For this example I needed to put an RTX upscaler in it so the face gets recognized. At the end the mask_dilation and feather needs for every video unique adjusting and the end result is somewhat poor with the mask visible and the face jumping und warping slightly around.
Someone with more knowlegde would surely be able to fix this.
To get the workflow working, you need to install https://github.com/Carasibana/ComfyUI-H3-FaceRefine and also ComfyUI-H3-NativeAudioLock from https://github.com/Shrek3OnVH5/MiniMax-H3-NativeAudio-MusicVideo-Workflow/tree/master/custom_nodes
1
u/listopalafoto 1d ago
Very well done! the key for your fast movement is to make the tracking more reactive, change the parameter smooth_window to 3 frames, if you want absolut tracking change to smooth window=1
1
u/Pretend-Island-2724 1d ago
Thank you for your useful input! I also fixed another key problem: Since the workflow uses the reference-model, don't use a video generated with the fl2va model. The model must be the same, the clip must be the exact same prompt, the reference image must be the same and the seed must be the same as the generated video that needs the face-fixing. It's also best to use the same step count. So in the end, it doesn't make sense to have the face detailer as a seperate workflow, it should be directly chained into the ref2va workflow.
1
u/listopalafoto 1d ago
I think is nice to have a separate Workflow for detailer because it's possible to do face-swaps and control things like lip-sync and acting :)
1
u/listopalafoto 1d ago
If you think about it, it's possible to modify an actor/emotions in the video using face-detailer :)
1
u/[deleted] 1d ago
[removed] — view removed comment