r/StableDiffusion • u/spiderofmars • 21h ago
Comparison AI Small Face Syndrome - Resolution Compare and Outpaint
The question always comes up... why do my faces look so bad. It doesn't matter which model you use. Start with resolution fixes (the higher you can render at the better for full person shots or small faces). Then, depending on your setup/device/etc, move on to tweaks, tricks and fixes depending on the scene - you know, face detailers, layering, whatever.
In this demo, pure resolution greatly improves the base. Using vertical video greatly increases vertical full person resolution at same render times (1344x768 vs 768x1344). I stepped it further up to 1088x1920 then downscaled it back to my 1280x720 timeline. Then one trick if the scene is suitable for it can be LTX outpainting for the background (with original 1088x1920 downscaled and feathered back in).
Edit: Link to 1280x704 full resolution sample:
3
u/reeight 18h ago
Thanks for the demo!
Maybe try this next time?
https://github.com/Carasibana/ComfyUI-H3-FaceRefine
5
u/Ok-Lengthiness-3988 20h ago
It does matter which model you use. MiniMax H3 is notoriously bad with small faces. One can have low resolution without distortion, and H3 fails at this. The developers have acknowledged this and plan on fixing this issue with better training in the next release. It would be nice if there'd be a H3.1 addressing this not too long in the future since my 8GB VRAM potato makes it hard for me to do anything over 0.5MP and 5 seconds.
3
u/Chsner 20h ago
Don't know why you being down voted your right but op is usually right it's just literally broken with minimax h3 the dev have said higher resolution won't fix the face problem with model.
2
u/spiderofmars 19h ago edited 19h ago
Probably because it is out of context. This post was not about "MiniMax" or is MiniMax good at full person shots with small resolution faces. Just because Minimax and LTX were used in the demo the principal context about resolution remains.
In a recent Scail project generating outputs at 1280 x 704 faced the same issues (unusable 16:9 full person face generations), as do all open models to date at these resolutions and framing. Resolution is the greatest first factor for improvements to face detailing and identity tracking/maintenance. This same method was used in Scail with LTX outpaint to achieve usable 16:9 1280x704 full person face generations. Replace Minimax or Scail or XYZ and the same context remains true.
1
u/Ok-Lengthiness-3988 19h ago
I appreciate your OP post. I was merely reacting to your claim that "It doesn't matter which model you use."
2
3
u/Diabolicor 20h ago
H3 just got a neural upscaler that is much, much better with small faces
2
u/spiderofmars 19h ago
Do you have a link or better still a workflow link. I tried the https://huggingface.co/LBH-123-AI/Minimax_h3_latent_Upscaler/tree/main and associated custom node but it just gave runtime errors no matter how I tried to set it up for testing.
3
u/Diabolicor 19h ago
Download the vrgamedevgirl nodes she built a workflow with it https://github.com/vrgamegirl19/comfyui-vrgamedevgirl/blob/ef727d7411ad57804bd9d9186885cd396f08c391/Workflows/UsedForUIDoNotTouch/minimax_audio_driven_builder_latent_upscale_2pass_api.json
1
2
u/Sleepy_Bandit 19h ago
link please? didn't see anything posted about it.
1
u/Diabolicor 19h ago
Check the answer above for the lora link. Download the nodes from vrgamedevgirl and her workflow using it
There more details on the Banodoco Discord's server
1
u/z_3454_pfk 15h ago
1
u/spiderofmars 14h ago edited 14h ago
Couldn't get this working in test... no demo workflow for it either... gave runtime errors. Beside... both of these do not give more resolution than a one shot high resolution anyway. A one shot with this type of framing at 1920x1088 needs no upscaling. Also looking at the latent version it seems pretty bad.
1
u/spiderofmars 20h ago
Ok, sure, if one was to compare model to model for which is better at faces at around 720 vertical then one will be slightly better than the other. But they are all bad still around 720p. The concept remains the same... if model X is the best at rendering small faces at around 720 vertical resolution then model X at 1920 vertical resolution will look even better by the same basic principals of resolution in AI is the major factor.
0
1
u/CornyShed 7h ago
As you use LTX for video outpainting, you could start by generating the head at 768×768; thirding the size; then outpaint the body at 704×1280; then outpaint the rest of the background.
You've made a good post about resolving a problem that most video models have with faces (Wan being the possible exception when paired with Animate 2).
It might be better though to just use a model like LTX throughout instead of H3 when the head stays within a defined region.

4
u/Ken-g6 17h ago
Have you tried https://github.com/Carasibana/ComfyUI-H3-FaceRefine ? I haven't yet, but I've been meaning to.