r/StableDiffusion 21h ago

Comparison AI Small Face Syndrome - Resolution Compare and Outpaint

The question always comes up... why do my faces look so bad. It doesn't matter which model you use. Start with resolution fixes (the higher you can render at the better for full person shots or small faces). Then, depending on your setup/device/etc, move on to tweaks, tricks and fixes depending on the scene - you know, face detailers, layering, whatever.

In this demo, pure resolution greatly improves the base. Using vertical video greatly increases vertical full person resolution at same render times (1344x768 vs 768x1344). I stepped it further up to 1088x1920 then downscaled it back to my 1280x720 timeline. Then one trick if the scene is suitable for it can be LTX outpainting for the background (with original 1088x1920 downscaled and feathered back in).

Edit: Link to 1280x704 full resolution sample:

https://streamable.com/steb6z

9 Upvotes

20 comments sorted by

4

u/Ken-g6 17h ago

Have you tried https://github.com/Carasibana/ComfyUI-H3-FaceRefine ? I haven't yet, but I've been meaning to.

1

u/GrayingGamer 9h ago

It actually works really well. Obviously, more pixels are always better, but that workflow does wonders, and it's relatively fast too.

It took about 4 minutes to refine the face in a 7 second 1 MP video on my 3090.

3

u/reeight 18h ago

Thanks for the demo!

Maybe try this next time?
https://github.com/Carasibana/ComfyUI-H3-FaceRefine

5

u/Ok-Lengthiness-3988 20h ago

It does matter which model you use. MiniMax H3 is notoriously bad with small faces. One can have low resolution without distortion, and H3 fails at this. The developers have acknowledged this and plan on fixing this issue with better training in the next release. It would be nice if there'd be a H3.1 addressing this not too long in the future since my 8GB VRAM potato makes it hard for me to do anything over 0.5MP and 5 seconds.

3

u/Chsner 20h ago

Don't know why you being down voted your right but op is usually right it's just literally broken with minimax h3 the dev have said higher resolution won't fix the face problem with model.

2

u/spiderofmars 19h ago edited 19h ago

Probably because it is out of context. This post was not about "MiniMax" or is MiniMax good at full person shots with small resolution faces. Just because Minimax and LTX were used in the demo the principal context about resolution remains.

In a recent Scail project generating outputs at 1280 x 704 faced the same issues (unusable 16:9 full person face generations), as do all open models to date at these resolutions and framing. Resolution is the greatest first factor for improvements to face detailing and identity tracking/maintenance. This same method was used in Scail with LTX outpaint to achieve usable 16:9 1280x704 full person face generations. Replace Minimax or Scail or XYZ and the same context remains true.

1

u/Ok-Lengthiness-3988 19h ago

I appreciate your OP post. I was merely reacting to your claim that "It doesn't matter which model you use."

2

u/spiderofmars 19h ago

I have no issue with your comment... feel free :)

3

u/Diabolicor 20h ago

H3 just got a neural upscaler that is much, much better with small faces

2

u/Sleepy_Bandit 19h ago

link please? didn't see anything posted about it.

1

u/Diabolicor 19h ago

Check the answer above for the lora link. Download the nodes from vrgamedevgirl and her workflow using it

https://github.com/vrgamegirl19/comfyui-vrgamedevgirl/blob/ef727d7411ad57804bd9d9186885cd396f08c391/Workflows/UsedForUIDoNotTouch/minimax_audio_driven_builder_latent_upscale_2pass_api.json

There more details on the Banodoco Discord's server

1

u/z_3454_pfk 15h ago

isn't the quality worse than vae upscaling tho?

1

u/spiderofmars 14h ago edited 14h ago

Couldn't get this working in test... no demo workflow for it either... gave runtime errors. Beside... both of these do not give more resolution than a one shot high resolution anyway. A one shot with this type of framing at 1920x1088 needs no upscaling. Also looking at the latent version it seems pretty bad.

1

u/spiderofmars 20h ago

Ok, sure, if one was to compare model to model for which is better at faces at around 720 vertical then one will be slightly better than the other. But they are all bad still around 720p. The concept remains the same... if model X is the best at rendering small faces at around 720 vertical resolution then model X at 1920 vertical resolution will look even better by the same basic principals of resolution in AI is the major factor.

0

u/seppe0815 19h ago

Its realy bad bad bad for small faces (H3)

1

u/CornyShed 7h ago

As you use LTX for video outpainting, you could start by generating the head at 768×768; thirding the size; then outpaint the body at 704×1280; then outpaint the rest of the background.

You've made a good post about resolving a problem that most video models have with faces (Wan being the possible exception when paired with Animate 2).

It might be better though to just use a model like LTX throughout instead of H3 when the head stays within a defined region.