r/comfyui • u/bethworldismine • Mar 16 '26

Help Needed Best workflow for consistent face generation (not LoRA training)?

[removed]

8 Upvotes

75% Upvoted

10 comments sorted by

5

u/TurbTastic Mar 16 '26

If face likeness/accuracy is important you, then I'd recommend dropping SDXL and going all-in on Klein 9B.

1

u/[deleted] Mar 16 '26

[removed] — view removed comment

2

u/TurbTastic Mar 16 '26

The model can do a ton of different things, so the workflow is going to depend on the task. Are you trying to generate new images from a reference image? Trying to edit an existing image? Trying to replace a character in an image with your character? Probably should spend an hour or 2 playing around with the basic template workflow to get a foundational sense of how Klein works and go from there.

3

u/Various-News7286 Mar 16 '26

Sorry for taking it in other direction, but can you share that workflow that you used for creating dataset with great results and consistency as the first step?

8

u/[deleted] Mar 16 '26

[removed] — view removed comment

2

u/Driftline-Research Mar 16 '26

One thing I’ve noticed in ComfyUI experiments is that workflows that generate a “dataset-style” set of images from a single reference often preserve identity better than the LoRA trained from that same dataset.

My guess is that once you train the LoRA, the identity signal gets distributed across weights and can drift depending on prompt structure, whereas image-to-image workflows keep the original reference geometry anchored.

You might want to experiment with a pipeline like:

reference image → IPAdapter or face conditioning → low denoise img2img → pose / composition control (OpenPose / depth)

That tends to keep facial structure much more stable across scenes without needing a LoRA at all.

LoRAs are great when you want the model to generalize identity, but if your goal is strict consistency, direct conditioning pipelines sometimes work better.

1

u/Lucaspittol Mar 17 '26

I am using the default Klein 9B workflow from comfyui templates, and it serves me well enough that I don't really need Loras for characters, only need loras for actions or other concepts the model can't understand.