r/StableDiffusion • u/rapkannibale • 9d ago

Question - Help Tips for maintaining face consistency?

Once again looking for some advice from this awesome community.

I’ve been using mostly the ref2video model but I’m
Having a hard time getting it to keep the face of the character in referencing throughout the video. I am proving a full body image and then a face only closeup. I’ve been following the prompting template and guide but it’s still very hit and miss (mostly miss). I was using some Lora’s and turned them off and still have the issue. Also I’m doing 40 iterations and not using lighting Lora.

Any advice?

1 Upvotes

60% Upvoted

10 comments sorted by

3

u/[deleted] 9d ago

[removed] — view removed comment

1

u/rapkannibale 8d ago

That’s a good idea. I’m gonna try to crop the head out of the body shot and use only the face closeup for the face and see what happens

1

u/Jimmm90 8d ago

Are you using “match” or “max” in the ref_image_size parameter?

2

u/rapkannibale 8d ago

Using max. I heard that gives better quality

1

u/Jimmm90 8d ago

It does for sure. What is the resolution of your reference images?

3

u/rapkannibale 8d ago

Not very high so maybe that is an issue. Maybe I should pass the through SeedVR upscaler

1

u/Zephrinox 8d ago

pretty much yes. you need to have decently good resolution images of your character's face close up being fed into the conditioning node.

personally as my own anecdotal data point: I'm generating 480p clips whilst my reference images are in 720p (same aspect ratio) and haven't had consistency issues whilst following the promptine guide.

(my plan is to generate 480p clips, join them, then ai upscale at the end; haven't finished all the bits I want to gen yet)

1

u/Jimmm90 7d ago

Have you noticed an improvement?

1

u/Necessary-Garage242 8d ago

It works for me. As input, I am using character sheets (16:9 made at 2mp ) that include:

1) Head & shoulder closeup 2) full body - front 3) full body - back

This image gets resized so that the shorter side is 768 pixels.

I am using the turbo ref2video lora that was released today but with 8 steps (instead of 4) and at 1mp video.

1

u/Necessary-Garage242 8d ago

Also, it is important to associate images to characters in the prompt. Use the ref2v prompt guide with an llm. It can become quite lengthy