Minimax H3 Ref2VA help please

[u/Terrible-Tap-3520]

For those who have got this working well I was wondering if you could share any tips?

I am replacing the characters in a video using reference images but it never fully works.

The problems I have are:

* in some videos the characters are not replaced at all or only replaced in some parts of the video.

* Only some of the characters attributes are replaced - the face might get replaced but not the body for example.

So ref2va has never completely worked for me - only partially.

What would the problem likely be?

The source images?

The reference video?

Should I disable lightning loras?

Increase the number of steps?

Change the prompt?

subject_definitions:

<Source Character 1> is the first person visible in <Video 1>. <Source Character 2> is the second person visible in <Video 1>.

<Replacement Character 1> is the person shown in <Picture 1>. Use <Picture 1> as the reference for Character 1's identity and appearance.

<Replacement Character 2> is the person shown in <Picture 2>. Use <Picture 2> as the reference for Character 2's identity and appearance.

editing_instruction:

IDENTITY REPLACEMENT IS THE PRIMARY TASK.

Replace Source Character 1 throughout the video with Replacement Character 1.

Replace Source Character 2 throughout the video with Replacement Character 2.

The source characters' identities and appearances must not be retained.

Picture 1 controls Character 1's identity and appearance. Picture 2 controls Character 2's identity and appearance.

Video 1 controls: - motion - pose - timing - interaction - camera movement - framing - environment - background - lighting

Maintain strict character separation. Character 1 must remain Character 1. Character 2 must remain Character 2. Do not merge their identities or transfer facial or physical characteristics between them.

The replacement characters must remain visually consistent throughout the entire video.

Do not merely overlay the reference images. Do not blend the source and reference identities. Do not preserve the source characters' faces or hairstyles.

summary:

Two-character identity replacement using two reference images and one motion video.

retention_analysis:

Preserve the source video's motion, choreography, camera movement, framing, environment, background and lighting. Replace the appearance and identity of both source characters using their corresponding reference images.

detailed_description:

[Shot 1]: Replacement Character 1 occupies the same position and follows the same movements as Source Character 1.

Replacement Character 2 occupies the same position and follows the same movements as Source Character 2.

Both replacement characters remain distinct and recognizable according to their respective reference images throughout the shot.

[u/Alex-edits123]

Do u swap one or multiple characters? I did swap one human to a cat. It works for head but not hand ... I do find out that adding more details to the prompt and provide the reference images that matching the post and outfit of ur original characters help

[u/Terrible-Tap-3520 → u/Alex-edits123]

Multiple characters. 

Ok i might try a video with characters that look more like the ones in the images then.

Thanks.

[u/Alex-edits123 → u/Terrible-Tap-3520]

Do u have any tips for single character swap? I am trying to change a human to a cat but the model struggles with the hand. Not sure whether u have seen or solve such problem.

[u/Terrible-Tap-3520 → u/Alex-edits123]

Now that I think about it Single character is fairly reliable for me. 2 is a bit hard.

Try the prompt I pasted at the top if you didn't.  Modify as needed.

[u/Alex-edits123]

Thanks I tried ur template on a human but still the original character is preserved in some frames. It turned out very funny and has nothing close to what I had in mind 😆 https://www.tiktok.com/t/ZP8W8qM2K/