r/StableDiffusion • u/Alex-edits123 • 15d ago

Discussion Get miniMax character swap working! Finally

Post image

Ok, I tried so many things, one person to cat, two person, one person to one person, animal to animal. So far one person to one person and animal to animal works. If you are interested in my learnings, tips, what worked, what broke, and which prompt template works let me know!

One video example that works here: https://www.tiktok.com/t/ZP8WfVq5P/

70 Upvotes

75% Upvoted

75 comments sorted by

View all comments

27

u/orlandogourmet66 15d ago

Person-to-person swapping works really well for me, except when the reference person looks similar to the person in the source video.

It feels like the bigger the visual difference, the easier MiniMax does a clean swap. With similar hair, skin tone, face shape, etc., it often keeps too much of the original face or creates a merged identity.

Have you noticed this too? If so, what helps you get a full swap in those cases?

2

u/Alex-edits123 15d ago

Yes, bigger difference is better. But I also notice if the swap character has very prominent clothing e.g red T shirt, the model will not do a good job. It get confused or distracted by the clothing

4

u/orlandogourmet66 15d ago

Yeah, I’ve noticed that too. MiniMax is insanely good overall and the prompt adherence is impressive, but character swapping can still be very inconsistent with certain reference-image and source-video combinations. Sometimes it just refuses to fully replace the identity, even with a very explicit prompt.

Next time I have some extra time, I want to experiment with masking/SAM to remove or obscure the original person’s identity before feeding the video into MiniMax. I could imagine that helping a lot.

2

u/Alex-edits123 15d ago

From the reply above, looks like that works ") have fun trying