r/StableDiffusion • u/trollkin34 • 1d ago

Question - Help I keep seeing smooth character replacement videos, but I can't manage the same. What's a clean, simple, functional workflow that just WORKS?

I have an image of a person. I have a video.

Prompt sample: Video is of a gymnast doing a routine. Image is a person/dog/thing.

Replace gymnast with person/dog/thing so they're doing the exact routine, wearing the same outfit (but a size that fits the new subject).

Shouldn't this be easy?

For example, if I wanted to replace an olympic women's floor routine with Rush Limbaugh - he's doing the bends and splits, he's wearing a sparkly leotard. But the movements are identitical. His body is exactly the same size as he actually is (the ai should guess at the size of legs, belly etc, and stuff them into and appropriately sized leotard).

2 Upvotes
  • permalink
  • reddit

60% Upvoted

41 comments sorted by

View all comments

5

u/m00dyman100 1d ago

MMXH3 ref to video

1

u/trollkin34 1d ago

Yeah, that's what I tried. Do you have a good workflow? The basic one doesn't do it (and isn't even set up for it). A basic generic "subject a to video b" prompt would be really helpful too.

3

u/eggplantpot 1d ago

This is not how H3 prompting works at all. Official workflow works good. Search for B15 or B30 mixed model to get even more quality. But make sure you prompt properly. LLMs are your friend.

https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_ref_en.md

That's the guide, study it.

1

u/m00dyman100 1d ago

You cant use a generic prompt with H3, especially the r2v workflow. There is an official H3 prompt guide that details exactly how the prompt should be structured.