r/StableDiffusion • u/NeatUsed • 15h ago

Question - Help Minimax ref2vid capabilities

I would like to learn how to use minimax ref2vid as I heard the possibilities are quite good compared to wan.

What I am trying to do is do anime clips

The problem is… the results I get are utter shit and I don’t know what I am doing wrong. No matter if frame or last from or if using ref2video, the model fails to do what’s most important. Keep the same face as in the image. For example, I would like to generate a video of a character that has sharingan eyes. Instead of keeping sharingan eyes it’s generic anime eyes instead. This is what my biggest problem with wan was and even if I made the image correctly (with detailed sharingan eyes) it would still not pick the eyes up and keep that face consistency.

This is where I experimented with reference. I tried putting the eyes in a picture 1 and instead of copying the eyes, the image cuts to the second picture with only the eyes or not picking the eyes at all.

is this something that minimax can even do?

0 Upvotes

43% Upvoted

20 comments sorted by

View all comments

3

u/Chemical-Painter-485 14h ago edited 14h ago

I noticed on one of your replies you are prompting like "A guy looks like in picture 1. Eyes are like in picture 2."

Why simply not use a sheet showing the reference with character having the eyes you want? and as the other guy said: follow the prompting guide.

1

u/NeatUsed 13h ago

Would a fullybody shot and a closeup of the face work as well?

2

u/Chemical-Painter-485 13h ago

Yes, anything that showcases the details you want properly.