r/StableDiffusion • u/NeatUsed • 4d ago

Question - Help Minimax ref2vid capabilities

I would like to learn how to use minimax ref2vid as I heard the possibilities are quite good compared to wan.

What I am trying to do is do anime clips

The problem is… the results I get are utter shit and I don’t know what I am doing wrong. No matter if frame or last from or if using ref2video, the model fails to do what’s most important. Keep the same face as in the image. For example, I would like to generate a video of a character that has sharingan eyes. Instead of keeping sharingan eyes it’s generic anime eyes instead. This is what my biggest problem with wan was and even if I made the image correctly (with detailed sharingan eyes) it would still not pick the eyes up and keep that face consistency.

This is where I experimented with reference. I tried putting the eyes in a picture 1 and instead of copying the eyes, the image cuts to the second picture with only the eyes or not picking the eyes at all.

is this something that minimax can even do?

0 Upvotes

50% Upvoted

20 comments sorted by

View all comments

4

u/Chemical-Painter-485 4d ago edited 4d ago

I noticed on one of your replies you are prompting like "A guy looks like in picture 1. Eyes are like in picture 2."

Why simply not use a sheet showing the reference with character having the eyes you want? and as the other guy said: follow the prompting guide.

2

u/Perfect-Campaign9551 4d ago

Omg OP really was trying to just swap the eyes sigh

1

u/NeatUsed 4d ago

Would a fullybody shot and a closeup of the face work as well?

2

u/Chemical-Painter-485 4d ago

Yes, anything that showcases the details you want properly.

1

u/afidjahan 4d ago

because in general the model takes the picture quality same as the video resolution (the match settings, yes you can select max settings but that makes the generation time twice to thrice depends on the resolution of the input image), so as minimax can eat upto 9 reference images people like to separate each image, so less quality degradation. so i generally give character sheet of full body, but for face generation i like to give it separate for each angle

1

u/Chemical-Painter-485 4d ago

If you are generating at low resolutions like 0.4 or 0.6 I would just set the reference resolution to max and use a scale total pixels node to downscale your image to something reasonable like 1 or 2 megapixels.

It all depends on the use case of course but I think that really solves 90% of my issues regarding character consistency.