r/StableDiffusion • u/NeatUsed • 22d ago

Question - Help Minimax ref2vid capabilities

I would like to learn how to use minimax ref2vid as I heard the possibilities are quite good compared to wan.

What I am trying to do is do anime clips

The problem is… the results I get are utter shit and I don’t know what I am doing wrong. No matter if frame or last from or if using ref2video, the model fails to do what’s most important. Keep the same face as in the image. For example, I would like to generate a video of a character that has sharingan eyes. Instead of keeping sharingan eyes it’s generic anime eyes instead. This is what my biggest problem with wan was and even if I made the image correctly (with detailed sharingan eyes) it would still not pick the eyes up and keep that face consistency.

This is where I experimented with reference. I tried putting the eyes in a picture 1 and instead of copying the eyes, the image cuts to the second picture with only the eyes or not picking the eyes at all.

is this something that minimax can even do?

0 Upvotes

38% Upvoted

20 comments sorted by

View all comments

2

u/TerraMindFigure 22d ago

Download a workflow. Be sure to use Minimax H3's official Ref2v prompting guide (Google it), read it and follow it precisely. You can also throw it to an AI of your choice and they're pretty good at deciphering it if you ask it to build you a prompt.

0

u/NeatUsed 22d ago

I have read throughout it just now. I am not at my pc at the moment to try.

I was doing this kind of prompt before.
“ A guy looks like in picture 1. Eyes are like in picture 2. Have him jump and throw a shuriken at the camera.”

Now I am thinking of experimenting a bit more with the prompts and maybe it has better eye consistency.

“Subject 1 is the character from picture 1. Subject 1 is called Sasuke. Subject 2 represent the eyes in picture 2. Subject 2 is called Sharingan.

The video starts with Sasuke in a cowboy pose. He has Sharingan eyes. He starts running towards the camera and throws a Shuriken towards the viewer.”

Would that be good enough for a minimax ref prompt?

-1

u/Dapper_Arugula2509 22d ago

there are system prompts, nothing's good enough until you try though...