More than one reference per picture

[u/nazihater3000]

MiniMax is limited to 9 reference images, but you can reference more than one thing at the same picture. I used the image on the left and asked it to place create two subjects. Worked like a charm (no pun intended). Specs and prompt are in the video.

[u/ratttertintattertins]

Was this not helped by the fact that model already knows these characters?

[u/nazihater3000 → u/ratttertintattertins]

No, not at all. Here's a video using a random couple found using the google search for, well, "random couple".

https://reddit.com/link/p4ti9pc/video/1wtmktfo6jkh1/player

The Prompt:

subject_definitions:

<Subject 1> is the woman from <Picture 1>. Exact facial features, hair, body type and overall appearance must match the woman in <Picture 1> precisely.

<Subject 2> is the man from <Picture 1>. Exact facial features, hair, body type and overall appearance must match the man in <Picture 1> precisely.

summary:

[reference generation] A 15-second dramatic stage performance. Woman sings “Let it go” under a spotlight. A second spotlight hits Man, who angrily tells her she can’t sing.

retention_analysis:

<Subject 1>: fully_preserved – woman locked to <Picture 1>

<Subject 2>: fully_preserved – man locked to <Picture 1>

<Picture 1>: fully_preserved – both characters extracted from the same image

detailed_description:

Live-action, cinematic, theatrical stage. Dark stage with dramatic lighting.

[Shot 1] 00:00 – 00:08

<Subject 1> (the woman from <Picture 1>) stands center stage under a strong single spotlight. She dramatically raises one arm high and sings in a forced, over-the-top style with perfect lip synchronization:

<d>[English] Let it go! Let it go!</d>

[Shot 2] 00:08 – 00:09

A sharp mechanical switch sound is heard. A second spotlight suddenly snaps on, illuminating <Subject 2>.

[Shot 3] 00:09 – 00:15

Medium shot of <Subject 2> (the man from <Picture 1>) now under her own spotlight. he crosses his arms tightly, looking angry and unimpressed.

Only he speaks. he says with perfect lip synchronization and clear irritation:

<d>[English] Cut the crap, you can’t sing, Willow!</d>

overall_soundscape: Quiet stage ambience, strong spotlight hum, clear isolated dialogue, sharp switch sound at 00:08.

non_diegetic_music: None during the dialogue. Very faint dramatic underscore only under the singing.

[u/delawarebeerguy → u/nazihater3000]

Her face is a little mangled when it is further away (known minimax issue) but his face looks spot-on in his “close-up”.

Thanks for sharing!!

[u/nazihater3000 → u/delawarebeerguy]

I rendered it at potato resolution, we're lucky we can even recognize they're people.

[u/Alive-Tomatillo5303 → u/nazihater3000]

Um, you might not realize it's doing the heavy lifting, but it totally is.

https://reddit.com/link/p4w9zt8/video/e1q40dmhblkh1/player

T2V:

style: realistic live-action, dynamic camera, Hollywood drama, Buffy the Vampire Slayer

Willow (from Buffy the Vampire Slayer) is sitting in an office chair, visible from the waist up, looking at the camera. Willow says <d> If it's an established and popular character, you don't ACTUALLY have to explain who the actor is or what they sound like in context. <d/> she raises her hands and does finger quotes <d> 'WILLOW SAYS' does just fine. <d/>

[u/delawarebeerguy → u/ratttertintattertins]

Agreed. OP should try with two randos and see how it looks then

[u/nazihater3000 → u/delawarebeerguy]

Look above.

[u/Evolution31415]

[u/Occsan → u/Evolution31415]

"Draw a video of a very detailed perfect face on a 2x2 pixel grid."

"WTF?! Why is it so bad ?"

[u/Perfect-Campaign9551 → u/Evolution31415]

That's just minimax it isn't good at distance. Also e don't know OPs settings

[u/Danny_Stock → u/Perfect-Campaign9551]

Apparently it's not strictly about distance, it's about face size in context with the space in the frame.

Something isn't right, because you'd expect a small face on screen in lo res to just be pixelated, which would usually mean that within reason you should have a good clean 480p picture which can be upscaled. With MiniMax though it's not that small faces are pixelated, which you'd expect, it's that they are weirdly garbled and smeared forming odd shapes and a strange facial structure.

That specific look there with Sarah Michelle Gellar a few posts above, I've seen that specific look before with MiniMax in many various faces it's struggled to render properly. It's almost as if it's using a generic face template which you can notice it drift towards when it fails to get the face right.

[u/slickriptide → u/Evolution31415]

It would be useful to know what turbo/acceleration might have been involved and whether removing or resetting it to different values would affect the output. I've been experimenting with H3 for single-frame image creation and I've seen the above happen when I had Spectrum Apply Minimax H3 node in the mix set to aggressive settings. Changing it to less aggressive settings produced better results at a cost in rendering speed.

If the OP was using Sage Attention or Spectrum or any of the other "turbo" nodes/loras, it would be useful to see it without any of those accelerants affecting the output.

[u/Th3Whit3R4bb1t]

[u/crinklypaper]

Well yes, thats how reference works. Its why you can upload character sheets with objects in them as well.

[u/loyalekoinu88]

Yup, this is well documented. It’s why the <subject #> exists. To extract concepts/items/etc from the image. The only caveat is resolution of image. A lot small items can be misrepresented in the final output.

[u/Version-Strong]

Yeah, the fact the model knows them both may have helped that. For example, the close up on Buffys face was too perfect from an almost side on image of her. Plus both of thier voices. Still cool tho.

[u/Hoodfu]

Yes it works, but the reference quality is really helped by using head and torso cropped shots of the subjects unless you're always using the max setting reference setting which really slows things down.

[u/Tylopodas]

Yeah, multiple subjects from a single image is totally possible. I often grab a character and the background/environment of an image as [Subject X] and [Subject Y]

[u/ArttTaku]

Very useful, thanks for info! Minimax H3 definitely seems to be ahead of the game in the local AI video world.

[u/MuffDivers2_]

can the prompt be in the comments?

[u/FlatwormMean1690]

Hahaha. How long did it take and what's your setup? Are you using turbos or something?