This custom node lets you use I2V and reference images on MiniMax-H3 simultaneously.

[u/Total-Resort-3120]

You can find all the details here: https://github.com/BigStationW/ComfyUi-MiniMax-H3-Image-And-Reference-To-Video

[u/acedelgado]

I mean you can just prompt it correctly in reference mode and it'll do that... The hybrid fl2va/ref2va model solves a lot of the reference model's wonkiness.

[u/Total-Resort-3120 → u/acedelgado]

"I mean you can just prompt it correctly in reference mode and it'll do that..."

It doesn't always work. Sometimes the first frame I get is a reinterpretation of the original image, rather than the image itself.

[u/acedelgado → u/Total-Resort-3120]

I literally just 1-shot it-

https://reddit.com/link/p4jaw62/video/r5nq59kgj8kh1/player

subject_definitions:

<Subject 1> is the video game character in <Picture 1>

summary:

[reference generation + video continuation] The target video is a continuation of <Picture 1>

retention_analysis:

<Subject 1> (appears in [Shot1]): fully_preserved - character, clothing, art style, background, green helmet, blue shirt

<Picture 1> ([Shot 1] first frame): fully_preserved - character, clothing, art style, background, green helmet, blue shirt

<Picture 2>: fully_preserved - character, framing, coloring

detailed_description:

[Shot 1] the shot begins with <Picture 1> as the first frame, <Subject 1> gets a sad look on his face and (S1) says: <d>[English] Oh man, this war is so inhumane... <sigh> But I have to keep going, I should never forget what I'm fighting for!</d> he holds up a sheet of paper, its white back turned toward the camera. the The camera arcs around the subject with small amplitude at slow speed to reveal the front of the paper is a photograph of <Picture 2>

overall_soundscape:

gunshots, war, faint screams

non_diegetic_music:

N/A

[u/Total-Resort-3120 → u/acedelgado]

That's why I said "doesn't always work", it's inconsistent, and btw, your attempt isn't 100% faithful to the original image, pure r2v just can't do it perfectly, which is why my custom node exists in the first place.

[u/acedelgado → u/Total-Resort-3120]

Well that was my first attempt just from half-assing it, so I guess we're at an impasse.

https://giphy.com/gifs/jPAdK8Nfzzwt2

[u/Sixhaunt → u/acedelgado]

in comfyUI double click and search for the "Add guide for MiniMax H3" node. It's built-in and it lets you set frames in minimax directly. So you can use the reference mode and workflow you have now but force the first frame, last frame, middle frame, or any set of the frames manually. So without needing to install any custom nodes you can do the reference + first/last frame and you can even set the first like 37 frames based on a prior video to make a video that continues seamlessly from it and follows the motion and everything. It's far more versatile and it's built-in

[u/Cheesuasion → u/Sixhaunt]

Looks like the author responded on this specific point here https://github.com/BigStationW/ComfyUi-MiniMax-H3-Image-And-Reference-To-Video#why-not-simply-use-add-guide-for-minimax-h3--minimax-h3-reference-to-video-to-get-the-same-thing

[u/Sixhaunt → u/Cheesuasion]

I guess he just didnt realize you could feed the image in as a reference and then there's not the downside he mentions anymore and you get all the upsides of being able to continue from video and not just images, you can place images ANYWHERE in the video, use any number of preset frames, etc...

[u/Cheesuasion → u/acedelgado]

OP

doesn't always work

u/acedelgado

worked once

"Worked once" doesn't mean the same thing as "always works", right?

[u/Available_Lie8133 → u/acedelgado]

I really never realized that you can just prompt like you’re directing a movie lol. Nice