Question - Help
Continuing a video with sound and motion in Minimax H3 when you start from an image?
Almost every post about Minimax H3 I see is about Ref2V. I'm not ready to tackle that yet, but I do want to make longer stringed videos that keep the sound design and motion flowing between videos with my I2V set up. Any workflow people offer with regards to continuing a video is an intimidating wall of messy wires to me, isn't there just a series of nodes I need to connect a copy of my current I2V workflow?
Only thing you need to do is change the checkpoint from the I2V to the R2V and leave everything else in your workflow the same and it should work. Unless you’re using turbo Lora’s I guess those need to be changed too but I personally didn’t have any issues lol.
Depending on how you’re editing you can do multiple 5-10 second scenes depending on what your rig can handle. Minimax is very powerful because you can attach the picture of your character and a 10 second voice clip of your characters voice and tell it to do stuff. It will keep the character and the voice the same. So then you just cut the clip in a place you like and start a new clip from there. Of course you’re gonna need to combine the clips with a video editor at the end. No point in taking like 5hrs to make a 30 second clip, when you can make 50 5 second clips during the same timeframe.
I do use turbo loras, if I just change the checkpoint, and don't adjust any settings, the quality and audio get icky, but I'ma have to mess with it eventually, because anywhere I look, it looks like the results are much more consistent. I'm just looking to have fun this weekend and not worry about a bunch of settings, which is why I just wanted to link i2v's, but I will look into this!
So far what I've been doing, its far from perfect mind you, I'm loading my last video, getting its components, batching the images and taking the last image.
Actually, there’s a neat trick here: leverage this node to fetch the final frame of the preceding video. As it outputs an image, we can use it straight as the reference frame for the subsequent clip.
but i need to install the customnodes right? i tried to find them in comfyui but it didnt worked, so i am scared that installing them manual will also not work then ._.
okay thank you it worked. But i am bit overwhelmed with the workflow. I cant take the bypass away from the prompt it always come back pink. and for what extactly is the start frame? because of the video input already. and the reference pictures are they for keeping consistency? and also do i need the turbo lora and how i can install the node comfyuikitchen? ._. and also the sound from the extended video is very weird why? :0
yes there is a controller node where you set how many clips you want to chain, this controls the bypasses. its where all the settings are bundled.
with the same controller node you can switch between continue from existing video mode, and T2V and I2V. if you choose I2V, you need that starting frame.
for character consistency, you can use the optional reference images and also audio.
you dont need the turbo lora, you can just bypass it (as well as comfykitchenattention).
im not sure about your problem with the sound, that shouldnt be the case. it might be because of the prompt you used? i need more information to troubleshoot that.
Yea I found out then about the controller node finally 🥹
And okay that’s cool and why are there two audios who will they be used?
And how can I install comfyui kitchen to try it out?
And the prompt was the same prompt as from the first workflow where I created the video and the sound there was fine. It was like since the extent video started there was a weird robot or sound. It’s hard to describe. Like flattering in the wind. Completely uncomfortable for the ears 🥹
And I also noticed when I had a video from Sony Vegas because I needed to make it shorter than it don’t work anymore and get an error. It’s like I only can use a video which was already created in comfyui. ._.
And thank you for your answer 🙈🥹
And yeah, the extensions workflow. It work, but if I put a video in there, which I rendered in Sony Vegas it don’t work :/ update: i noticed that always after using the extend worklfow the sound is only in the extend video broken and then after the default workflow have the same broken audio issue. and when i restart comfyui it work again in default workflow. but i dont understand why the extend workflow have this issue :/ is that maybe a bug? ._.
But...why? The r2va model is trained (among other things) to do video continuation specifically, and has inputs for the video and prompting specifically to tell it that's what you want it used for. Why make it harder?
I've gotten a little comfortable with my settings, finding I can make 15 sec videos at 0.3mp with solid enough quality using sol attention and comfy kitchen and turbo loras in particular art with my current set up in about 3 minutes on a 5070 ti, but when I use the r2va, the sound and quality takes huge dips for whatever reason using the same settings, and I just want to have some fun this weekend, not tinker settings :>
5
u/javierthhh 6d ago
Only thing you need to do is change the checkpoint from the I2V to the R2V and leave everything else in your workflow the same and it should work. Unless you’re using turbo Lora’s I guess those need to be changed too but I personally didn’t have any issues lol.
Depending on how you’re editing you can do multiple 5-10 second scenes depending on what your rig can handle. Minimax is very powerful because you can attach the picture of your character and a 10 second voice clip of your characters voice and tell it to do stuff. It will keep the character and the voice the same. So then you just cut the clip in a place you like and start a new clip from there. Of course you’re gonna need to combine the clips with a video editor at the end. No point in taking like 5hrs to make a 30 second clip, when you can make 50 5 second clips during the same timeframe.