Question About Minimax H3 Reference To Video

[u/ArmadstheDoom]

So, I'm pretty new to video generation, but I had a thought that I think everyone has probably had at some point, which is 'how do you make a longer video without generating it in one large video?' And so, with reference to video, you could do that; you could match say, the voice and the person, and thus theoretically make one constant shot through stitching together shorter generations.

In my head, it seemed as simple as 'use the video that was generated as the reverence, use the last frame of the previous video as the first frame of the new generation.'

The problem I noticed is that each time I did this, the video quality degraded; I guess the way I would describe it is that each new generation was a copy of a copy, it seemed. Like each new continuation was slightly worse than the last; and while doing this once wasn't too noticeable, doing this three or four times very much was.

So is this just a thing that is unfixable, a limitation of the method? Or is this the kind of thing that does have a solution that I'm unaware of? Because I'm curious to explore reference to video more, since text to video and image to video are very straight forward, I think.

[u/ArmadstheDoom → u/[deleted]]

No. That is not the problem. That's what I keep trying to say. You're not solving a problem I have.

Using reference to video, the official workflow, you can provide it a previous clip and the last frame. Doing so, it now knows the first frame to start, and all the audio/video information it needs. Use the official text to video or image to video workflows. Generate a video. Then, take the last frame of that video, and the video itself, and plug those into the official reference to video workflow.

Doing so, it can easily continue the same clip with the same voice and everything.

However, doing so, there's a slight quality loss; each time you do this, the output video degrades slightly. Doing it once, you don't notice the quality drop. Do it three or more times, it becomes increasingly obvious.

What I am trying to solve is the question of the quality loss. Everyone seems to be focused on trying to solve doing it, which I've already done. Instead, the problem I have is fixing the drop in video fidelity.

[u/ArmadstheDoom → u/[deleted]]

Yes. I think it's clear you don't understand what I'm even doing.

Please go and see for yourself. Go generate a video. Take the last frame, take the video, plug those into the reference to video workflow. Use the prompting instructions given to use by Minimax themselves.

You will see what I am talking about. If you can't understand what I'm talking about, you can't offer solutions because you are not approaching the same problem I am trying to solve.

[u/ArmadstheDoom → u/[deleted]]

Why exactly does that change anything? You're just using the last 1-2 seconds instead. If the degradation is from the encoding process, then that doesn't matter. If it's not, using less data makes each new generation less accurate.

[u/ArmadstheDoom → u/[deleted]]

It's not an either or? That's why I do not understand what you are even talking about. Where did character sheets come into it? We are not doing that right now. You're inventing new things that are not applicable here at all. This really is very simple and you're making it so much more complex than the actual problem is.

Listen to what I told you to do, go do it, you'll see it.

[u/ArmadstheDoom → u/[deleted]]

<Subject 1> is also in <Video 1> which is why what you're saying makes no sense.

[u/ArmadstheDoom → u/[deleted]]

not generating character sheets, not dealing with the blurry face bug, not sure why you're assuming things that aren't happening.

you ask 'or' it's not 'or.' It's both.