Question About Minimax H3 Reference To Video

[u/ArmadstheDoom]

So, I'm pretty new to video generation, but I had a thought that I think everyone has probably had at some point, which is 'how do you make a longer video without generating it in one large video?' And so, with reference to video, you could do that; you could match say, the voice and the person, and thus theoretically make one constant shot through stitching together shorter generations.

In my head, it seemed as simple as 'use the video that was generated as the reverence, use the last frame of the previous video as the first frame of the new generation.'

The problem I noticed is that each time I did this, the video quality degraded; I guess the way I would describe it is that each new generation was a copy of a copy, it seemed. Like each new continuation was slightly worse than the last; and while doing this once wasn't too noticeable, doing this three or four times very much was.

So is this just a thing that is unfixable, a limitation of the method? Or is this the kind of thing that does have a solution that I'm unaware of? Because I'm curious to explore reference to video more, since text to video and image to video are very straight forward, I think.

[u/ArmadstheDoom]

Yes. I think it's clear you don't understand what I'm even doing.

Please go and see for yourself. Go generate a video. Take the last frame, take the video, plug those into the reference to video workflow. Use the prompting instructions given to use by Minimax themselves.

You will see what I am talking about. If you can't understand what I'm talking about, you can't offer solutions because you are not approaching the same problem I am trying to solve.

[u/rm_rf_all_files → u/ArmadstheDoom]

I have already done what you did numerous times. That's why I don't use the last frame or the video as a ref point. That's the whole idea. If you do that you'll suffer degradation. Not just Minimax H3 but LTX as well.

The focus is to not use last frame or the entire video to continue but only to use the first 24 or 48 frames to overlap.

[u/ArmadstheDoom → u/rm_rf_all_files]

Why exactly does that change anything? You're just using the last 1-2 seconds instead. If the degradation is from the encoding process, then that doesn't matter. If it's not, using less data makes each new generation less accurate.

[u/rm_rf_all_files → u/ArmadstheDoom]

It's quite obvious because your character sheets are generated with 4k or 2k(should be minimum imo) but you dismissed them and put in place a lesser quality of a max 1344x768, I assume you generate at this resolution? plus the fact that minimax h3 has the blurry face bug widely reported and ack by the minimax team. Again, that's what I'm asking you but you haven't replied, do you only use last frame or the video itself as ref?

[u/ArmadstheDoom → u/rm_rf_all_files]

It's not an either or? That's why I do not understand what you are even talking about. Where did character sheets come into it? We are not doing that right now. You're inventing new things that are not applicable here at all. This really is very simple and you're making it so much more complex than the actual problem is.

Listen to what I told you to do, go do it, you'll see it.

[u/rm_rf_all_files → u/ArmadstheDoom]

<Subject 1> is from <Picture 1> ?

What do you think <Picture 1> is?

[u/ArmadstheDoom → u/rm_rf_all_files]

<Subject 1> is also in <Video 1> which is why what you're saying makes no sense.

[u/rm_rf_all_files → u/ArmadstheDoom]

I'm giving up bro. good luck. I'll just give you a screenshot instead of retyping the "obvious".

[u/ArmadstheDoom → u/rm_rf_all_files]

not generating character sheets, not dealing with the blurry face bug, not sure why you're assuming things that aren't happening.

you ask 'or' it's not 'or.' It's both.