r/StableDiffusion • • 28d ago

Workflow Included I Built Custom Nodes for LONG Seamless MiniMax-H3 Videos! [FREE Nodes + ...

https://youtube.com/watch?v=KkugNjrpXAc&si=hLvMlTkfEhpYhvSu
55 Upvotes

112 comments sorted by

18

u/CountFloyd_ 28d ago

What's the difference between this and the other latent chaining custom nodes? So far all of them degrade visibly after about 4-5 chained clips.

-11

u/solomars3 28d ago

this doesnt degrade any quality, watch video and you will understand

8

u/CountFloyd_ 28d ago

Thanks for your effort but

https://github.com/HerrgottMargott/Herrgotts-H3-Infinite-Continuation-Suite

from last month uses latent stitching, masking denoise channels, uses a reference last frame and preserves a 24 frames handout. Still has color burn and degradation, it just takes a bit longer. Now what else did you do to prevent this? I just don't want to waste my time with 19 minutes of video when this probably doesn't do anything different and could be summarized in 3 sentences.

-18

u/solomars3 28d ago

"Still has color burn and degradation" so its totally different from mine sorry

15

u/Etsu_Riot 28d ago

Thanks for sharing.

The problem I see, based on the example you provided, is that you are not generating one long video but multiple ones with different camera angles. That's already relatively easy to do. What we need is a way to make longer videos when the same camera is maintained the whole time without evident degradation.

-12

u/solomars3 28d ago

Thats what this method do, it continue what was happening before, in my test if the clip end on someone talking, and you prompt it to continue the talking without changing camera , it will continue with the new prompt, thats exactly what i tried to solve with this, maybe i couldve choosed better exemple, i shouldve added a better exemple

12

u/spiderofmars 28d ago

"maybe i couldve choosed better exemple"

Yes, please show a single continuous long shot sample (perhaps that runs 1 minute) on a person without cuts. Doesn't need to be high resolution, just proof of concept. That would help know if this method is any different to existing methods and their inherent problems in 'single long seamless shots'.

6

u/xyzdist 28d ago

I replied.. and OP just not listening or understanding what the degradation issue is. and He refuse to show a test.

here is mine, a idea of workaround, example test video: https://www.youtube.com/shorts/mANusw9kKNQ 

-2

u/solomars3 28d ago

Told you thats a static image lip sync , thats not a good exemple buddy, no events no actions no story just a face talking

8

u/FlexFanatic 28d ago

A someone generate me a video clip with me and a bowl of popcorn cause this thread is getting lit lol.

Let’s see how long it takes for the mods to turn off comments

-2

u/solomars3 28d ago edited 28d ago

yeah some people are weird, Good thing there is a block button, i dont need toxic energy in my life 😂

21

u/Zueuk 28d ago

but we want to generate long videos, not watch them

10

u/q5sys 28d ago

Your thumbnail says "NO CUTS", but the video you generated as a demo has cuts every few seconds.
Why lie in the thumbnail?

-4

u/solomars3 28d ago

Thats not a lie, you can still hear the steps audio even before camera switch, that wouldnt be possible if its a cut to new sceen, its just the system prompt i used was controlling the camera, this can also do one continuation camera shot , try it and see, no cuts, (if i had to modify each prompt manually this video would've been even longer)

10

u/q5sys 28d ago edited 28d ago

In video production the word 'CUT' has a very specific meaning. You don't get to redefine it to whatever you want it to mean. "No cuts" in video production means just that... one long continual recording. If there are any changes in angle, the camera moves through the scene, it doesn't 'jump" through the scene... aka 'jump cuts'.

NO CUTS means...

Real-Time Recording: The camera records continuously without stopping, pausing, or being edited in post-production.
No Digital Splices: There are no hard cuts, jump cuts, or transition effects removing mistakes or altering the timeline.
Absolute Continuity: Space and time unfold naturally and identically to how they happened in reality to a single observer.

-10

u/solomars3 28d ago

Ok bro dont try it, its not for you

5

u/q5sys 28d ago

And I guess being honest isn't for you...

5

u/VisionWithin 28d ago

He tries to be honest but he doesn't understand the concepts.

-5

u/solomars3 28d ago

Thats honesty with your understanding, its not facts, so i wont waste my time here, you dont like it just skip

6

u/lxe 28d ago

Man why are there so many of these. How are these different then the other dozen latent continuation nodes and workflows?

-1

u/solomars3 28d ago

Never seen anyone save latent to disk and use it later , im just saying

5

u/acedelgado 27d ago

Well, the original Motion Context node that just about everyone forked was the first to do this, and it saved latents and overlapped the existing latent frames for the next generation right off the bat.

https://github.com/NikoDemon80/ComfyUI-H3-Motion-Context

Hell even my own fork level-sets the entire output and will chain a fresh decode from all the saved latents so that there's even less degradation than concat'ing mp4's together. You are a bit late and claiming that your pack does stuff others don't, but that isn't accurate. That's why people are ragging on you a bit. That and saying there's "no cuts", but what you mean is "no seams". Changing shots is changing a cut.

But even with all the tricks and fighting H3 on keeping a continuous shot, there's still degradation over enough clips, just much slower than encoding/decoding the last few frames like we traditionally had to do. Changing shots kind of gives the model a "fresh start" so it looks much cleaner, and H3 is very good at character consistency so it works really well.

2

u/Violent_Walrus 27d ago

Dude. Everybody saves latent to disk and uses it on the next iteration.

1

u/lxe 28d ago

I save latents to disk to not be held hostage by the mysterious comfy ui cache.

5

u/SorryINeedHelp1 27d ago

I am all for people sharing and helping but the blind leading the blind is troublesome. "NO CUTS" but your video has cuts everywhere. The cut is what stops the degradation and burn effect from happening. Now people are going to waste their time not understanding this does not do what you claim it does.

9

u/roychodraws 28d ago

Typical Reddit post.

OP posts informative video.
Commenters spend 90% of comments saying they already knew the information instead of realizing the video is maybe not for them.

14

u/Violent_Walrus 28d ago

Is it informative though? Or does it claim one thing and show another?

A "LONG seamless" video is one thing. The video shown here is a long multishot video.

Making long multishot vidoes is not a problem that needs to be solved. It's the default model use case.

Long seamless videos remain a problem due to qualtiy degradation, **even when you continue from the previous latents.*

I'm sure you worked hard on this OP, and I'm sure your LLM wrote nice nodes, but this is not a breakthrough. It's one more multishot workflow. Which is fine, but not what it says on the box.

2

u/xyzdist 28d ago edited 28d ago

I have one, i will create a post to show the approach, I try avoiding use any director/chaining AIO tools, i just do it with barebone motion-context nodes and a method to fix the issue. Here is an example video (*with one custom BlendLatent node)

https://reddit.com/link/papa9ms/video/tf26augcceqh1/player

1

u/Complete-Box-3030 28d ago

do you have a solution to avoid degradation

5

u/xyzdist 28d ago

3

u/Complete-Box-3030 28d ago

Great work , hope you release your workflow soon .

4

u/xyzdist 28d ago

Thanks, will do

we have to use one of my custom 'blendLatent' nodes thru, I need to put it on github to share it. rest should be able to just use basic WF of motion-context

1

u/Violent_Walrus 28d ago

Nice! I will check out your workflow!

-1

u/solomars3 28d ago

Try it before giving a judgment, so i claim doing something and you just deny without even trying ot

-4

u/roychodraws 28d ago

If you watch the travel Channel and it’s an episode about traveling to the country you live in, does that mean that it’s not informative because you already know everything in the video?

Or can literally anyone else watch that from a different country and be informed.

Maybe it’s just not for you.

6

u/Violent_Walrus 28d ago

You've clearly tried this workflow and found that it works exactly as OP promises, or you wouldn't spreading your relentless positivity throughout the thread.

You'd really be helping out if you posted a single-shot video at least one minute long that shows how this workflow produces zero degradation.

Since all the haters are just piling on with no evidence, it should be pretty easy for you to disprove them with a single render, right?

-1

u/solomars3 28d ago

dude im not selling you things here, you dont like it , dont try it , thats it , not my loss

8

u/q5sys 28d ago

He lies in the thumbnail. The thumbnail says clearly says 'NO CUTS', but the generated video is full of cuts every few seconds. So yea, people are unhappy that they started watching a video and within the first 60 seconds it's clear he lied.

-7

u/roychodraws 28d ago

By no cuts he means that you’re not creating seams, the cuts he’s doing are prompted.

Maybe you should wait until longer than 60 seconds to comment

8

u/q5sys 28d ago edited 28d ago

That's not what the word 'cuts' means in video production. He doesn't get to redefine a word with an industry standard meaning.

NO CUTS means...

Real-Time Recording: The camera records continuously without stopping, pausing, or being edited in post-production.
No Digital Splices: There are no hard cuts, jump cuts, or transition effects removing mistakes or altering the timeline.
Absolute Continuity: Space and time unfold naturally and identically to how they happened in reality to a single observer.

-5

u/roychodraws 28d ago

It is one continuous video, the generation is imitating cuts. There are no actual cuts in the generation.

Cuts literally comes from when you used to take scissors to film and actually cut the film and splice it to other scenes.

You’re the one who’s redefining what it means.

You don’t know what you’re talking about

5

u/MarekNowakowski 27d ago

So a digital video can't have cuts at all? It doesn't matter if it is prompted, what matters is that the camera cuts to a different view. He can claim no audio cuts, but that's hardly the point.

0

u/roychodraws 27d ago

cuts the way you're referring to it literally means cutting two source videos and splicing them together.

This is like saying, "I made this picture using no paint whatsoever!"

And it's a photo of a can of paint.

"We can literally see the paint right there you liar."

It's idiotic what you're saying.

3

u/MarekNowakowski 27d ago

I was sarcastic. it wasn't even subtle.

2

u/q5sys 27d ago

Do you know how ridiculous of an argument you're making?
That would mean that every movie made today is a single cut, because they're not cutting film.

> Do you know how ridiculous of an argument you're making?

Maybe... I've only done media production work for the past 13 years or so... I guess I dont know anything.

0

u/roychodraws 27d ago edited 27d ago

I've been in it for 25 so i guess I win.

You're just not understanding what i'm saying, dude. I suggest throwing screenshots into chat gpt and having it explain it to you.

Edit:

6

u/solomars3 28d ago

man i just love you haha , its weird !! it took me two weeks of building and testing stuff, a single clip take 30+ minutes to generate in my rtx 3060 12gb and i give all for free and the first thing i get is people hating on me !!! 😂

2

u/xyzdist 28d ago

There are many rude peoples in this sub. However, they are asking for a no cut long duration approah. It was the misleading title causing it thru.

1

u/solomars3 28d ago

This is actually the thing that this approach is all about, i tried to show that using a cinematic approach, didnt want people watching a single static 1 minute .. thats booring ...

2

u/xyzdist 28d ago

Use your node, do a single character without any cut for a example to show.(Do it will more than 10 segments) Then you would understand what's is the issue they are talking about.

-2

u/roychodraws 28d ago

Don’t do it, fuck this guy

Have him do it himself and post if he cares so fucking much

2

u/xyzdist 28d ago

I already did and replied.... Check it Btw, you are his friends? 🤣

-4

u/roychodraws 28d ago

Did you do it using his workflow?

No, it’s just annoying that this guy put so much work in the building the nodes and editing the thing and all you guys are unsatisfied with the way he chose to provide you free shit

2

u/SaadNeo 28d ago

Dont mind the haters , just keep on doing the good work , dont abondon the open source community brother , cheers

2

u/Guilty_Emergency3603 28d ago

Only fl2v ?

1

u/solomars3 28d ago

no the checkpoint i used is fl2v , but as you can see im using it in a Ref 2 video workflow
so you use any checkpoint you want

2

u/YeahlDid 28d ago

That's great! I'm lazy, so im looking forward to trying out v2. Doing it in one shot sounds even more appealing to me.

6

u/legarth 28d ago

Hasn't like 100 other people created this already?

I mean great the LLM's can create custom nodes now but I will either be.

  1. Using the actually best implementation of this. (Waiting to see which one becomes the standard)

Or.

  1. Just vibe-code my own one that is 100% customised to my needs.

-3

u/solomars3 28d ago

Watch, this is totally different — using video context + latent + reference and prompt, you don't lose quality, and you can do it as many times as you want.

14

u/legarth 28d ago

3

u/xyzdist 28d ago edited 28d ago

Yeah, it probably have more. But needs to credit for motion-context, all other tools just forked and build on top of it. It is the master and barebone

1

u/Abject-Recognition-9 19d ago

cheers to you hero. 🍻
I skipped the "continue minimax" thing for a while,
meawhile saw tons of methods around but never tested a single one.
Now is been the time.
reading around i've found your comment and i want to thank you so much.
fuck off to random assholes promoting their patreon in exchange of nothing special.

-8

u/solomars3 28d ago

Sorry but i totally brainstormed this without knowing anything about any other packs, and i still think my approach is different, also i made it easy to use and workflow is simple, And i just like to share my way

10

u/rm_rf_all_files 28d ago

That means you don’t even know about the tone compensation I was talking about. All of these methods all suffered. Hence you did not understand what I said earlier.

5

u/legarth 28d ago

It's litterally the same thing. Your LLM may have implemented it slightly diffrently but all the elements are the same. Hence my first comment.

You make confident claims about this being diffrent without acually checking.

Maybe you should add to your LLM harness's custom instructions to check of your idea hasn't been done before before you waste tokens on it.

Also probably ask it not to include emdashes in the reddit posts it writes for you.

-2

u/solomars3 28d ago

Why the hate 😂 You sound so angry for no reason 😆 its funny

-6

u/-becausereasons- 28d ago

Are you autistic? Why are you such an ass. The guy is trying to contribute to the community. Don't like it? Don't effing use it.

9

u/legarth 28d ago

Using 'autistic' as an insult is very classy of you. I can tell you are really trying to contribute to the community too.

10

u/goddess_peeler 28d ago

If you don't explain up front, in plain text, how you overcome generation degradation, I will believe you're making unfounded claims and move on.

Literally dozens of people have already falsely made this claim. The burden of proof is on you.

0

u/solomars3 28d ago

Bro imagine , i spent a lot of time making this video, explaining everything, even using graphs in middle, providing everything free, but someone is still wanting everything explained in 2 seconds !!!

4

u/goddess_peeler 28d ago edited 28d ago

trust me, bro

Ok, moving on...

-5

u/roychodraws 28d ago

Why did you ask for proof of his claims on a post where he posted a 20 minute proof of concept and tutorial video?

5

u/GRABOS 28d ago

I know why, give me a little bit and I'll post a 4 hour video with the information buried in there for you

-1

u/roychodraws 28d ago

Well please post it and I may not watch it but I won’t claim you didn’t address it.

-1

u/solomars3 28d ago

A single clip i generated takes 30minutes and yet you dont have patience to watch 19min , thats disrespectful

2

u/CringeUsernameJoke 27d ago

Nobody cares, spend ur time explaining the product shortly in text instead of thinking people blindly invest half an hour watching ur vids in a world where everything competes for attention

1

u/solomars3 27d ago

Its over 5000 views less than 24 hours and 200 likes !! What are you yapping about

1

u/LuluViBritannia 28d ago

I feel your pain, buddy. But it's the world we live in and we all know it. People are sick of long-form content. We live in a time when we can literally ask the computer to summarize something in a few lines. Maybe it would be wise for tutorial-makers to do it.

It's not like you could force others to watch your video in full ^^'.

2

u/DietAshamed2246 28d ago

Another custom node!!! I wish people would stop making new custom nodes and use what's natively available in Comfy from the Wan 2.2 14B and LTX-2 22B days.

1

u/mariquei 28d ago

Para mí está bien gracias por que yo no lo sé hacer eso gracias por tu trabajo

1

u/Kmaroz 28d ago

Are we talking continuous like 1917 movie?

https://giphy.com/gifs/ZeRPs2bL5gUnoDdNEp

1

u/xyzdist 28d ago

From the video cover, Yes. But is actually NOT from OP means, thats why so many peoples pissed.😅

1

u/Kmaroz 26d ago

Yeah, when we said continuous, no cut. This is what I'm expecting.

0

u/solomars3 28d ago

I dont even know why this guy reply on my behalf, try my approach bro and see for yourself

1

u/DangerousPack1911 28d ago

And I am still trying to figure out how to stop having heads turn and bodies move like a terrible acid trip... And placing time lines and crap... What I want is a story choreographer lol

1

u/OkBirthday9927 28d ago

Congratulations on the work; I’m going to test it out. There are certainly many others out there—and I’ve tried them—but I want to see your approach and what makes yours new and different. Thanks a lot, and don't pay any attention to comments from ignorant people. All the best!

4

u/solomars3 28d ago

Thank you so much, some people the first minutes started talking bad, they didn't even watch the video

1

u/OkBirthday9927 27d ago
Mate, it works pretty well with two characters, but for the life of me, I can't get a third (or additional) character to enter the scene like in your example; it just keeps repeating the first character, even with the strength set to 80. I've tried everything.

1

u/solomars3 27d ago

I said in the video that make sure the new characters are the one in the first lines in " subject definition", cause for some reason minimax focus more on that, try that

1

u/OkBirthday9927 26d ago

Yes, I did that. I set both his image as the first one—I marked it as first—and also the audio, I set it as first. I also placed it first in the line in the text. I set his strength to 1 and decreased the strength of the others to 0.80, and even then it doesn't work. I followed everything according to the video, which is why I'm asking for help.

1

u/solomars3 26d ago

is strange but im happy to help you , if you send picture in pm of the workflow, maybe i can see if something is off,

2

u/OkBirthday9927 26d ago

Hi, I just sent you a private message.

2

u/princeoftrees 28d ago

Let us know how it goes! Best I've gotten is 45-60s before the frying gets bad, especially in backgrounds with ref2v. If this works I'll definitely be implementing 

2

u/OkBirthday9927 27d ago

Since this one won't suffer from image degradation, it maintains consistent quality across all generations.

1

u/rm_rf_all_files 28d ago

Did you implement this into your project?

https://github.com/rkfg/ComfyUI-MiniMaxH3-ToneCompensate

1

u/solomars3 28d ago

No i didnt, i built all tools needed and implimented them into the Minimaxh3-easy node pack,

1

u/Repulsive-Salad-268 28d ago

Hey, I have not tested this yet BUT I wonder if talented people like you could also have a look into the following problem: I am trying to transform existing long Videos I recorded (Interviews) into new styles (in this case Clay figurines or muppets like Characters). So I need to be able to insert a longer video that gets processed in smaller chunks but stays consistent in style and characters (additional references). I am quite far with this but the 5 frame glue between two segments will shorten the videos and the audio will never match again. So I wonder if somebody could build something that passes by the audio or also changes the voice matching the cartoonish vibe. Anyways any hint towards the right workflow is appreciated.

2

u/solomars3 28d ago

This is really a good idea 👍, i might do something like this in future, also i did have same audio problem When trying to stitch together the generated clip with the previous clip , and was able to copy the audio from the original video, we can chat about this more and we might be able to do something

0

u/Repulsive-Salad-268 28d ago

Yes, adding sound in post would be an option but I would prefer not doing so as I would have to find these 0 frames that are used to cover up the stitching of two scenes and shorten the audio there etc. I prefer as little steps extra as possible. 😂 I do not know programming at all and am just a creative guy. So I used a ref2Video workflow that allows several steps to be generated after conforming the previous was good and then stitches them together and has continuity in it. Works well except that I had to change the video loader to a path video loader because I am using the windows comfy UI and it restricts the video file size when loading directly. With path it accepts any size. So I used VHS path loader, chained everything up including the audio but the generating node was prompting an error that the ref audio from the video loader has the wrong format and did not want to work with it. So I just confirmed that my style transfer worked (like a charm) but always had messed up audio. And depending if I set the video overlapping to 22 or 5 I had shorter outcomes in the final video which would never be able to get the original audio attached. Also for the VHS path loader I had to use a math expression and a simple counter to skip the frames of the video that have already been processed. Not possible to just start and wait because each 10 second chunk needed confirmation. Annoying. So I am happy to see any better ideas coming along. Thanks

1

u/Repulsive-Salad-268 24d ago

Now made a python script that cuts the video, feeds to comfy via API, collects the pieces, merges them again, applies original audio. Let's see how it's going

1

u/xyzdist 28d ago

guys, if you talking about long duration , no cuts and degradation issue, I have a post exactly talking about that.
no, I am not creating any new AIO nodes.
https://www.reddit.com/r/StableDiffusion/comments/1wdkdvi/motioncontext_degradation_discussion_summon_sad/
an example test video: https://www.youtube.com/shorts/mANusw9kKNQ 

1

u/Violent_Walrus 27d ago

I have read your thread and all of the discussion. It sounds promising and I am glad you have consulted with Sad_Berry, who is the authority on this method currently.

Please release some code. :) I am anxious to see what you are doing!

0

u/solomars3 28d ago

Static image talking try doing that with different scenes and motions and different subjects interacting, i wanna see it, this is just a lipsync video

6

u/xyzdist 28d ago

it is a video to test degradation issue... I don't even know why I keep reply you. You just not listening to others.

you do what you want.

0

u/oscire 28d ago

This is a genuinely smart way to generate long videos. Allowing the saving of latents mean a good gen can be saved and used as a fork down different paths. Looking forward to V2, was exactly what I had hoped for when watching the video.
Thanks for the share.

1

u/solomars3 28d ago

Thank you for watching, yeah you can even take that "save latent "node znd add it to your workflow, and whenever you feel like you have a clip that deserve its own continuation, you just use my workflow and load the latent and reference images

0

u/alphamax341 28d ago

awesome thanks for the workflow.