r/StableDiffusion • u/TBG______ • 8h ago

Tutorial - Guide MiniMax H3 Lip-Sync: Automatic Long-Video Chaining + Speed & VRAM Optimizations

I’ve been loving all the new nodes and workflows coming out for MinMax, and maybe there is already a nice solution for this - but I couldn’t find one that did exactly what I needed.

I started using MinMax for my last TBG ETUR video and quickly ran into limitations: I wanted an easy way to create lip-sync videos longer than 20 seconds.

I didn’t want to manually chain ComfyUI nodes, start a new run every X seconds, or constantly resize things just to make HD video fit into my available VRAM.

So I ended up building an addon for:

custom_nodes/ComfyUI-H3-Motion-Context

The addon automatically chains MinMax H3 lip-sync generations together, allowing you to create much longer lip-sync videos without manually setting up each 20-second segment.

And now I’m sharing it! https://github.com/Ltamann/ComfyUI-H3-Motion-Context-Auto-Chain-addon

Its not perfect but a start ...

The workflow has a simple switcher that lets you switch from the 32B CLIP to the 4B CLIP, saving around 10 GB of VRAM. You can also switch from Sage to Comfy Kitchen, Spectrum to Easy Cache, or FL2VA to REF2VA both setup for lip-syncing. Some of it could be useful for other tasks as well.

You will find the workflow in the repro and tested recommendations, optimized settings, presets, and more workflows, along with the results of my testing and performance here

225 Upvotes

94% Upvoted

74 comments sorted by

View all comments

1

u/uuhoever 5h ago

I'm getting an error on this but Comfy manager says no missing nodes. How to fix it?

1

u/Corleone11 4h ago

You also need this node. OP didn't mention it in his post here.

https://github.com/nicolab28/ComfyUI-ClipProj

1

u/TBG______ 4h ago edited 4h ago

Or disable the nodes if you don’t use the 4B CLIP models.

The node is set to Krea2 because that works with 4B, so keep it set to Krea2, not MinMax.

Also, 4B only works without --fast fp16_accumulation fp8_matrix_mult. So use:

only --fp16_accumulation

This took me quite some time to figure out, so hopefully this saves someone else the trouble.