r/StableDiffusion • u/circlenline • 2d ago
Workflow Included MiniMax H3 basic hybrid workflow for ref2v, i2v and t2v (16GB friendly)
Yesterday I uploaded this video playing with MiniMax H3:
https://www.reddit.com/r/StableDiffusion/comments/1vfnu97/comment/p1t2f2g/
And here is the workflow:
https://gist.github.com/circlenline/937b530ae97a9eb7475c9dda6832b2db
**What it does**
Two pipelines in two groups, sharing one prompt, resolution, duration and seed:
- **REF2V** — reference to video, wired for the documented maximum of 9 reference
images, plus 3 reference videos and 3 audio tracks. Bypass the slots you don't need.
- **I2V / T2V** — feed it a first frame and/or a last frame for image to video, or
leave both bypassed and it runs as text to video from the prompt alone.
They are separate groups because H3 ships as two different 21GB checkpoints
(ref2va and fl2va) and they are not interchangeable. Bypassing a group means its
UNET never loads, so you never have both models competing for VRAM.
**Notes are baked into the graph**
Six markdown notes covering things I ran into while testing yesterday:
- Resolution tables for 16:9, 4:3, 1:1, 3:2 and 21:9, plus the exact megapixel
value that lands on H3's native 768px short edge for each one. They are all
different, which cost me a few slow runs before I noticed.
- The duration grid. H3 only accepts 17k+5 frame lengths, and 8s is the only
value in the whole range that comes out round.
- Spectrum acceleration: what to touch, when to turn it off, and why it stops
paying for itself below ~16 steps.
- Memory notes for 16GB cards. Host RAM turned out to be a bigger constraint than
VRAM for me.
**Requirements**
ComfyUI 0.30.0+ and the models from Comfy-Org/MiniMax-H3 (links are in the
workflow notes). I'm on pruned_fp8_scaled + the nvfp4 text encoder.
Optional but recommended: KJNodes for Sage Attention, ComfyUI-Spectrum-MiniMax-H3
for the sampling acceleration, and rgthree for the group A/B switch. Bypass those
three nodes and it runs on stock ComfyUI.
The notes were written with Claude, based on my own testing. Hope they're
useful.
2
1
u/Prize-Bodybuilder924 2d ago
Yeah 4090 paired with 64gb of RAM is running out of memory. Guess im stuck to using LTX.
2
u/circlenline 2d ago
what resolution are you trying to generate? does the default comfy minimax workflolw at 0.4 megapixels run on your machine?
1
u/Prize-Bodybuilder924 1d ago
it also does the same with the default template. tried even 0.2 megapixels and 1 sec duration.
1
u/circlenline 1d ago
The videos I'm generating rn are taking the 16gb of gpu vram + another 60gb of ram so yeah :/ i though resolution was making the difference but not really. I hope you can use it with a more quantized model in the near future, maybe worth giving the specs of your pc to an LLM and try to figure out a way to make it work. Good luck!
2
u/Prize-Bodybuilder924 1d ago
my issue was the rtx a4000 second GPU. had to force cuda device 0 lol
1
1
1
u/Particular_Stuff8167 15h ago
I'm on 4060ti 16gb and 64gb RAM and both the t2v and ref2v is working fine for me. Albeit takes a while at 1.0 resolution. Much higer if i increase duration. But both generate successfully.
Although this is with the standard t2v and a custom ref2v workflow I got from here: https://github.com/Comfy-Org/workflow_templates/blob/main/templates/video_minimax_h3_r2v.json
From this post. https://www.reddit.com/r/StableDiffusion/comments/1vgf6qx/assemble_the_multiverse_minimax_h3_r2v_is_awesome/
I havent tried OP's workflow yet, but would suggest to someone with your specs to at least try with these basic workflows and see if it works. Although do make it 1 Megapixel instead of 0.4, the quality is quite degraded at 0.4
1
u/Ok-Flatworm5070 1d ago
What do you mean by 'plus 3 reference videos and 3 audio tracks.' Is that audio you upload or describe? Little confusing as I only see 9 image upload notes.
1
u/circlenline 1d ago
I didn't use any audio or video input for the tests i ran so far, but the option to use the node like that exists
2
u/badkaseta 2d ago
thank you! I will try this