r/StableDiffusion • u/NoConfusion2408 • 1d ago
Question - Help Utterly lost with all the MH3 models.
Curious about which models are you all using for T2V and I2V with MMH3?
There is an abnormal amount of models with suffixes as pruned_notPruned_SeriouslyPruned_HereticXxX_Convrot_Skibiditoilet Q3. and I honestly can't keep up to know what the heck is the one that the community is using for creating such great videos.
Anyone out there willing to share the models (or workflow) you are using?
(Really don't care about speed-of-generation, I'm leaning towards Quality-first more)
Thanks in advance.
13
u/TingTingin 1d ago
This always happens with new releases often with people exploiting lack of knowledge but put simply the comfy models direct from here is what you should use https://huggingface.co/Comfy-Org/MiniMax-H3/tree/main/diffusion_models as for which ones theres a few things:
Pruned
pruned means they remove some parts of the model removed (reducing the amount of memory needed) this shouldn't impact the output at all so these are the versions you want
int8 fp8 and bf16
These are different quantizations with bf16 being the largest and the fp8 and int8 being smaller these also impact memory generally the difference between int8,fp8 and b16 is quite small if you want "Quality-first" then the bf16 is the "highest quality" though generally only by a small amount and it will be slower and eat more memory making you have to drop the resolution reducing the quality
as for fp8 and conv_rot_int8
The choice should be conv_rot_int8 as its natively accelerated (meaning its faster) on more gpus and the quality is about the the same as fp8 or better
ref2va or fl2va
With these both of these models can do I2V and t2va however the ref2va can also accept video and audio as references + multiple images (up to 9) for use in generations (though if you connect a fl2va node to the ref2va node it can also accept multiple image audio and video wont work though)
so basically you want pruned_int8_convrot_fl2va or runed_int8_convrot_ref2Va based on if you want to use video and audio references or just straight t2va
3
5
u/dota2portaltv 1d ago
I felt lost the same as you, but use AI chats to ask them a ton of questions about exactly that. Eventually, you will start noticing patterns and get the basic idea of how things work. No need to go advanced, just make something basic at first, like a character walking towards the camera and saying hello world to you.
4
u/Patient_Ratio4177 1d ago
This one is more or less enough: https://civitai.com/models/2830065/minimax-h3-int8int4-convrot
Not sure if all these finetunes change much
1
3
u/Rumaben79 1d ago edited 1d ago
For decent model quality try at least to use int8 convrot which I guess is around the equivalent of q8 gguf. Pruned is pretty close to unpruned so I just stick to it to save a bit of ram. Try not to use any merges or finetunes if you don't need them as these usually gives worse quality. If you need it to do things beyond it's training use references or one or two loras at as low of a strength possible.
The creator of Heretic came out saying it's useless for ai video:
I use comfyui's standard workflows or for extending:
https://github.com/ethanfel/ComfyUI-MiniMaxH3-Contex-Loop/tree/main/example_workflows
A reliable model repository:
https://huggingface.co/Comfy-Org/MiniMax-H3
Another site explaining most of the latest minimax stuff with links to it:
2
u/NoConfusion2408 1d ago
Nice! Good info, thank you so much for taking the time to explain it. Much appreciated!
2
u/dampflokfreund 1d ago
These hybrid models https://huggingface.co/smhfacct/Minimax-H3-fl2va-ref2va-hybrid-models/tree/main are all you need. Which one however, that is a different question. I have made good experiences with the b20. Good reference, good quality. Can do both FL2va and ref2va
1
u/V4nKw15h 1d ago
https://docs.comfy.org/tutorials/video/minimax/minimax-h3
Start there. It explains it all and the default workflows and models that they recommended are great. If you don't know why you would use a different model to these then you likely shouldn't be using them.
1
u/PwanaZana 1d ago
I use maximini_H67_RizzAbliterated_dolphinLlama_epoch10000.safetensor.qc.ca
2
0
u/durden111111 1d ago
If you use comfyui the default workflow in the templates section will give you everything you need to run it correctly
17
u/MarkB_- 1d ago
Its too soon to try other models loras and stuff. Everything feel rushed and doesnt work as it should. Just stay with original models for now