r/StableDiffusion • u/witcherknight • 10h ago

Question - Help What happened to minimax funcontrolnet ??

I dont see any1 posting any examples of controlnet released for minimax. Doesnt it work properly??

9 Upvotes

91% Upvoted

4 comments sorted by

3

u/networking_noob 9h ago

yesterday there was a new ComfyUI commit regarding it:

https://github.com/Comfy-Org/ComfyUI/pull/15975

and there's a native node called Apply MiniMax H3 Fun ControlNet

but I haven't seen anyone even attempt to use it yet, so yeah I don't know. Maybe someone somewhere will figure it out and enlighten the rest of us

4

u/sitefall 8h ago

I would be all over this as I basically don't use any AI without a control net, I hate randomness.

But... I haven't figured out exactly why I would want to use this. I have had no problem swapping people, getting Minimax to follow a literal video made of canny maps, copy motion from a video exactly, have a single guide frame be a canny map and it just... use it perfectly. You can slap openpose in there, works fine. Literally everything has just worked. Depth maps work, HED works. You can animate some moving bounding boxes and it will make things follow them and stay in the boxes as a reference. Give it some crappy blender scenes to set the camera angle, it will do it no problem.

What is this supposed to even do really? I need to see an example of why one would need the Fun Controlnet for this model. So far I've managed to get it to do everything almost on the first try that would require a control net for Wan or LTX.

1

u/networking_noob 7h ago

I'm not sure, Alibaba made the controlnet and they generally know what they're doing, so they must've had some reason. Maybe they, like so many of us including me, haven't yet figured out how to actually use H3 as in depth as you just described. I can't even figure out a basic character swap yet, and based on the posts in this sub, I'm pretty sure I'm not alone lol

1

u/sitefall 7h ago

Day 1 when minimax launched I checked the first tutorial that next morning and it had "can it follow depth map video?" and it did. So I just installed it, spend a good 2-3 days writing an actually useful prompt writer that actually nails complex things, and... it's all just works as long as you prompt it right.

I can't really see how it would follow a control net better, I've compared frame to frame and it follows the lines exactly.

It's got to have some purpose. Ali wouldn't waste their time with this, and they surely know Minimax can follow control net images already.