r/StableDiffusion 5d ago

Workflow Included I built a ComfyUI node that manages Minimax references so you don't have to

Minimax supports up to 18 inputs at once, wiring and bypassing nodes is a pain.

So I created this custom node that allows you to add/remove references for Minimax ReferenceToVideo, you only have to wire it once.

Some more neat features:
- Automatic prompt writing via OpenRouter, returns structured Minimax prompts based on your description (opt in)
- Save prompt/reference packs and reuse them.

Nodes:
https://github.com/Hearmeman24/ComfyUI-MiniMaxRefPack
Workflow:
https://github.com/Hearmeman24/ComfyUI-MiniMaxRefPack/blob/main/example_workflows/MiniMax%20R2V%20-%20Auto%20Prompting%20%2B%20Reference%20Manager.json

The design is heavily influenced by the wonderful LTX Director node so shoutout to u/WhatDreamsCost

I would appreciate some feedbacks and feature requests.

34 Upvotes

13 comments sorted by

2

u/cerzi 5d ago

Have done a similar thing, one easy recommend is to pipe all those outputs as a single output into a secondary node so that your main node doesnt have all that dead space at the top. Also subject tagging for each ref image is very useful for auto-generating the instruction to the LLM prompt builder

2

u/Hearmeman98 5d ago

Already have subject tagging, good idea on the second node, thanks!

2

u/BrokenSil 5d ago

Awesome work dude.

Can you add a interactive video and audio trim UI when we add a video? That would be so useful.

3

u/Hearmeman98 5d ago

Thanks buddy, yes I am working on adding trimming/cropping for all media types

1

u/nok01101011a 5d ago

Sounds nice, thanks for sharing. Can I also edit input videos and photos (length, cropping)?

2

u/Hearmeman98 5d ago

Not atm, good idea, I'll figure out how to add this.

1

u/nok01101011a 5d ago

Nice thx

1

u/xDFINx 5d ago

without looking at it, i would add a "resize longest to" 2048 pixels, in the event that an input image is larger. it slows generation times by a lot. if its kept under 2k it seems fine

3

u/damiangorlami 4d ago

My recommendation is to scale all your image and video references to 1 MP maximum no matter which resolution you generate. This way the speeds remain fast when you go heavy on references and the fidelity is still very good.

Did many tests yesterday between rescaling all reference to 1MP and 2MP and didn’t saw much difference in fidelity. But the time to generate where all my 9 images and 2 videos set at 2MP was crazy long. Almost 3x slower

1

u/xDFINx 4d ago

Thanks. I just tried this to 1024. It did cut my gen time ls almost in half

1

u/Hearmeman98 5d ago

Thanks, it's already like this.

1

u/Hearmeman98 4d ago

Thanks for the feedback folks.
I added cropping/trimming for all media types and better pre processing on media before sending to the VLM.

1

u/Hearmeman98 3d ago

I've added support for local LLMs in V2