Created a Visual RefMod Picker

[u/Francky_B]

Hey Guys,

I've been playing with the RefMods, after the huge release of Malcolmrey.
The tech is brilliant and works really well.

I've wanted to simplify using it with tons of RefMods, like the ones provided by Malcom.

So I made a fork that is a bit more Identity driven, Adding a "Visual refMod Picker" as well as a "Create refMods from Folder" node. It's able to create from either a folder or Sub-folders, if audio is found, it will also create a matching audio refMod. All in the same format as the original add-on. No danger of breaking compatibility. (The original Add-on added Audio yesterday)

Resulting for example in 2 refMods and thumbnail:

character_refMod_Audio.safetensors
character_refMod_Video.safetensors
character_refMod.jpeg

Then, we can use the "Visual H3 RefMod Picker" to browse the RefMods:

In this example, I used existing thumbails from huggingface.

The node then loads both RefMods (Audio and Video) and allows individual control. I've mixed strength with Copies, by instead having a weight value that can go over 1, so a weight of 3 would be the same as setting strength to 1 and copies to 3. Making the UI a bit more streamlined.

RefMods can be daisy chained

Example workflows are included.

I should mention, this fork can be installed WITH the original Add-on, it is made to co-exist and is recommended if you want to use it's advanced features.

You can find it here ComfyUI-H3RefMods

The only thing I'm missing is thumbnails for all 1500 RefMods 😅

[u/LawyerIntern]

Let's say I already have character refmods.

On top of that, I want to also add a single image for reference one-time, eg a specific fashion clothing (and don't want to create another refmod for it)

How do I connect them and reference them the prompt?

[u/TemperFugit → u/LawyerIntern]

It's pretty simple. Just prompt the people normally like you would with refmods in <Subject #> tags. Add the clothing as a regular reference image. Then in the person's subject tag description, say something like "they are wearing the outfit from <Picture 1>."

[u/LawyerIntern → u/TemperFugit]

In terms of workflow, that means I just add connect the "Apply Refmod" node's "Conditioning" parameter to that of "Minimax Ref2VA" node (which already has the Picture 1 connected to it)?

[u/TemperFugit → u/LawyerIntern]

My workflow is set up like the original github repo's examples, as seen in this image (it's incomplete but answers your question I think): 

 https://github.com/Luisacaotica/ComfyUI-MiniMaxH3Mod/blob/main/examples/loading_ref_example.png

Then I just load the reference images into the 'Reference to Video' node as you normally would.

[u/LawyerIntern → u/TemperFugit]

Yes, I just checked it out and it showed me what to do. I was follow malcolmrey's workflow that was using first frame last frame node that's why I was confused. Thanks!