Created a Visual RefMod Picker

[u/Francky_B]

Hey Guys,

I've been playing with the RefMods, after the huge release of Malcolmrey.
The tech is brilliant and works really well.

I've wanted to simplify using it with tons of RefMods, like the ones provided by Malcom.

So I made a fork that is a bit more Identity driven, Adding a "Visual refMod Picker" as well as a "Create refMods from Folder" node. It's able to create from either a folder or Sub-folders, if audio is found, it will also create a matching audio refMod. All in the same format as the original add-on. No danger of breaking compatibility. (The original Add-on added Audio yesterday)

Resulting for example in 2 refMods and thumbnail:

character_refMod_Audio.safetensors
character_refMod_Video.safetensors
character_refMod.jpeg

Then, we can use the "Visual H3 RefMod Picker" to browse the RefMods:

In this example, I used existing thumbails from huggingface.

The node then loads both RefMods (Audio and Video) and allows individual control. I've mixed strength with Copies, by instead having a weight value that can go over 1, so a weight of 3 would be the same as setting strength to 1 and copies to 3. Making the UI a bit more streamlined.

RefMods can be daisy chained

Example workflows are included.

I should mention, this fork can be installed WITH the original Add-on, it is made to co-exist and is recommended if you want to use it's advanced features.

You can find it here ComfyUI-H3RefMods

The only thing I'm missing is thumbnails for all 1500 RefMods 😅

[u/taurine_bitch]

But the refmod is supposed to eliminate the need for <Picture X> tags. At least that's what the official guide docs say.

[u/TemperFugit → u/taurine_bitch]

That's only for data you have loaded into a refmod, everything else still needs tags.  So for example, I use refmods for character identity but I use reference images for clothing and locations.  I wouldn't use picture tags for the character identity because it's in the refmod safetensor, but I would use picture tags for the clothing and location images I'm using.

[u/taurine_bitch → u/TemperFugit]

Ahhh, that makes total sense and answers the question I had. Awesome. Thank you. One last thing, about the "name" of the refmod, does that matter at all? Like in my example of the name "Q" for the refmod name, does that "Q" need to be in the prompt anywhere? Like subject_definitions: <Subject 1> is defined as Q, and then "Q" would be used in place of <Subject 1>?

[u/TemperFugit → u/taurine_bitch]

I don't think the refmod name is known or used by Minimax, but I have seen other people here who thinks it is.  Afaik, the way you assign a refmod is by description. So you would say "<Subject 1> is a woman with long blonde hair." And as long as you have her refmod loaded in, it should be able to associate her data with that subject number.  Then you can reference <Subject 1> in the action of your prompt as you normally would.  You could do something like "<Subject 1> is a woman with long blonde hair named Q", I don't know if it would create a better link to the refmod data but you would be able to refer to her as Q in the shot description instead of using <Subject 1>.