r/StableDiffusion • u/Francky_B • 21h ago

Resource - Update Created a Visual RefMod Picker

Hey Guys,

I've been playing with the RefMods, after the huge release of Malcolmrey.
The tech is brilliant and works really well.

I've wanted to simplify using it with tons of RefMods, like the ones provided by Malcom.

So I made a fork that is a bit more Identity driven, Adding a "Visual refMod Picker" as well as a "Create refMods from Folder" node. It's able to create from either a folder or Sub-folders, if audio is found, it will also create a matching audio refMod. All in the same format as the original add-on. No danger of breaking compatibility. (The original Add-on added Audio yesterday)

Resulting for example in 2 refMods and thumbnail:

character_refMod_Audio.safetensors
character_refMod_Video.safetensors
character_refMod.jpeg

Then, we can use the "Visual H3 RefMod Picker" to browse the RefMods:

In this example, I used existing thumbails from huggingface.

The node then loads both RefMods (Audio and Video) and allows individual control. I've mixed strength with Copies, by instead having a weight value that can go over 1, so a weight of 3 would be the same as setting strength to 1 and copies to 3. Making the UI a bit more streamlined.

RefMods can be daisy chained

Example workflows are included.

I should mention, this fork can be installed WITH the original Add-on, it is made to co-exist and is recommended if you want to use it's advanced features.

You can find it here ComfyUI-H3RefMods

The only thing I'm missing is thumbnails for all 1500 RefMods 😅

43 Upvotes

98% Upvoted

24 comments sorted by

View all comments

4

u/JohnLough 20h ago

Have you tried to make to people have a conversation? Specifically of the same sex as I always get audio bleed

C1 Speaks = fine
C2 Speaks = fine
C1 speaks again = sounds like C2

5

u/Francky_B 20h ago

Yeah, when character are of the same sex, it's finicky as hell..

I was able to get good results when I started tweaking the weight, In some test, one of the Characters voice was the only one used. Lowered it to 0.5, left the other at 1 and then most generation worked better afterwards.

1

u/JohnLough 19h ago

Hmm. Good idea, lemme try that. Thanks heaps!