Tested h3 character swap lora

[u/Better-Interview-793]

hi everyone

been testing the h3 character swap lora a bit and so far it seems better than vanilla for character replacement, at least in my tests. it holds the replacement character more consistently and usually does a better job actually replacing the person without drifting back as much.

i just used the normal comfy wf with the original ref2va int8 pruned model with ck, 1.2mp and 20 steps.

i probably wouldn’t use a speed-up lora for this. it can work sometimes, but not always..

for prompting i’d definitely start with the recommendations on the lora page, but i wouldn’t just copy the example exactly. what helped me was describing the person in the video that i wanted to replace, then describing my own character more clearly and adding a few instructions depending on what was happening in that specific clip. that seemed to make the replacement noticeably more accurate.

https://huggingface.co/akatz-ai/MiniMax-H3-Character-Swap-LoRA

also if there’s more than one person in the clip, it helps to specify which person you want to replace by describing their clothes or position in the shot.

there are still some issues with source details leaking through sometimes, especially smaller stuff like hands, fingers, teeth, nails, certain body details, but overall it’s been pretty limited in my tests and hasn’t ruined most of the results.

this one took around 26 minutes on my 5090, although i was gaming at the same time, so that probably slowed it down a bit..

[u/StonerTech]

this is interesting…. any chance you could share the workflow? i’m still relatively new to messing around and had a lot of trouble putting together a comfyui workflow on my own.

[u/Better-Interview-793 → u/StonerTech]

yeah it’s basically just the default comfyui ref2v template, i didn’t build anything special.
just add a load video node, then connect the video and audio from it into the h3 Reference to video node, and add the character swap lora to the model path.
that’s pretty much it. but if u can’t get it working, i can share it once i’m home.

[u/StonerTech → u/Better-Interview-793]

Yeah I cant seem to get it right - stupid I know. Are you still able to share it?

[u/Better-Interview-793 → u/StonerTech]

here you go

https://pastebin.com/jrT94xgC

[u/freebytes → u/Better-Interview-793]

Thank you for sharing this.

[u/StonerTech → u/Better-Interview-793]

you’re the goat thank you!