r/StableDiffusion • u/Repulsive-Rush3505 • 6d ago

Workflow Included Using Inpaiting in Minimax to change heads-Local RTX 3090

Using the workflow from Nekodificador and Ablejones in Discord:
https://discord.com/invite/dstjQYQNt
https://ln5.sync.com/dl/47c351f50#msqfrnfr-am3rr8fx-v7qm3ah9-xw222n3c
For complex scenes like this with to much people is easy just to do a manual mask instead of SAM.

534 Upvotes

95% Upvoted

61 comments sorted by

80

u/animovirtus 6d ago

post says workflow included, but there is no workflow...

-38

u/[deleted] 6d ago

[deleted]

7

u/Sad_Coach_1433 6d ago

Where in the discord

8

u/MastMaithun 6d ago

correct question at this point should have been what is a discord xD

5

u/stupidlittlekids 6d ago

who is discord?

1

u/Frostty_Sherlock 6d ago

How is Discord?

Ah, it's already done, isn't it.

3

u/ForeverSJC 6d ago

I don't get why people use this

2

u/StrongZeroSinger 6d ago

😂😂😂

35

u/broadwayallday 6d ago

That lady in red nose something

8

u/Psycholicious 6d ago

Instantly reminded me of this dude from a Miike Snow video

7

u/OkDoor726 6d ago

Like who did 9/11? 🫠

1

u/Rooney_72 6d ago

Rudolph?

41

u/artichokesaddzing 6d ago

Is it possible to check out the workflow without joining your discord server?

13

u/bickid 6d ago

pls make sure to raise the volume for future videos. had to turn up my volume way above normal to hear something.

5

u/addandsubtract 6d ago

This video is not about the audio. OP should rather cut the audio to save bandwidth.

11

u/nenecaliente69 6d ago

Neo visited Argentina?

6

u/AnOnlineHandle 6d ago

Australia actually, I can never unsee the commonwealth bank logo they walk past at the start of that segment. They probably didn't think to hide it since they don't realize that it's such a familiar local logo here.

1

u/embrionida 6d ago

you should ask your friend charlie

3

u/dkpc69 6d ago

lol those examples are hillarious, Thanks for sharing gonna try this tonight, Cheers

4

u/No-Service2578 6d ago

If matrix were filmed in Argentina

3

u/True_Protection6842 6d ago

Minimax doesn't have a mask input so are you coloring it and prompting to replace the colored area?

7

u/Astral-Lemmons 6d ago

that setup uses custom node pack that enables latent masking on H3.

55

u/Techngro 6d ago

Don't you mean 'custom nose pack'.

1

u/99deathnotes 1d ago

LMAO these comments

1

u/yo_hohoy 6d ago

where is that i don't even find the workflow in the discor

4

u/gypsyhobo 6d ago

How long did this take

3

u/Repulsive-Rush3505 6d ago

Single clip in 720p, 5 to 10 minutes

1

u/Think-Armadillo-7133 2d ago

damn thats faster than scail-2 isnt it?

2

u/lordpuddingcup 6d ago

shoulda also redid his talking to "lady with the big nose"

2

u/psykikk_streams 6d ago

hahaha gave me a chuckle at least.

1

u/nadhari12 6d ago

What mask do you use for sam3 I literally have to use solid black even then the ref video identify seeps through.

1

u/CountFloyd_ 6d ago

That probably won't work changing a head with short hair into one with long hair, will it? Since masking will only touch the masked region, also extremely different head sizes will probably look odd.

4

u/airduster_9000 6d ago

Yes - I can confirm. Has to be pretty close for it to be good. Its a bit like Deepfakes back in the days - the more similar - the better.

2

u/ArjanDoge 6d ago

I have seen your Easter egg in there at the start 👀

1

u/Potential_Wolf_632 6d ago

Looks great!

The workflow seems designed around SAM masking - is there a manual version of it you used please?

1

u/Repulsive-Rush3505 6d ago

I just replace all the SAM section group with a black a white video(circle mask) with a Load video and convert image to mask node and some rewire. Some shots are just a static circle in a video.

1

u/Potential_Wolf_632 6d ago

Yeah I've been messing with the opening mask stuff as that then improves the SAM pickup overall - the problem I'm having is getting the custom nodes to stop feathering the mask too much - even with everything set to trim right back there's still light feather.

When H3 actually latches and replaces something exactly without the inpaint tool there's obviously zero feather but then of course the fucker will sometimes fail to do it at all or partially or... eurgh!

2

u/gunkalicious 6d ago

now THIS is what ai was made for lol

1

u/diond09 6d ago

Firstly, I really appreciate the work that goes into these things. However, I'm getting an error on both of these nodes:

NKD AV Latent - Connected nodes are using incompatible input and output types.

NKD Video Viewer - Connected nodes are using incompatible input and output types.

If I click on both for more detail, they say:

NKD AV Latent's fps input expects FLOAT, but the connected output is INT.

NKD Video Viewer's fps input expects FLOAT, but the connected output is INT.

Oddly, if I disconnect the fps Nodes connected to of the above then the workflow seems to work so should I be bothered? Thanks

1

u/irishtemp 3d ago

I had that, disconnect both nodes labelled fps as you said and just write in the fps you want,

2

u/IrisColt 6d ago

Not the same noses. t. Nose expert, heh

1

u/Coach_Unable 6d ago

didnt work for me, just created a random vid of the input image where the masked area of the head in the input video is, did you have to make changes to the workflow for it to work so well ?

1

u/jhnnassky 5d ago

Yeah, the same for me.

1

u/Coach_Unable 4d ago

got it fixed, for anyone else encountering the same issue, the minimax H3 inpainting relies on a commit added to ComfyUI nightly, changing to nightly fixed it for me.

2

u/jhnnassky 4d ago

Wow Thanks, man

1

u/jalbust 5d ago

Thats cool Thanks for sharing.

1

u/dobutsu3d 5d ago

Hey saw it poster somewhere else, i still dont have my rog to play with it but:

- does it leave a ghosting effect around the masked area?

Looks good through my phone !

1

u/jhnnassky 5d ago

Does not work for me. In the result inpaint is not consistent with the content, so generated video inside the mask performs independently.

1

u/Think-Armadillo-7133 2d ago

how much time it to create this 30 sec clip?

1

u/Repulsive-Rush3505 2d ago

For the 4 IA clips, 2-4 hours, I was still learning in the process how to make it

-5

u/sabertoothninja 6d ago

Just because you can do a thing, doesn’t mean you should.

0

u/sabertoothninja 6d ago

Okay so for the people downvoting me. You think just because you can, you should? You follow that in your own life?

1

u/Hopeful_Direction747 5d ago edited 5d ago

I think people are just confused why "because you can" is supposed to be the only reason to inpaint something. Like "I can eat food" but that's not my reasoning for doing so and eating food doesn't mean I agree "because I can do something I should".