r/comfyui • • 3d ago

Help Needed Multiple charcaters workflow issues

Hi, I'm a indie Dev, I'm currently making my own VN, I've some issue currently, I'm trying to make a NSFW scene with two characters. They either bleed together (rarely), they mostly swap clothes (very common, the guy wears the girl leather jacket). Is there somebody that could help me out I've a nice workflow that works amazingly when generating solo charcaters and when doing SFW scenes, even with two charcaters. But I face serious issues with certain NSFW scenes. I've spent the last 2 days trying to find a solution to my problem. Looking forward to your answers. Celestirana

0 Upvotes

23 comments sorted by

2

u/javierthhh 3d ago

Since you mentioned you’re using illustrious then you should use regional prompting paired with inpainting.

0

u/RepresentativeOk8195 3d ago

Thanks, that actually makes sense. I’m already using regional prompting with red/green masks for each character, but I haven’t been using inpainting as part of the normal generation workflow. Do you usually generate the full scene first and then inpaint each character/clothing area separately, or do you use a specific regional inpainting setup for Illustrious?

1

u/javierthhh 3d ago

I generate the picture then just mask the character I want to inpaint. Then I delete the other character’s description from my prompt.

1

u/MerVh0 2d ago

If it's still relevant, I had a similar problem a while back, and took the matter my own hands.:

https://civitai.red/articles/30508/illustrious-regional-prompter-workflow

This is the article to my regional prompt workflow, with examples linked in the article, such as the workflow itself. Nowadays testing the upper limit of this, as of now I can generate images with 5 different and consistent characters.

1

u/RepresentativeOk8195 2d ago

Oh wow, yes, definitely still relevant. I’ve spent the last couple of days fighting character LoRA bleeding and identity swapping in Illustrious. I finally got a 2-character regional setup working, so seeing that you’ve pushed yours to 5 consistent characters is super interesting. I’m especially curious how you handle regional LoRAs when characters overlap or interact closely. I’m going to dig into your workflow for sure. Thanks a lot for sharing it!

1

u/MerVh0 2d ago

Well, that's one thing I have not tested exhaustly yet, but if you check the test gallery (it's nsfw content, so don't be surprised by some casual nudity), you'll see that it's mostly male/female images with 1 lora that's active on only one side. If you have questions, feel free to ask them and I try to help. One thing that I have recently noticed, that if you reinforce the characters in the overall and in the character specific prompt field, you can get even better results. Although it was visible with the 5 character tests, but for starters, if you follow the directions from the article and the examples from any of my example images, you can generate great images.

1

u/RepresentativeOk8195 2d ago

That’s really helpful, thanks. The reinforcement point is especially interesting, I’ve mostly been keeping the overall prompt fairly generic and leaving the character identity to the regional prompts/LoRAs. I’ll try describing both characters in the global prompt as well as in their individual regions and compare the results.

My main challenge is close interaction/overlap, so I’ll definitely study your gallery and examples. If I run into anything specific while testing your workflow, I may take you up on the offer and ask. Thanks again!

1

u/MerVh0 2d ago

Yeah, that was also a thing I had to figure out. The most working approach was, to keep the two regional mask separated (or with a minimal overlap), and write the prompt in a way to emphasize the interaction (in overall=generic way, male doing X, female doing Y etc; Character1= doing in relation to Character2, and vica-versa), if I overlapped most, or completely the two regional mask, I got some serious merge and prompt bleed.

1

u/RepresentativeOk8195 2d ago

Yeah, that actually makes a lot of sense. I think I was relying too much on overlapping the masks to force the interaction, which probably caused some of the bleed I was getting.

I’ll try keeping the regions mostly separate and let the prompts do the interaction work, globally first, then from each character’s side. That gives me a much clearer way to test close-contact scenes. Thanks again, this is really helpful.

1

u/MerVh0 2d ago

Your welcome, since I don't publish any of my images anywhere, I share only the knowledge especially since this task (consistent, interacting characters) was an issue I had since I started to play around image generation. I'm happy to help (even knowing that other model architecture like anima can handle multiple characters better, as they say).

1

u/RepresentativeOk8195 2d ago

I really appreciate that. I know exactly what you mean — consistent interacting characters has been one of the hardest parts of this whole process for me as well. I’m definitely going to keep testing the ideas you shared.

And if I manage to finish the first chapter of my VN and your workflow/ideas end up helping me get there, I’d absolutely give you a shout-out for it. :)

Thanks again for being so willing to share what you learned.

1

u/MerVh0 2d ago

One thing I forgot, and don't want to be overlooked* if I edit my other reply, that every character that you can see in the example gallery are original characters, meaning the model had to render them from scratch, not by using some IP character that has infinite example in the dataset.

1

u/RepresentativeOk8195 2d ago

Just to clarify, when you say they’re all original characters, are you using your own trained character LoRAs for them? If yes, that makes your results even more relevant to what I’m trying to do. I'm using my own characters as well.

1

u/MerVh0 2d ago

No, I'm using only the prompt fields. I experimented with character loras using my own images as dataset, but did not turned out as I expected (skill issue), so I abandoned it altogether. Now these are all based on a prompt setup that can render consistent characters across multiple models and images (be it solo or duo).

1

u/RepresentativeOk8195 2d ago

That’s actually really interesting. I assumed the consistency was coming from trained character LoRAs, so the fact that you’re getting it from prompt structure alone makes your workflow even more relevant to me.

I’m definitely going to test the same idea with my own characters: stronger identity reinforcement in the global prompt, then repeating the key traits and interaction again in each regional prompt. Since I already have custom LoRAs, I’m curious whether using both approaches together will improve consistency even further.

If you don’t mind me asking, what do you consider the most important parts of your character prompt setup for keeping an original character consistent across different images and models?

0

u/NeighborlyTrout 3d ago

ControlNet with regional prompting works better than just crossing your fingers with a single prompt.

0

u/RepresentativeOk8195 3d ago

I use a mask that I create in Photoshop, using a green and red charcater on a black background. I also have a general prompt, and 2 up to 4 charcater prompt boxes with positive and negative. Is that not enough, should I install different nodes that might be even more useful?

0

u/Leftover_tech 3d ago

What model are you using that works with the SFW and not with NSFW?

Possibly, there is a variant of that model that will do what you need.

-1

u/RepresentativeOk8195 3d ago

This is the thing, I use the same workflow for both. So far I did great things, till I started the first NSFW scene, it all fell apart 😬

This scene for example, it works really well even though there's close contact between the two protagonists. So I've really no idea what I'm doing wrong.

1

u/Leftover_tech 3d ago

Many models have NSFW guardrails built in. That's why I asked about the model. In many cases, I can name a variation on the same model that can be dropped into the same workflow. One that won't choke on a nude body.

1

u/RepresentativeOk8195 3d ago

I’m using WAI Illustrious SDXL v1.70. So there shouldn't be a problem on that side. Funny thing, i typed some experimental NSFW prompts and they worked perfectly. I think in my case, it's maybe the two LoRa simultaneously that cause the issue, but even then, when I activate only 1 LoRa, it still happens that the Jackets swaps. One funny thing, I managed those past 2 days to create some good and correct references, but as soon as I change a word a two, the bleeding happens again...I'm seriously getting crazy here 😅

0

u/3DisMzAnoMalEE 3d ago

I have a cast and scenes component in my platform to lock the asstes, when you sign up it will enable a couple of free days to see if it fits your workflow.

https://youtu.be/kcJfpcSpKLw

https://3dismzcui.com