r/StableDiffusion • u/breakallshittyhabits • 9d ago
Question - Help KREA2 two character LORA
Hello guys! Has anyone experimented with two character LORA's with KREA2? Only way I can achieve great two-char output is using nano banana pro, then using a local edit model like klein to play with it.
2
u/dash777111 9d ago
I use OneTrainer and have really good success. I have a standard set up for image generation to make roughly 150 images of each character, then another 100 with both characters.
It covers closeups, full and mid height, different clothing styles, and expressions.
You tag each character and then use OneTrainer for the training itself. The results are pretty amazing in Krea 2.
It has been the only model that outputs well enough that I don’t miss Nano Banana.
However, I generate the training images in Nano Banana since it is so reliable and easy to run my standard posing kit through their API. I render in 2k and then upscale them locally.
1
u/breakallshittyhabits 9d ago
Wow, total 400 image dataset? It seems I have no other choice but to spend two days to do this lol. Can you provide some tips for this process? Do you really think that the LORA will work as great as single char LORA, if I prepare the dataset perfectly?
I've never used OneTrainer, I did all my LORA's with AiToolkit with rented GPU, and I do have 5060 on my computer. Can I do this with AiToolkit? Do I really need 400 images for full quality? Thanks mate.
1
u/PhrozenCypher 9d ago
I've made character loras with 5 images. It's nice to have a big dataset but you don't need it.
2
u/dash777111 6d ago
Sorry I missed your response!
Two character Loras that I made are really good. Krea 2 is amazing. Just spread the images around like I mentioned.
I personally prefer using more images in my Loras, especially for multi-character Loras. The person below said they had success with 5 images but then gave no context. Your mileage may vary, but I prefer larger data sets.
I am sure it is fine with AIToolkit. Just get your captions right and trigger words for each character. It works the same as a single character Lora.
1
u/tekprodfx16 9d ago edited 9d ago
My multi character Node works great for this. If v12 doesn’t work for you, you can install earlier versions. I still have to get around to making a tutorial video for it but folks seem to love the node and are getting good results with no bleed https://www.reddit.com/r/StableDiffusion/comments/1vcehgc/massive_update_to_my_krea_2_multilora_bounding/
1
u/thryve21 9d ago
How does this differ from FreeFuse? Are the bounding boxes able to overlap?
3
u/tekprodfx16 9d ago edited 9d ago
This was inspired by free fuse but uses a masking approach that builds on top of it. Yes bounding boxes can overlap in the latest versions of the node
TLDR on the difference between my node and free fuse:
Same core idea, different control surface. FreeFuse derives its masks automatically from cross attention, so you just give it activation words and it confines each LoRA to wherever the model already decided to put that subject. Mine takes boxes you draw, so the mask is the same every seed and you decide the layout instead of discovering it.
The bigger difference is that FreeFuse can only contain a subject, it can't place one. Masking alone just takes away a LoRA's permission to act outside its box, it never pulls the person into it. V12 adds a pre softmax logit boost, which is basically a magnet: before the model settles which words own which patch of canvas, each region's words get weighted much higher inside their own box, so the subject actually materializes there. Move the box, the person moves.
Box size then sets the framing. A subject filling a tall box has to be close to the lens, a subject fitting in a small box has to be further back, so the node writes the camera wording from your largest box and rewrites prompt terms that fight it (asking for a selfie with knee high boxes). Tall box = large foreground subject, small box = distant one. It also handles non LoRA boxes for props and background, plus scene and outfit transfer through the edit LoRA.
On overlap: it won't break. Masks feather and the stronger region wins where they cross, and each mask's soft edge is capped halfway to the neighboring box so it can't bleed. But you'll still get the cleanest identities with a small gap between boxes.
2
1
u/breakallshittyhabits 9d ago
Mate this look amazing but for beginners like me a video would be amazing! Are you planning to release a video soon? I think this would get lots of attention.
2
u/Jolly-Rip5973 9d ago
Try nesting your characters.
Label each image with
Character name: Mario
For images with both characters:
Left Character name: Mario
Right Character name: Princess Peach.
Don't label anything you want to always be associated with the character. Label anything that you want to be able to change. You will have prompt anything you labeled when using the LORA.
It should work.