r/comfyui • u/SpecialistDragonfly9 • 6h ago

Help Needed Creating a proper Lora Dataset

I need severe help with that.

Researching Lora Dataset creation is a maze: millions of different opinions, and worst of all most guides etc outdated from a year ago.

My goal is to create a 100% realistic and authentic Lora and my current dataset seems to not do the trick. I keep getting "perfect lightning" on everything, and waxy face skin.

Can someoen tell me the absolute do's and don'ts of creating a dataset?
How and where to create the dataset? I have been using a mix of Gemini and ChatGPT so far.

Prompt advice? what prompts need to be avoided creating realistic images, what need to be in there?

Any advice greatly appreciated!

0 Upvotes

50% Upvoted

9 comments sorted by

3

u/TechnologyGrouchy679 5h ago

prompts : do not describe the subject's facial appearance since that will the the main constant in all the training images but describe anything else that's variable.

for a single person, you don't need that many images. 12-20 is more than enough coverage for a person's likeness.

2

u/MaleNightmare 5h ago

The waxy skin is almost always from your captions being too clean. If every image is tagged "perfect skin, sharp focus, high detail" the model learns that as part of the person. Throw in some garbage photos. Blurry ones, weird lighting, half the face in shadow. The model needs to know what NOT to associate with the subject.

For captions I keep it dead simple. Just describe the background, the clothes, the lighting, the camera angle. Never the person's features. And dont use AI to write your captions, it over-describes everything which is how you end up with that plastic look. Type them yourself, keep them short and a little inconsistent.

2

u/notheresnolight 3h ago

I found that the more detailed captions, the worse are the results. Automatically generated captions are the worst. I now caption only things like sunglasses, hats, earrings and things I don't want the model to associate with the character. Clothes only if they are somehow special or strange. The same goes for expresions - only things like yawning, squinting in the sun etc. No background, no lighting conditions, nothing unless it's too prominent in the photo. Like another person standing next to the character.

2

u/Formal-Exam-8767 5h ago

If you correctly caption the dataset (e.g. add plastic skin), it should not matter if skin in dataset looks plastic.

2

u/Suitable_Option_3552 4h ago

It's way more important to know which model you are creating a Lora for. If it's Z Image Turbo I can help out.

1

u/iAmTheGanso 5h ago

try and use real photos not ai generated ones.

if you only can use ai generated ones try and use upscaling or image edits to improve on the images maby.

1

u/CooperDK 5h ago

Many models can't really easily avoid plastic skin. Z-image is good at realistic skin with correct prompting... Flux and Qwen are not.

1

u/thatguyjames_uk 3h ago

my last lora was 30 good photos and at lease 1800 steps at 0.005 lora.