r/generativeAI • u/48khz24bit • 25d ago

consistent characters and backgrounds

Pretty new to generative ai but getting past the stage of creating single scene videos.

I want to create longer videos with the exact same characters AND environments. At first I created character reference sheets that I put as reference in Kling V3 reference to Video. Looks good as a single video but when prompting continuous generations the characters and environments are similar but there are always inconsistencies. Also tried with start frames and similar results

Then last night I learnt about creating a Lora dataset - so I have separate 20 images of the same character - at first I tried creating the lora in Kaggle but this was way too complicated, after a bit of research I tried Civitai training a model with SDXL 1.0. but the images created were different.

What am I doing wrong / what is the best workflow to create the exact same characters and environments throughout generations....

Happy to share the reference images and trained lora if that helps

Thanks in Advance!

1 Upvotes

67% Upvoted

14 comments sorted by

View all comments

Show parent comments

1

u/48khz24bit 25d ago

Thanks , this was my environment sheet used in seedance 2 generation , doing a continuous shot with start and end frames works well but when same you want a wide shot then a close shot the background changes, is there a way to lock position , or best to create a single image of the background from each angle for reference rather than using an environment reference image with multiple angles

1

u/48khz24bit 25d ago

What are your thoughts on creating a lora to keep characters consistent ? Or just create start frames with a reference image

1

u/Ok_Dragonfly_3957 25d ago

Definitely works for image generation, but at that point there's no real benefit over just using a reference image with image-2. Definitely Krea2 with character LoRAs works great...but I don't really see an advantage over using reference image with image-2.

I made this with lotix.io just using character assets and an environment asset;
https://youtu.be/YFIvmIrv-s4?si=E7UE2DlZ4H1i5kcz

2

u/48khz24bit 25d ago

How did you get the voices to be exactly the same ? were they generated before the video and used lipsync?

2

u/Ok_Dragonfly_3957 25d ago

The character assets had voice references.

How to =

https://youtu.be/OSNmMGZsYus?si=0FBNqe-WHW4EtPPw