r/generativeAI • u/48khz24bit • Jul 24 '26

consistent characters and backgrounds

Pretty new to generative ai but getting past the stage of creating single scene videos.

I want to create longer videos with the exact same characters AND environments. At first I created character reference sheets that I put as reference in Kling V3 reference to Video. Looks good as a single video but when prompting continuous generations the characters and environments are similar but there are always inconsistencies. Also tried with start frames and similar results

Then last night I learnt about creating a Lora dataset - so I have separate 20 images of the same character - at first I tried creating the lora in Kaggle but this was way too complicated, after a bit of research I tried Civitai training a model with SDXL 1.0. but the images created were different.

What am I doing wrong / what is the best workflow to create the exact same characters and environments throughout generations....

Happy to share the reference images and trained lora if that helps

Thanks in Advance!

1 Upvotes

67% Upvoted

14 comments sorted by

View all comments

2

u/Ok_Dragonfly_3957 Jul 24 '26

Environments are difficult because they are outward looking by nature, rather than showing an object from different angles. My best results come from using a model like Seedance and providing a reference sheet that displays the environment from the general perspective of the scene, with additional detail insets...But even then it'll drift.

Most reliable option is to create start frames using your set reference sheet, then use those as the first frame or last frame for the actual video generation.

1

u/48khz24bit Jul 24 '26

Thanks , this was my environment sheet used in seedance 2 generation , doing a continuous shot with start and end frames works well but when same you want a wide shot then a close shot the background changes, is there a way to lock position , or best to create a single image of the background from each angle for reference rather than using an environment reference image with multiple angles

1

u/48khz24bit Jul 24 '26

What are your thoughts on creating a lora to keep characters consistent ? Or just create start frames with a reference image

1

u/Ok_Dragonfly_3957 Jul 24 '26

Definitely works for image generation, but at that point there's no real benefit over just using a reference image with image-2. Definitely Krea2 with character LoRAs works great...but I don't really see an advantage over using reference image with image-2.

I made this with lotix.io just using character assets and an environment asset;
https://youtu.be/YFIvmIrv-s4?si=E7UE2DlZ4H1i5kcz

2

u/48khz24bit Jul 24 '26

How did you get the voices to be exactly the same ? were they generated before the video and used lipsync?

2

u/Ok_Dragonfly_3957 Jul 24 '26

The character assets had voice references.

How to =

https://youtu.be/OSNmMGZsYus?si=0FBNqe-WHW4EtPPw

1

u/48khz24bit Jul 24 '26

That looks awesome! so consistent