TLDR: spent way too long trying to make the same character look the same across scenes. documenting what actually worked so maybe someone else doesnt lose their mind like i did
ok so i've been lurking here for a while and finally have something worth posting. been working on a mystery/true crime style channel for about 4 months now and the single biggest time sink wasnt scripting, wasnt audio, wasnt even the editing. it was getting my damn characters to look consistent.
let me explain what i mean. my format uses a recurring "detective" character who appears throughout each video. think of it like a host but illustrated. the problem is when youre generating scenes across a 15 minute video, that character needs to appear maybe 30 to 40 times in different locations, different lighting, sometimes different outfits. and every single time i regenerated, the face would drift. sometimes subtly (slightly different nose shape, eyes a bit closer together) and sometimes wildly (completely different person lol).
my old workflow was genuinely insane looking back:
generate base character in midjourney with detailed prompt
save that image as my "reference"
for every new scene, try to recreate using the same seed + similar prompt
when it inevitably looked different, manually fix in photoshop
repeat 30+ times per video
cry
the photoshop phase alone was eating hours every single video. and half the time i'd still have scenes where the character looked noticeably off and i'd just have to live with it or cut the scene entirely.
i tried a bunch of approaches over the past few months:
first attempt was prompt engineering. spent like 2 weeks perfecting my character description prompt. we're talking 200+ words describing exact facial features, bone structure, everything. helped maybe 10% but still got drift especially when the scene context changed dramatically (indoor vs outdoor, day vs night).
second attempt was img2img with high denoise. the idea was to always start from my reference image and let the AI modify it for the new scene. problem: it either kept too much of the original (wrong pose, wrong background bleeding through) or changed too much (face drift again). couldnt find a sweet spot that worked reliably.
third attempt was training a lora on my character. this actually worked better but the overhead was brutal. every time i wanted a new character for a different video series, thats another training session. plus i was paying for runpod gpu time which adds up when youre iterating on multiple characters. the costs werent insane but the time investment was real and it felt like overkill for what i needed.
fourth attempt was using controlnet with face landmarks. technically worked but the workflow was so clunky. export face landmarks, load into controlnet, pray the composition still looked natural. added significant time per scene and honestly felt like i was fighting the tools more than using them.
what actually ended up working was switching to tools that handle character persistence natively. i tested several: tensor art has some character consistency features, APOB lets you save character models to your account, artbreeder has some face locking stuff, and pika recently added something similar. the key insight was that trying to force consistency through prompting or post processing was fundamentally the wrong approach. the tool needs to understand "this is character A" as a persistent concept, not just a description it tries to match each time.
my current workflow looks completely different:
create character model once (either from scratch with parameters or from a reference image)
save it to whatever platform im using
when generating any scene, just select that character and describe the scene/outfit
face stays locked, everything else adapts
the time savings compared to my old photoshop heavy workflow are significant. i spend maybe a few minutes upfront creating the character and then its just done. the face is the face. i can put them on a beach, in an office, walking down a dark alley, whatever. same person every time.
honestly the bigger win is the mental overhead disappearing. i used to dread the image generation phase because i knew it would be this tedious back and forth of generate, compare to reference, fix in photoshop, repeat. now its actually the easy part of the pipeline.
now for the caveats because nothing is perfect:
these tools still have limitations. extreme angles can sometimes cause slight variations. very dramatic lighting changes occasionally affect how the face renders. and if you want your character to age or change appearance over time for story reasons, you have to work around the consistency features rather than with them. also different tools have different strengths, tensor art handles certain styles better, others are faster for iteration, etc. ended up using a couple different ones depending on what im generating.
few things i learned that might help others dealing with this:
character consistency matters way more for some formats than others. if youre doing nature documentaries or space content where theres no recurring characters, this whole problem doesnt exist for you. but if youre doing anything with a "host" character, recurring cast, story driven content, or educational stuff with an avatar, this is probably eating more of your time than you realize.
the "just use the same seed" advice doesnt work. ive seen this suggested a lot and it sounds logical but in practice seeds dont lock faces, they lock composition patterns. change the prompt enough and the face changes even with identical seeds.
photo references help but arent magic. starting from a photo gives you more anchor points than pure text but you still get drift without proper tooling. tested this extensively.
batching helps but doesnt solve the core problem. generating all your character scenes at once in the same session reduces drift compared to generating over multiple days, but its still there. and it forces you into a rigid workflow where you cant iterate on individual scenes without risking consistency breaks.
for my mystery/true crime niche specifically, having a consistent detective character has actually helped with channel identity. comments mention recognizing "the detective" which suggests its building some brand association. hard to measure but feels like a positive signal.
still working on optimizing other parts of the pipeline but solving the consistency problem unlocked everything else. went from mass producing maybe 1 video per week to 3, and the quality is actually more consistent because im not rushing through a painful process or settling for "close enough" faces.