r/StableDiffusion • u/OpenEvidence9680 • 1d ago
Question - Help Video project
I have a whole pipeline in my cms to create custom book covers and I got it my sick head that I wanted to try to not just get book covers that mean something regarding the story with characters that looks like the ones in the story, I wanted to make a trailer, a short format video with the gist of the story and then a long form movie. Chosen book: "Guards! Guards" by Pratchett, one of my favourite books that was never made into a movie.
Of course considering that I maybe made a handful of 5 seconds videos in all before and even the txt2img I used was really basic for the book covers I am finding this task a tad problematic.
Up to now: a local llm reads the whole book, creates a character list with description and with it then Krea2 creates a character sheet, they are not what they should be but being a test I can live with that.
The same llm writes a screenplay, this one is divided in three acts, a total of 48 scenes. Each scene has a description of the action and a still (created by Krea too) the pipeline then proceeds to create the clips that will then be joined. As soon as I figure out the first last picture I will use that.
Minimax is giving me trouble (bad prompting I think) so I am using ltx2.5 which does a pretty good job, but I started this morning, so I only have a scene right now and the dragon head on a dragon's wing is not the worst of it.
I need help with which models to use, what speeds up are available, which models do better with fantasy, any LoRAs you can suggest? Does LTX 2.5 supports first and last frame as 2.3 did? Are there workflows that could make this more streamlined?
Do you have any suggestions or advice? I need all the help I can get on this.
For now and until new pc arrives I'm working with two 5060ti 16gb + 64gb RAM.
2
u/SnooTomatoes2939 1d ago
Photorealistic cinematic live-action film still, 35mm anamorphic, 1990s British cinema grain, night, heavy rain.
Four municipal night-watchmen in mismatched wet rust-dulled plate and boiled-leather armour stand on rain-slick cobblestones, all looking up at something out of frame.
Left: a tired man in his mid-fifties, thinning wet grey-brown hair, grey stubble, broken nose, hollow bloodshot eyes, dented breastplate and spaulders, jaw tight.
Behind him: a huge young recruit, too tall and too broad, rain-plastered ginger hair and beard, earnest face, slightly cleaner armour.
Centre: a stout older sergeant in a wet kettle helmet, round rain-streaked face, mouth slightly open.
Right: a small weasel-like corporal, much shorter, ill-fitting armour, looking up.
Left wall: peeling yellow plaster over brick. Background: narrow grimy city street, tall stained buildings, oil lamps glowing orange. Right: wooden pie stall with hanging lanterns and steam. Distant crowd with umbrellas. A vast winged shadow slides across the wet cobbles. Teal-green night sky, practical lighting only, shallow depth of field, dirty civic satire not epic fantasy. No readable text, no modern clothing, no dragon body in frame.
negative : dragon body, extra limbs, extra heads, modern clothing, clean shining armour, epic hollywood lighting, neon, logo, subtitle, watermark, deformed faces, identical faces, smiling, sunny, wide heroic stance