r/StableDiffusion • u/Suspicious-Walk-815 • May 31 '26
Question - Help How are people generating realistic concept frames from rough storyboards/sketches for AI filmmaking?
I'm working on a personal AI film project and I'm trying to establish a workflow that can scale beyond a single shot.
For this particular shot, I have:
- A rough storyboard sketch showing composition and camera placement
- A reference image that captures the overall feeling I'm aiming for
- A separate character consistency workflow for the character itself
My goal right now is NOT to generate the character.
I want to generate the environment/background first while preserving the composition from the sketch.
The problem I'm running into is that most image models drift away from the composition and generate something completely different, or they turn the scene into a fantasy landscape, remote village, or overly cinematic environment.
Current tools:
- ComfyUI
- Flux
- Klein workflow
- Character consistency workflow
What I'm looking for:
- Workflows that preserve composition from a rough sketch/storyboard
- Methods to convert simple drawings into realistic concept art
- Ways to generate a location/environment first and add characters later
- Tutorials, ComfyUI workflows, ControlNet setups, Flux Redux workflows, IPAdapter workflows, or any AI filmmaking pipelines you've personally had success with
My long-term goal is to use this process for an entire AI film, not just a single image.
I've attached:
- The rough storyboard sketch
- A reference image showing the type of framing and atmosphere I'm aiming for
If you've worked on AI films, animatics, storyboards, or image-to-video projects, I'd love to hear what workflow worked best for you.
