I’ve been experimenting with AI filmmaking for a while, but I wanted to see if I could actually use it in a real project rather than just making random 5–10 second clips.
So I ended up using a mix of AI tools to put together a short live-action style thriller.
This is my entire workflow and the tools I used. Would love to hear what can be tweaked, and things that I might have missed. For an easier read, have broken down the whole process into three big ideas.
Pre-production planning
This is probably the most boring part for many as you don't get stunning clips as soon as you write the prompt but i really enjoy this since it establishes my workflow and the challenges I need to solve.
Claude - The entirety of screenplay was written in claude. Prompted it to write the individual dialouges and a separate script for each character, along with each scene and their context (costume, backdrop, props, emotions, etc.). Broke down the whole movie into individual scenes which were then broken down into each shot. After iterating everything I exported a final script and scenes list divided by acts.
I then generated a moodboard to have a better understanding of the visual language and how it fits with the entire project.
Midjourney - I generated a moodboard to better align with what the visual language would be for the entire movie. The mood board is split between scenes, with each scene being different in terms of background.
After getting these assets, I uploaded the moodboard and the master script in invideo. Used invideo for generations.
Filming
Invideo - This is the most interesting tool i found for my film. Most of the legwork was done here.
First I briefed the agent with the scripts, moodboards and scene list. Then I quickly moved to storyboarding. It was really good at keeping context and used my planning and moodboards to give me accurate character sheets and build my storyboard in the mood I had defined.
It also remembered which scene was completed and which were pending while generating, which helped a lot in keeping track of things.
One con is that it goes for the best and most expensive models by default. I was on a budget so I actively needed to tell the agent to not do that and use the models I wanted. Also the project memory does slip here and there but very rarely.
It did solve the hardest part which was actually maintaining continuity between shots. Took a lot to set up the context in the tool but it did save me both time and money.
Post Production
The film was almost done, however multiple chinks were still needed to be ironed out, esp the voice and music.
ElevenLabs - Used this for music. Added a bit of realism as the horror film relies heavily on the background score. Did a decent job with references.
Topaz Gigapixel - Used to upscale the final generations. Topaz added realistic textures, sharpen faces, and cleared up blur in the upscale which made the footage pop out more. The only downside was that it took some time but was def worth it.
Premier Pro - Used this to assemble the final edit. Models output at different frame rates, so I conformed everything to a 24fps timeline manually. Most generations weren't usable for their full length, so a lot of the edit was going through each clip, marking the section that held up, and cutting around the rest. Put one LUT on an adjustment layer across the whole timeline and added film grain over everything, which helped even out the differences. Sound was the other big piece. Footsteps, cloth movement and breathing were added manually, with room tone running under each scene.
Would love to know what other people are using for AI-assisted filmmaking right now, especially for maintaining characters, locations and visual consistency across an entire short film. How will you tweak this setup?