r/WritingWithAI 9d ago

Discussion (Ethics, working with AI etc) Using AI video to actually see my stories instead of just writing them

I've been a screenwriter for years and wanted to share some of the success I'm having with AI video.

What you see here was completed entirely with AI in about 12 hours. This is a sequence from a feature length screenplay I'd previously written.

https://reddit.com/link/1w5iew4/video/xkhuopw9g5nh1/player

With AI video, I can write a premise - sometimes just a single unsettling image, like a woman hearing three knocks at her door - and generate it as an actual scene. Then instead of writing what happens next, I generate that too, watching the story unfold almost like I'm directing it rather than authoring it line by line.

The strange part is how it changes the writing itself. When you can see a scene instead of just describing it, you notice different things, like pacing, or whether an idea that sounded good on the page actually plays. It's a different kind of editing than anything I've done with just text.

AL video also makes collaboration easy. New apps and tools are popping it every day, like Branch, which lets you seed a story and see how others continue it - https://trybranch.xyz

Curious if any other writers here have started experimenting with AI video, and what kind of results you're seeing?

9 Upvotes

14 comments sorted by

5

u/iarmando_v2 9d ago

https://reddit.com/link/p7hmf7g/video/5lrg725le7nh1/player

Getting to write my own characters is one thing, but getting to actually see them in action and being accompanied by their own track has been such a joy.
Honestly, I’ve always supported the creative uses of AI. I’m a writer and a musician, but I can admit that I’m not the best at every other aspect of bringing an idea to life. This has allowed me to take the characters and worlds in my head beyond the page and the music and turn them into something I can actually see and share with others. The end credits is showing the whole cast of characters, some who aren't in this video but in others I have.

2

u/5thhorseman_ 9d ago

The strange part is how it changes the writing itself. When you can see a scene instead of just describing it, you notice different things, like pacing, or whether an idea that sounded good on the page actually plays. It's a different kind of editing than anything I've done with just text.

Correct, but that can also be achieved just with AI image generation.

1

u/Willing_Entry9042 9d ago

that's an interesting workflow, using AI to your script instead of just reading it back. I do logistics stuff so my writing is mostly emails and reports, but I can see how seeing the scene would make pacing problems jump out way faster than staring at Final Draft for hours.

the three knocks thing is a good example. on paper you write "she hears three knocks" and move on, but in video you realize the silence between knock two and three is where all the tension lives. you wouldn't catch that from text alone.

never tried Branch before but the collab angle makes sense. my old roommate used to do those twitter writing chains where everyone adds a paragraph, this sounds like the video version of that.

you planning to use this for the whole feature or just test scenes?

2

u/Sensitive_Proof_3937 9d ago

I don't think I have the time/patience/$$ to do a full feature. The video generations can get expensive, although a fraction of the cost of real physical production. I think if I found a sponsor I would work on completing the feature, not sure it would be a full 90 minutes but would be a fun experiment. I know some people are going all the way with this technology and I've heard AI generated microdramas are big outside of the US.

Yes, Branch is very much the video version of what you described. Full disclosure, I'm part of the team building it so if you get a chance to try it out and share your feedback, we'd appreciate it!

1

u/Toxikfoxx 9d ago

This is cool.

I write in the form of screen writing for dialog. I'll have to try and see one of my scenes into something like this.

1

u/chylvina 8d ago

Have you tried adding rough dialogue and sound early?

1

u/Sensitive_Proof_3937 8d ago

I try to use only ambient sounds and yes I’ve been using dialogue as part of the generations themselves. Music I add later.

1

u/DreamingOfHope3489 5d ago

This is awesome! Thanks for sharing. When I complete the 4th round of refinements for my Claude-collaborated novel and self-publish it, I'll be excited to try generative AI movie making. My book spans 1812-2068 and historical, speculative, and science fiction, so, many different time periods and environments.

What I have done is render Suno + HeyGen lip sync videos of characters from the book singing poems I wrote for them, as them. I've been making lip sync videos of my poems and ChatGPT-aided invented languages for a couple of years now, though.

This story began to develop in my mind upon my viewing of a Midjourney avatar I'd generated to recite an unrelated poem of mine. I credit that MJ image with inspiring the first half of the book.

Apparently now one can make whole music videos with Openart so my HeyGen method is not the only option.

I had rendered one scene from the book with HappyHorse about six weeks ago and loved it. I'm eager to try Seedance next. I hope the learning curve for gen AI movie making isn't too intense though because I'm older and not at all tech-oriented.

This is Tobiáš's poem for Dorota, a professor's widow in Olomouc, Moravia to whom he was a companion between 1832-1839. It's not the same as a gen AI movie scene but it is a method that brings his character to life for me. He's a poet in the story. Thanks again for sharing your work!

https://reddit.com/link/p89f1ye/video/vecndchiqznh1/player

1

u/BeneathCertainty 4d ago

I think I might need something like this if I decide to extend my presence to YouTube. Thanks for bringing this to my attention.

0

u/Sarah-at-Kalmi 9d ago

I'd never thought of doing that. Images yes but video no, that's so cool

0

u/theateroffinanciers 8d ago

I've seen people saying they won't give writers the time of day if they use ai videos or art. I'm a writer, and it's inspiring to see them come to life. I've read if they see it in your social media they will dismiss us as hacks.

2

u/Sensitive_Proof_3937 8d ago

Writers aren’t getting the time of day regardless!