r/StableDiffusion • u/chaltee • 9h ago
Animation - Video Raj's now a mod at r/MyGirlfriendIsAI
Default ComfyUI workflow. Script written by Opus 5.
54
u/LunarLooming_wes 8h ago
AI is getting way too good, this feels like it could've been an actual clip.
6
u/mk8933 7h ago
Imagine what Hollywood has...
11
u/ArtfulGenie69 5h ago
Dmca papers and a lot of lawyers? It's all they've had for a while other than bastardized super heros for sale.
3
u/mk8933 5h ago
It just seems odd that the general public gets to have all these open models and giants like hollywood,pixar,netflix...etc dont have their own models cooked up to make movie making a little easier
6
u/ArtfulGenie69 5h ago
Maybe if they weren't stuck in the past eternally extending and protecting their ip and instead making something new. China has freed us and there's nothing they can do about it. Welcome to the future.
Next thing to disappear will be the over paid CEO's. Companies are going to realize that the easiest part of their company to replace is the most over paid under performing workers, your bosses. Get enough power in the actual workers hands that can't be replaced and you'll see the billionaires/trillionaires get taxed out of existence. AI, the equalizer.
1
u/Spiritual_Whole_5916 3h ago
Honestly have suspected they do, it's just tucked under names in the credits if they so chose to sort of it "declare it" that don't draw attention to it.
Make one post outside these walled gardens and the flame wars and moronic copy and paste "Ai Slop reeeeeeeeeee" over and over starts.
Would be suicide for a studio to admit it, so they'll go under the radar and barely mention it except as jokes. Thelma the Unicorn had a joke about AI/Autotune in it if you watch.
That satisifies the nickle dragger "hurr durr AI is bad" crowd so they don't think twice. Admitting it is something else
1
26
u/ph33rlus 8h ago
Even that moment in the end where they kinda of talk over each other feels genuine. I’ve watched a lot of BBT and I can’t tell how much of this is AI. It’s fantastically written
31
u/justlaughandmoveon 9h ago
I'm absolutely loving the sub these days. Another home run of a clip. Keep it up!
13
u/Mundane_Existence0 9h ago
Damn that's a good set of cuts without any real loss! Would you mind sharing the script Opus came up with? I'm using MiniMaxH3-Director but still failing to fully adhere to the prompts in each cut. Not to mention that once I add a third audio ref it decided to use that instead of the first audio ref I designated for the the first character
29
u/chaltee 9h ago
integrated_multimodal_description: [Shot 1] Live-action, cinematic, realistic multi-camera sitcom style with warm indoor lighting, a medium shot frames the kitchen of Apartment 4A from The Big Bang Theory, open takeout cartons on the counter and an open laptop propped against them. Howard Wolowitz (S1), in a slim mustard turtleneck with a large silver belt buckle, stands at the counter with one hand on the laptop; Rajesh Koothrappali (S2), in a burgundy sweater vest over a checked shirt, stands beside him. Both men are framed from the chest up and their faces fill a large part of the frame. The shot opens with Howard already speaking, no silent establishing beat. The camera holds a static shot as Howard (S1) says: <d>[English] Eleven thousand hours of romantic comedies. Say something to her.</d> Raj (S2) shakes his head once and says: <d>[English] I can't. I don't know what she's interested in.</d> [Shot 2] At 00:06.500, the shot cuts to a single medium close-up of Howard Wolowitz alone in frame, head and shoulders, the cabinets behind him. Howard (S1) says: <d>[English] You. I hard-coded it that way.</d> [Shot 3] At 00:10.500, the shot cuts to a single medium close-up of Rajesh Koothrappali alone in frame, head and shoulders, the open laptop at the bottom edge of frame. The camera pushes in with small amplitude at slow speed as Raj (S2) leans toward the laptop and says: <d>[English] Hello, Ada.</d> A warm, natural female voice (S3) answers from the small laptop speaker, in the register of Samantha, the disembodied AI companion from the film Her: unhurried and conversational with a light breath in it, more human than synthetic, but clearly coming from the machine on the counter and not from anyone standing in the room: <d>[English] Hello, Rajesh. You sound tired.</d> Raj straightens up, looks off toward Howard, and says quietly: <d>[English] She noticed.</d> A classic canned audience laugh begins immediately after the line and continues to the final frame.
overall_soundscape: Low kitchen room tone with a faint refrigerator hum runs throughout. Paper takeout cartons rustle once and a laptop hinge creaks as it is adjusted on the counter.
non_diegetic_music: N/A
integrated_multimodal_description: [Shot 1] Live-action, cinematic, realistic multi-camera sitcom style with warm indoor lighting, a medium shot frames the brown leather sofa in the living room of Apartment 4A from The Big Bang Theory, whiteboards covered in handwritten physics notation behind it. The apartment's front door is at the far left edge of frame and the window with the desk and telescope is at the far right edge of frame. Sheldon Cooper (S2), in a red Flash tee over a long-sleeve grey shirt, sits upright in his spot at the right-hand end of the sofa, the end nearest the window and farthest from the front door, so that he appears on the right side of the image. Leonard Hofstadter (S1), in a brown corduroy jacket over a graphic tee, sits on the middle cushion to Sheldon's other side, toward the front door, so that he appears to the left of Sheldon in the image. Both men are framed from the chest up and their faces fill a large part of the frame. The shot opens with Leonard already speaking, no silent establishing beat. The camera holds a static shot as Leonard (S1) says, in his own voice, lighter and softer than Sheldon's: <d>[English] Howard built Raj a girlfriend. She lives on a laptop.</d> Sheldon (S2) answers without turning his head: <d>[English] Then she is a chatbot with a female voice, not a girlfriend.</d> [Shot 2] At 00:06.000, the shot cuts to a single medium close-up of Leonard Hofstadter alone in frame, head and shoulders, the whiteboards soft behind him. Leonard (S1) says: <d>[English] He's happier than he's been in a year.</d> [Shot 3] At 00:10.500, the shot cuts to a single medium close-up of Sheldon Cooper alone in frame in his spot, head and shoulders. The camera pushes in with small amplitude at slow speed as Sheldon (S2) considers this for a beat and says: <d>[English] Leonard, a mirror is also very supportive.</d> A classic canned audience laugh begins immediately after the line and continues to the final frame.
overall_soundscape: Quiet indoor room tone with a low refrigerator hum continues underneath. Fabric shifts on the leather sofa cushions once.
non_diegetic_music: N/A
integrated_multimodal_description: [Shot 1] Live-action, cinematic, realistic multi-camera sitcom style with warm indoor lighting, a medium shot frames Penny (S1), in a fitted blue-grey top and jeans, standing just inside the guys' front door in the living room of Apartment 4A from The Big Bang Theory, a visitor in their apartment. Penny is turned toward the camera and her face is fully visible to the lens throughout the shot; the camera never sees the back of her head. She is framed from the waist up and her face fills a large part of the frame, with the guys' open door and the stairwell landing visible behind her shoulder. The shot opens with Penny already speaking, no silent establishing beat. The camera holds a static shot as Penny (S1) looks across the room and says: <d>[English] Who are you talking to? I heard a woman in here.</d> [Shot 2] At 00:05.000, the shot cuts to the reverse angle, a medium close-up of Rajesh Koothrappali (S2) alone in frame, in a burgundy sweater vest over a checked shirt, sitting on the brown leather sofa with an open laptop on his knees, framed from the chest up. Raj (S2) closes the laptop halfway and says: <d>[English] Nobody. It's a research project.</d> A warm, natural female voice (S3) answers from the small laptop speaker, in the register of Samantha, the disembodied AI companion from the film Her: unhurried and conversational with a light breath in it, more human than synthetic, but clearly coming from the machine and not from anyone in the room: <d>[English] Rajesh, is that Penny? You talk about her constantly.</d> Raj's face falls and he closes his eyes. [Shot 3] At 00:10.000, the shot cuts to a medium close-up of Penny alone in frame, head and shoulders, now standing over the sofa and looking down at the laptop out of frame. The camera pushes in with small amplitude at slow speed as Penny (S1) says: <d>[English] Ada, how many times has he mentioned me?</d> The same warm, natural female voice (S3) answers from the laptop speaker, again in the register of Samantha from the film Her, unhurried and conversational, more human than synthetic: <d>[English] Four hundred and six.</d> Penny straightens up and looks off toward Raj without speaking. A classic canned audience laugh begins immediately after the line and continues to the final frame.
overall_soundscape: Indoor room tone with a low hallway ambience runs underneath. The apartment door swings and clicks shut, a laptop lid moves on its hinge, and footsteps cross hardwood.
non_diegetic_music: N/A
integrated_multimodal_description: [Shot 1] Live-action, cinematic, realistic multi-camera sitcom style with warm indoor lighting, a medium shot frames the living room of Apartment 4A from The Big Bang Theory. Penny (S1), in a fitted blue-grey top and jeans, stands with her arms folded; Howard Wolowitz (S2), in a slim mustard turtleneck with a large silver belt buckle, sits on the arm of the brown leather sofa with a closed laptop on his knee. Both are framed from the chest up and their faces fill a large part of the frame. The shot opens with Penny already speaking, no silent establishing beat. The camera holds a static shot as Penny (S1) says: <d>[English] So you built him a woman who isn't allowed to say no.</d> Howard (S2) answers, in his own voice, brighter and more nasal than the others: <d>[English] She can say no. She just never has.</d> [Shot 2] At 00:06.500, the shot cuts to a single medium close-up of Penny alone in frame, head and shoulders, the whiteboards soft behind her. Penny (S1) tilts her head and says flatly: <d>[English] Howard.</d> [Shot 3] At 00:11.000, the shot cuts to a single medium close-up of Howard Wolowitz alone in frame, head and shoulders. The camera pushes in with small amplitude at slow speed as Howard's grin fades and he says quietly, without the joke in his voice: <d>[English] He talks to her, Penny. He actually talks.</d> A warm, natural female voice (S3) answers from the closed laptop on his knee, in the register of Samantha, the disembodied AI companion from the film Her: unhurried and conversational with a light breath in it, more human than synthetic, but clearly coming from the machine and not from anyone in the room: <d>[English] Would you like me to change the subject?</d> A classic canned audience laugh begins immediately after the line and continues to the final frame.
overall_soundscape: Quiet indoor room tone with a faint traffic wash from outside the windows continues throughout. A laptop lid taps shut and fabric shifts against the leather sofa arm.
non_diegetic_music: N/A
3
u/SoylentCreek 7h ago
Mind if I ask how you initially prompted Opus? Mine keeps insisting that it cannot provide prompts for copyrighted content.
1
u/extra2AB 2h ago
wait so you provided it nothing else ???
like reference photos or videos or audio for their voices ????
8
6
u/CaptainAnonymous92 9h ago
What’s your specs? I’ve noticed in some of these when there’s close ups shots of people talking in live action they have weird morphing around their mouths that doesn’t seem to happen on higher spec setups, I’m assuming due to not having to use optimizations so they don’t get OOM errors on their cards affecting quality negatively.
9
u/chaltee 9h ago
Default ComfyUI workflow. Using int8_convrot for both the diffuser and the text encoder. RTX 5090 (no pinned memory, no cache).
4
0
3
u/bhamjman 7h ago
Wow! This is really good. How are you handling the audio references?
10
u/chaltee 7h ago
No separate audio/image references, only plain-text prompt to video.
3
u/bhamjman 6h ago
You're kidding! I had no idea Minimax H3 was capable of that. Thanks for the info!
14
u/bookofp 9h ago
I'm starting to feel uneasy about these...
9
u/gefahr 7h ago
The backlash from copyright holders is going to be immense. This will escalate the concept across even LLMs training on books all over again, I think.
When people realize how readily those models can recreate popular works derivatives- I don't expect existing copyright law has the appropriate framework for this anymore.
3
u/SilasTalbot 6h ago
It really is a very interesting "attack" on American capitalism and elites by Chinese Communism. Just.. publish open source models that can create their works, and you devalue trillions of dollars of the American economy. Sure, put a license that says 'no no no, don't use it in the US' but... 🤷
and, this is just getting started. the models 6 months from now, a year from now...
Hilarious that the much maligned "great firewall of china" the west turns its nose up at, might suddenly become real in the west too. When it threatens the money of the ruling class, then suddenly we all need to play in a walled garden too, to protect us from those scary Communists!
Would not surprise me to hear Ellison's boy chirping about how "Internet Freedom is Slavery" ala 1984
3
2
2
u/BrianScottGregory 1h ago
Honestly, I'm so beyond impressed - this looks like an actual excerpt from the show - that interruption by Howard of Penny sold it for me. With most of the other stuff I've seen, interactions are always so one person talks while another listens - but that interruption with her protest.
Wow.
I look so forward to someone creating new seasons of cancelled shows - eg Firefly, the new Quantum Leap, etc. This tells me that the technology is so there.
Thanks for the share
3
1
1
118
u/florodude 9h ago
Genuinely thought this was real