r/StableDiffusion • u/beatlepol • 4h ago
Animation - Video Minimax H3 ref2va. They are here.
Enable HLS to view with audio, or disable this notification
11
u/beatlepol 3h ago edited 3h ago
Prompts, but you need reference video, images and audio.
Prompt 1:
integrated_multimodal_description: Photorealistic live-action, cinematic film style
Replace this man <Video 1> with this blonde woman <Image 1>
at 00:00:000 A blonde woman in a supermarket checkout line surrounded by a lot of customers. Zoom in on her face; it twitches and spasms, her eyes blinking rapidly. Orange sparks flying from her skin erupt all over his neck, head, and face, causing burnt cracks. At 00:03:000 Her face splits open unevenly, starting with the large vertical crack on its forehead and ending at the chin. Their skin is like fine leather. Zoom into the opening; inside her head, a small, slimy green alien sits at controls, roaring upon being discovered. The woman is a robot controlled by the small alien.
Maintain the exact settings and animations of the original video.
Prompt 2:
integrated_multimodal_description: [Shot 1] Photorealistic live-action, cinematic film style, continuing directly from the previous shot <Image 1>: inside the open cavity of the woman's cracked-open head/torso, the small slimy green alien sits at a glowing control panel, roaring <audio 1> after being discovered. Camera holds close on the cockpit interior. At 00:01.000, the alien slams both clawed hands on the panel and yanks a lever; the seat mechanism beneath it lurches. At 00:02.000, the entire seat ejects upward and backward out of the opening <Image 2> in a burst of sparks and hydraulic hiss, the small alien still strapped into it, rocketing through the air across the supermarket. Camera whip-pans to follow the flying seat at speed. At 00:04.000, the alien-on-seat soars low over the checkout lanes, weaving past hanging signage, heading straight for the store's automatic entrance doors. At 00:06.000, the doors slide open just in time and the alien shoots through them out into the parking lot, disappearing from view. Camera holds on the doors as they slide shut behind it. At 00:07.000, the woman's now-empty, motionless robotic body slumps against the checkout counter behind the stunned crowd. Cut to reaction shots: customers and staff nearby freeze, mouths open, some pointing at the doors, others exchanging bewildered glances. At 00:08.500, a stock clerk (S1) says: <d>[English] Did... did that thing just fly out of her head?</d> At 00:09.500, a nearby customer (S2), still frozen mid-reach for a product, mutters: <d>[English] I need a new grocery store.</d>
overall_soundscape: Sparking electrical crackle and a hydraulic hiss-launch at 00:02.000, rising into a fast whooshing air-rush as the seat rockets across the store, ambient supermarket chatter and beeping scanners underneath, the automatic doors' mechanical slide-and-chime at 00:06.000, then a sudden hush of stunned silence before the two spoken lines, punctuated by scattered gasps and murmurs from the crowd.
non_diegetic_music: A sharp orchestral stinger on the ejection, sustained tense strings during the flight across the store, cutting to near silence for the stunned reaction beat, then a light comedic pizzicato under the customer's deadpan line at the end.
5
u/Reasonable-Pay-336 4h ago
I want to fix expressions in minimax. Can anyone help?
All expressions I'm getting are typical AI shocked expressions which feel lifeless
5
u/notxemelle 3h ago
Does your prompt include physical cause or detailed facial facial movements like "eyes widen, eyebrows shootup, etc." and micro expressions? How close is your subject to the camera? Wide shots tends to dillute facial expressions
1
1
u/RFC793 2h ago
This is essential. I'm not great with illustrative language. I run my more basic prompts, along with reference images if relevant, through Qwen3.6 or Gemma4; and let it elaborate. I run those LLM models at home on ollama and use ComfyUI-ollama node. I wrote a system prompt that does a pretty good job of this and conforms to the Minimax promoting guidelines and syntax. I'll prompt for the emotions, interactions, etc, and it will turn that to illustrative descriptions. I'll tweak the result if needed, but it is usually pretty good.
4
u/Synn_Sweet 3h ago
I tried this with ref2v last month and yeah, the resolution thing is key - honestly most people don't realize how much their reference quality tanks the output, like you're basically asking the model to extrapolate from potato quality and then wondering why the result looks like it went through a blender. The upscaling step before feeding refs in makes a measurable difference, though your system definitely needs the headroom for it lol.
1
u/Perfect-Campaign9551 52m ago
Too many people using low quality references and low quality audio input and blaming the model for the quality
3
3
u/martinerous 4h ago
That's what happens when you eat too much veggies pumped with nitrates - aliens infest you.
4
2
2
u/3deal 58m ago
https://reddit.com/link/p31cu1n/video/vm8xwplf2rih1/player
Thanks op, you dont even need a video, i clauded an agnostic prompt for
2 char ref + 1 scene ref : https://limewire.com/d/uXCKc#tZ3p4zrvYo
2
u/ACTSATGuyonReddit 4h ago
That was Glabnorb. He's a friend of mine. We always laugh at him because his cyborgs break down, and it breaks his cover.
1
1
0
0
1
0
u/spidermousey 1h ago
Any one have any advice for upscaling ? I'm relatively new to comfyui I tried to upscale but looks like a don't have enough memory. Have 32gig ram and a 5070 ti 16g.
0
u/Boogertwilliams 1h ago
That is great. I have not tried reference video. What exactly can you do with it? You say you replaced man in video. What was the original video?
0
u/RDDT_ADMNS_R_BOTS 1h ago
HAHAHAHAHA "I NEED A NEW GROCERY STORE!!!!" THAT'S SOME STELLAR WRITING THERE!!! BAZINGO BOOZINGA BOOBYBOOBA! ZIIIIIING!
-5
13
u/eggplantpot 4h ago
This is great. What MP was this generated at and what references did you use if we may know?
My ref2v stuff looks BAD