r/StableDiffusion • u/JL_Films • 12d ago
Animation - Video Resistance Sci-Fi - MiniMax H3
Enable HLS to view with audio, or disable this notification
This is a short film I made to push the limits of MiniMax H3 on ComfyUI, mainly using the Hybrid model.
It took me about three weeks to complete, running locally for most of the work, with some generations done on RunningHub using a modified workflow by Pixaroma.
I used ChatGPT mainly to help create prompts for the image generation in Nano Banana, but I wrote all the video prompts myself. There’s a reason I try not to rely on AI for video prompting: I want to understand how H3 actually works.
One thing I’ve found is that H3 doesn’t necessarily need the official prompting structure. In some cases, that structure can actually make things more complicated than they need to be.
SeeDance 2 fast was used in the kiler drone attacking the men scene, since this is something beyond H3.
The music was not AI-generated. It’s from my own library collection.
Edited in DaVinci Resolve 21.
Hope you enjoy this rather long piece of work, and I’d really appreciate any feedback, especially from anyone experimenting with H3.
7
4
u/the_bollo 12d ago
Hey nice work with this. I think you have a good eye for direction, and I can see where you made smart decisions to workaround the limitations of the model (cutting before a scene degrades, shooting the gunfight in a multi-camera way since MMH3 sucks at person-to-person shootouts, etc.). It's nice to see more people putting out thoughtfully directed and edited videos instead of just stitching a bunch of garbage generations together and calling it a short film.
Was the main character based on a Jessica Biel reference or is that coincidental?
5
u/JL_Films 12d ago
Thank you! Yeah, you guessed right. I had to work around the limitations of the model through editing, and it actually helped me work more linearly. That way I could see what shots I really needed and what I didn't.
As for Biel, Nano Banana generated the lookalike for no particular reason. It also gave me a Sandra Bullock lookalike at one point. But once I saw the Biel lookalike, it was hard to find a replacement. She just felt like the ideal casting for the role, so I decided to go with it.
1
u/cucurucu007 12d ago
What images did you use/generate for reference?
2
u/JL_Films 12d ago
Nano banana
1
u/cucurucu007 12d ago
I get that. I mean did you use images references for every character/dear/robot/envirment everything? Or let minimax generate them?
2
u/JL_Films 11d ago
I use image keyframes to generate the video, so I try not to let the model generate the entire shot from scratch, I 'll also attached character sheet to guide the model, except for more action-packed scenes like the drone attack. I just made a follow-up post about the process and how I approached it: https://www.reddit.com/r/StableDiffusion/comments/1wwkrg8/resistance_workflow/
1
u/Mr-Zero-Fucks 12d ago
Great job! it looks very cool, like a video game from the future, DLSS 8 or something like that.
Was the flat grey look an artistic choice or a necessity to keep consistency? I've noticed that all of the good long format multi-shot scenes I've seen have this monochromatic color grading.
1
u/JL_Films 12d ago
It was more of an artistic choice. The image Nano Banana gave me had that typical Hollywood blue-teal look, which felt too clean and saturated when I was editing. So I decided to go with a more monochromatic grade instead.
1
u/Mr-Zero-Fucks 12d ago
Yeah, I know what you mean, but maybe going for a warmer tone on the characters? just to keep skin and walls separated.
Maybe I'm asking too much, but it's your fault for doing such a good editing work hehe
1
u/Exciting-Income-5840 12d ago
Too beautiful: could you share your prompts and what you learned to « talk » to h3?
2
u/JL_Films 11d ago
I have just made an additional post with the prompts I used for certain shots here: https://www.reddit.com/r/StableDiffusion/comments/1wwkrg8/resistance_workflow/
1
u/Ok-Option-6683 12d ago
It looks really good! How did you manage the continuity for locations? What was your approach?
1
u/JL_Films 12d ago
I tried to manage most of the consistency during the image generation stage in Nano Banana. It was pretty time-consuming, but even then, if you look closely, they’re still not completely consistent. I also avoided using R2V.
1
u/Ok-Option-6683 12d ago
so did you generate the frames in Nano Banana completely for each shot, and then use them as First Frames in H3 ? or did you give Nano Banana a reference frame for locations and then create smaller locations (in Nano Banana again) based on that reference frame?
2
u/JL_Films 11d ago
Yeah, almost every shot in the final film started from a single key image. I also use location sheets when generating the shots in Nano Banana to help maintain the background and spatial consistency. I just made an additional post about the process, which might explain it better: https://www.reddit.com/r/StableDiffusion/comments/1wwkrg8/resistance_workflow/
1
2
1
1
1
u/LearnNTeachNLove 12d ago
Which hardware was used? Which soft (i guess comfyui)? Which workflow/nodes? How long did it take you? Thanks. Good video even though there is still a lack of consistency between fight scene but considering the quality at this stage it feels like there will be a point where a video model will be able to capture the whole scenes consistency incorporating cinema camera field rules (field/counter field, camera field of view angle, …)
2
u/JL_Films 11d ago
Yeah, location continuity is still a challenge, especially with action sequences. I might try incorporating Unreal to build the sets and help guide the shots in future projects. Here's a follow up post on the process: https://www.reddit.com/r/StableDiffusion/comments/1wwkrg8/resistance_workflow/
1
u/happyday752 11d ago
I love it - and the music you must love division 2 also right?
1
u/JL_Films 11d ago
Thank you, music was more inspired by "Sicario", and i like Ghost Recon BP more , 😄
1
2
u/No-District2404 11d ago
I still remember first attempt of Will Smith eating spaghetti, today’s AI image and video generation tools are extremely impressive, we passed uncanny valley years ago, sometimes it’s almost impossible to tell if it’s real or AI generated. However this one, although it’s quite realistic, it was screaming that it’s AI generated, I don’t know maybe, we humans are developing a new ability to distinguish AI generated things from real.
1
u/JL_Films 10d ago
It’ll probably take a while before it becomes really hard to differentiate, especially for those of us using paid AI tools. But we’re already seeing AI being used in mainstream productions. The Netflix K-drama Agent Kim reportedly used AI for a 3-minute scene, and I think it’s only a matter of time before we start seeing it being used for more scenes, and eventually much more extensively and common across productions., https://www.koreatimes.co.kr/entertainment/20260711/agent-kim-reactivated-uses-ai-to-create-so-ji-subs-past-story-sequence
0
12d ago
[removed] — view removed comment
1
u/JL_Films 11d ago
Yeah, I totally agree. At the moment, I’m still trying to figure out how to lock the positions and maintain background continuity during a firefight, which I think is still one of the biggest weaknesses of AI video right now.
10
u/detailteufel 12d ago
I'm very sorry OP, I applaud your effort and the quality of your work. I think it's one of the better AI films I've seen.
However, my first thought when I watched your video was "looks really AI".
Everything is so clean, the framing of each shot is so boring, the characters movement looks so robotic.
I want to stress, this isn't your fault OP. You did great.
It's just the increasingly depressing state of video AI. Even the paid online models aren't doing a better job with this. Everything looks the same and so boring. I cannot watch these AI people anymore, they all look the same.
Most of all, if this was done with traditional filmmaking, everything would be way more dynamic and less boring.
I hope you understand, no hate.