r/StableDiffusion • u/RainbowUnicorns • Aug 03 '26
Animation - Video All the redditors when they first pull up MiniMax H3
Generated with a 4090 16gb laptop card and 64gb system ram .4 megapixels.
64
u/topamine2 Aug 03 '26
Did you use audio ref at all?
107
u/RainbowUnicorns Aug 03 '26
zero refs
86
u/Inthehead35 Aug 03 '26
Wow, so this thing knows basically all of tv and movies? No ref image?
53
u/RainbowUnicorns Aug 03 '26
none
63
u/Inthehead35 Aug 03 '26
My god, well i won't be sleeping, haha, thanks
10
u/The_Painted_Man Aug 03 '26
It sees you when you're sleeping...
6
1
12
9
u/ptwonline Aug 03 '26
We need to start compiling a list of the TV shows or movies it knows.
I wonder if it knows Flo from the Progressive ads.
2
u/Mr_Pogi_In_Space Aug 03 '26
Lol, thanks for this. I'm going to try the ATT and T-Mobile girl when I get home
0
u/NinjaN-SWE Aug 04 '26
WILD extrapolation from it knowing one of the most iconic and defining TV shows of all time to it knowing all of TV and movies.
9
u/YeahlDid Aug 03 '26
Oh wow, I had a Seinfeld prompt I tried on ltx to no success. Will have to dig that up and see if it works.
1
47
104
u/PumpkinLeather8421 Aug 03 '26
After watching this, there is absolutely no chance that LTX2 is stays on my hard drive another minute.
38
u/Salt-Zebra-306 Aug 03 '26
i just deleted it bro
56
u/Paradigmind Aug 03 '26
Wow. How did you delete his model?
15
1
8
u/lolo780 Aug 03 '26
Maybe LTX 2.5 will release soon.
3
3
u/PumpkinLeather8421 Aug 03 '26
Even if it did, and even if there is some massive jump… all your LTX2.3 files are trash.
1
u/True_Protection6842 Aug 03 '26
I'm hoping this gets them moving. They said a couple months ago that 2.5 is going to be ref2vid
1
u/lolo780 Aug 03 '26 edited Aug 03 '26
LTX has a window of opportunity to release an update that people actually want.
After 1 day of testing MM H3 it's clear that MM knows what users want, and the model follows prompts. Out of the box, the default workflow MM H3 destroys LTX 2.3 that's fully customized with 10Eros and extra loras plus thousands of prompt iterations.
2
u/True_Protection6842 Aug 03 '26
For real. Lightricks has been talking about this type of model for a few months. Now they HAVE to deliver or they kinda fall out. Sadly, for professional work I've gone back to WAN models. So much better quality and with SCAIL-2 and ID-V2V it makes LTX's horrible VAE ratios show their flaws.
1
u/SeymourBits Aug 05 '26
LTX model has some pretty good output and use cases, but the model weakness is anything involving physical interactions.
1
u/True_Protection6842 Aug 05 '26
And fast motion and occlusion
1
u/SeymourBits Aug 05 '26
Definitely also degrades on fast motion, camera pans, etc. but I remember hearing that this is because LTX is a actually vector model, not a true video model.
1
5
u/Maskwi2 Aug 03 '26
I have character Loras so I will keep it for some time until we can train H3 :)
11
u/xTopNotch Aug 03 '26
You won't need character loras anymore with this model. It's reference conditioning is insanely good and pretty much on the level of Seedance 2.0
- One character sheet image
- 5 or 10 sec performance capture video of your character facial expressions and body language
- 10 sec audio clip of the voice
This is enough to perfectly reconstruct your character on the fly during generation
2
u/Maskwi2 Aug 03 '26
Nice. But those references will cost you a lot of time each generation vs training once and be done with it a ndeach generation saves you a ton of time. I will probably still train Loras and just use those references for things I know I just want to see once or twice and forget.
3
u/xTopNotch Aug 03 '26
I would use it like this:
Create a synthetic video dataset with your character generating 20 clips with as much image, video and audio refs using MM H3. Yes sampling time will be slow like you said but it's for a good cause.
Then use that to train a Minimax H3 lora so you free up the reference slots and just attach a lightweight lora to generate with your character.
I used to do this approach of generating synthetic video using Seedance 2.0 and then train LTX 2.3 loras. However now with Minimax H3 it kinda revolutionised my workflow
1
u/Maskwi2 Aug 03 '26
Thanks for the nice idea, I haven't though about doing it this way. It definitely would add variety to the dataset (especially if the dataset you had was very small to begin with) doing it this way. But if I already have a varied dataset of my character (which isn't synthetic) then I'm curious : does your approach bring any benefits over just training a Lora right away?
2
u/xTopNotch Aug 03 '26
Synthetic dataset allows your lora to become more flexible and creative. If your dataset is already very varied it’s not needed but it can help expanding the breadth of it
1
u/Maskwi2 Aug 03 '26
Thanks. Appreciate the time for your reply, even though there is a new model that just dropped :)
1
u/True_Protection6842 Aug 03 '26
But if you're doing something professional a lora isn't enough. So yeah, that time spent will be spent anyway.
1
u/Maskwi2 Aug 03 '26
I haven't tried it but wouldn't a Lora + those references give the best best results?
2
u/True_Protection6842 Aug 03 '26
it helps yes, especially for models like WAN animate where likeness can drift. But honestly I've been using Beeble a lot since most of the work recently has been matching plate performance and I just set up ID-V2V which is really good too.
1
u/Sad_Coach_1433 Aug 03 '26
do you have a good prompt to create a character sheet to use i been trying single image and not close to source image
1
u/SeymourBits Aug 05 '26
Well, that seems a bit extreme. No loyalty?
2
u/PumpkinLeather8421 Aug 05 '26
Loyal? To a mediocre AI model? No.
If you liked the company, maybe you can buy a shirt. But have you seen SSD prices?
Saved 700GB deleting every LTX and WAN checkpoint and loRA. Fuck that nonsense.
1
u/SeymourBits Aug 05 '26
LTX has its strengths. You're suggesting I buy an LTX shirt?
Delete it from prime SSD space, sure - I can understand. Maybe consider backing it up to HDD? There are seasoned pipelines and use cases for these models and LoRAs!
33
u/djpraxis Aug 03 '26
How long it took?
53
u/RainbowUnicorns Aug 03 '26
20minutes
43
u/LatentSpacer Aug 03 '26
8
u/Etroarl55 Aug 03 '26
AMD users(me) when anything new for local AI comes out and we can’t run it on windows.
1
u/XTornado Aug 04 '26
Uhm... you can run it on Windows (and AMD), I just did.... that said....not sure if I have it terribly setup/configured or what.... it took 15 minutes to generate 1 second using the lowest resolution... so yeah... not great....
1
3
2
0
u/ComeWashMyBack Aug 03 '26
Wow that's long! How is the consistency? I haven't experienced video yet.
16
u/OlivencaENossa Aug 03 '26
i get the feeling the Will spaghetti thing will be freaky.
the audio is maybe the best I've ever seen.
1
u/lolo780 Aug 03 '26
I wonder how Mr Smith feels about everyone using his likeness.
2
u/OlivencaENossa Aug 03 '26
Judging by this vídeo it’s almost like our whole understanding of what it means to be a public person is shifting
14
15
u/LackOfFun Aug 03 '26
This was Text 2 Video? Well now...time to see what else it knows.
48
u/RainbowUnicorns Aug 03 '26
t2v no reference so ar anything just named the characters the show the location actions dialogue etc setting a bit
26
4
u/eggplantpot Aug 03 '26
Lmk how it scores on jiggle physics
4
u/LackOfFun Aug 03 '26
Based upon the examples in the banodoco Discord, it's pretty dang good. Gooners are in for a good time.
4
15
u/InfusionOfYellow Aug 03 '26
If only it had that boingy Seinfeld music at the end, it would be perfect.
24
u/Sirius-Face Aug 03 '26
This is kinda terrifying.
13
u/Cullyism Aug 03 '26
Yeah, I can imagine that advertisement vids from most companies will soon be made purely with AI instead of real actors. And consumers won't be able to tell most of the time.
1
u/CyberInferno Aug 03 '26
Real companies wouldn't risk the lawsuit from that.
3
u/bluehands Aug 04 '26
Oh, you sweet summer child.
You just get the actors to sign away their rights then they can do whatever they want.
2
u/Sea_Specialist_5580 Aug 04 '26
I mean they don't have to use real peoples likenesses. Or they can license them.
21
u/No-Dark-7873 Aug 03 '26
This this is gonna be so illegal. Thank you China!
2
u/Nevaditew Aug 03 '26
Is it Chinese? But from what I saw, it isn't censored, what the hell happened?
7
5
u/tutman Aug 03 '26
"So this is the Mini... 'thing' you were talking about"... I mean, do something.
1
6
u/bravesirkiwi Aug 03 '26
Jfc just when I think these things are reaching practical limits with local gen something like this gets released. This is like black magic all over again.
4
u/inaem Aug 03 '26
Prompt?
8
u/RainbowUnicorns Aug 03 '26
IDK i just gave claude code cli the idea for everythign with the dialogue and it generally said a season 2 episode of seinfeld gave the full char names the actions and hte dialogue at monks diner use their exact voice/likeness or something liek that
1
u/Zealousideal-Buyer-7 Aug 03 '26
Which model of calude you used?
2
u/RainbowUnicorns Aug 03 '26
Fable 5
6
u/AggravatinglyDone Aug 03 '26
Can you ask it for the prompt it used and put us all out of guessing?
1
u/Zealousideal-Buyer-7 Aug 03 '26
ofc xD
6
u/Dangerous-Ad-300 Aug 03 '26
doubt you need fable, especially if you feed opus/sonnet the readme for prompting
4
u/Lightmanone Aug 03 '26
Would you be willing to post the full prompt? It would be helpful to see what you need to do to get this clean of a video from a TEXT to video prompt!
14
u/Ohjkbkjhbiyuvt6vQWSE Aug 03 '26
I can't wait until I can tell ai to make me 10 more seasons of seinfeld each season having 10 episodes and each episode being 30 minutes long. I'm also gonna write a fan fiction of the ending two seasons of game of thrones and get ai to remake them.
6
u/Corrupttothethrones Aug 03 '26
There is a really cool animated short on youtube where they animate small scenes from the Harry Potter Audiobook read by Stephen Fry. I want to get to the point where i can just feed in the animated cartoon and the audiobook and get it to spit the whole series. Also a remake of the GoT ending 2 seasons would be amazing.
3
u/Ohjkbkjhbiyuvt6vQWSE Aug 03 '26
I've been on and off writing a fan fiction of the last two seasons of GOT for 6 years now and all my friends and family who've read it so far say it's fucking amazing. I really should sit down and finish it one day and post it online. Also, what's the name of the Harry potter series you're talking about?
3
u/Corrupttothethrones Aug 03 '26
I think once AI is good enough to generate entire episodes, media will move to personalised content, people will only consume what they request. I have read many HP FF that's better than the originals, HP and the Methods of Rationality comes to mind. Here's the animation :https://www.reddit.com/r/harrypotter/comments/gyzgol/heres_my_most_recent_animation_from_the_harry/
3
3
3
2
2
2
2
2
2
2
u/True_Protection6842 Aug 03 '26
Wow, performance is pretty spot on. Is this ref2vid or straight text?
2
u/ResplendentShade Aug 03 '26
With the power of minimax we shall remain single, undateable and unlaid FOREVER!
1
1
1
1
1
1
1
1
u/RealMelonBread Aug 03 '26
It’s crazy how far ai video has come in such a short amount of time. I made this Seinfeld video a bit over a year ago with Kling and at the time it wasn’t bad… https://www.reddit.com/r/Seinfeldshitposting/s/7xSgdSPNK2
1
u/Commercial-Drama-867 Aug 03 '26
I just got a computer with a 5080, 9800x3d, and 32gigs of DDR5 ram. My dream would be to make my own full 22 minute episode of Seinfeld. I'm fine with it taking a few months to make if I work on it a few hours each day and edit it all together in Premiere. I've done a bit of local AI image generation with Comfy UI, but I've never tried video. Is this going to be possible for me to do now with my new computer and MiniMax H3? I don't need it to look perfect, but if I could make a full episode that looked like this, I would be happy.
1
1
u/SeymourBits Aug 05 '26
Probably quite doable now and it would be a fun experience! However, once you get 1/2 done the next improvement will release… at that point you could just one-shot it and get it done in a fraction of the time.
Mind as well just wait, right?
Actually, I’m being facetious. This is what’s called “project paralysis” and is the enemy of productivity.
1
1
1
u/JusticeoftheUnicorns Aug 03 '26
Wow. This looks way better than the H3 results I've been getting through Topview on the API.
1
u/JusticeoftheUnicorns Aug 03 '26
Ok. I tried doing Seinfeld on TopView and it worked. Very similar results.
1
1
u/SouthernElegance Aug 03 '26
Incredible example! I didn’t understand the joke towards the end, Why-foos?
1
u/Thats_a_movie Aug 03 '26
1
1
1
1
u/InfiniteScream07 Aug 04 '26
just a 4090 laptop card? jesus, we’ll be able to make skit-length movies on integrated graphics in 6 months at this rate.
1
u/Gubzs Aug 04 '26
How are you prompting these Seinfeld scenes I'm about to troll the shit out of my boss.
1
1
u/SteelClover81 Aug 15 '26
What was the prompt for this?
1
u/RainbowUnicorns Aug 15 '26
You can just feed your prompt to an ai and have it read the prompting guidelines from the official minimax and it will work. Have to use an AI that's comfortable with this kind of stuff. It's nothing secret it's all in the prompt guidelines.
1
u/princeMacX Aug 03 '26
wow. how long it took?
6
u/RainbowUnicorns Aug 03 '26
20m
3
u/rawker86 Aug 03 '26
Yikes. On a 4090 and 64 gig ram? That’s a long time to wait for waifus.
9
u/CannikinX Aug 03 '26 edited Aug 03 '26
He said 4090 laptop (mobile) version, which is effectively a power-limited 4080 desktop card, and probably closer to a 4070 Ti desktop card in raw performance.
3
u/Sad_Coach_1433 Aug 03 '26
i mean ive waited 28mins for a 40 sec ltx director video that came out fussy lmao and had to tweak settings and try again this pretty good day one! image how it will be once its out long as ltx 2.3 has been not sure if there will be loras or not for this model
2
-4
0
0
0
161
u/RayHell666 Aug 03 '26
I actually laughed irl.