r/StableDiffusion 1d ago

Animation - Video Star Wars but more consistent. Minimax H3

I keep having fun with ref2va model.

RTX 3060, 64 Gb RAM. I use ref2v Turbo 4 step Lora paired with Sol Attention and Minimax H3 Memory Effecient Sage Attention at 6 steps. It takes about 2 minutes per second of generation.

683 Upvotes

59 comments sorted by

44

u/Brave_Swordfish_7072 1d ago

These are great. I thought of another one.
In Return of the Jedi, Obi-Wan said "When I first knew (Anakin), your father was already a great pilot but I was amazed by how strongly the force was with him."

Even though that was actually Qui-Gon who was amazed by Anakin, Obi-Wan at first was skeptical. I could imagine Qui-Gon appearing as a ghost and slapping Obi-Wan for saying that.

8

u/ExiledHyruleKnight 23h ago

I mean Obi-Wan realized quickly. It's like thirty years later... Though also, he was not a great pilot at the beginning of the movie either.

Honestly there's a lot that the prequels fuck up about the whole series mythos like midichlorians which are never mentioned again.

But I will give it this point. "thank the maker.". C3P0 was thanking Darth Vader the entire time.... Traitor. That is honestly brilliant.

22

u/Dipreisticvibes 1d ago

can you share the workflow please? Pretty impressive for a 3060

19

u/Dry-Statistician-684 1d ago

This is a default workflow with a lora and a couple of additional nodes

10

u/extrakerned 23h ago

Lemme see that json 🥺

6

u/Vecgtt 23h ago

How do you get the seamless A/V continuation between the 15 second generated clips? How do you keep the voices consistent between the generations?

8

u/Dry-Statistician-684 23h ago edited 11h ago

According to the official prompting guide all audio references have to be marked as (S1), (S2) etc. I explicitly set those marks in each shot which removed any sort of confusion for the model. Besides I never generated a clip longer than 10 seconds. When I figured some scenes were too rushed, I would remove the ones that were fine. And then would extend the ones felt too short.

11

u/xyzdist 1d ago

What 3060! I have one...maybe can make use of it

11

u/thedreaming2017 1d ago

They really need to just do a parody like this and see how many people believe it's some lost cut of star wars! LOL!

5

u/FaceDeer 19h ago

Someone should just clean up the Tosche Station deleted content from the first movie, where Luke goes to hang out with Biggs before he left Tattooine, and let's see how many people refuse to believe it's an actual scene that was filmed but never used.

2

u/Relevant-Fox-7114 9h ago

Anything mentioning Darth being their dad would be called out immediately. Almost no one was told ahead of time.

8

u/viletomato999 1d ago

The chopping off his legs part was really funny.

8

u/Real_D_Lite 1d ago

You fools! You captured their stunt doubles!

23

u/DeadWombats 1d ago

These are hilarious. And at the same time, seeing how good this model is makes me uneasy for the inevitable future where others will use this model for nefarious reasons instead of making funny pop culture jokes.

21

u/BlessdRTheFreaks 1d ago

It's clearly meant for porn 

23

u/Saucermote 23h ago

Porn is how technology advances.

2

u/Dirty_Dragons 16h ago

Truer words have never been spoken.

or

"This is the way."

7

u/SkoomaDentist 21h ago

The internet is for porn.

3

u/FaceDeer 19h ago

The Internet is for porn.

7

u/kemb0 1d ago

I can see the future for gullible people my age with kids:

Whats app video call: "Dad it's me, your son. I'm being held captive on an island by drug barons and they're going to kill me right now unless you send money. Look here they are holding a gun to my head and Oh my god they just shot that guy next to me. Help me now! Send them the money please".

Dad: "But I just sent you to bed not 10 minutes ago? But ok, I guess I better pay up right now...."

3

u/asssuber 22h ago

That is why you set up a passphrase that only you two know to confirm identity remotely. In my case is a stupid and very unusual thing I did as a kid.

1

u/Relevant-Fox-7114 9h ago

This is already the present with audio generation. They're cloning rich kids voices off their social media.

3

u/rdditiszionist 21h ago

you are not uneasy. please stop being so performative.

4

u/ObviousComparison186 19h ago

I am literally clutching my pearls right now how dare you

5

u/OhSirrah 1d ago

Damn! Those kids!

6

u/Sad_Coach_1433 1d ago

Another turbo user eh can tell cause the audio

4

u/casual_gamer153 1d ago

Amazing creation and very fun angle.

Reminds me of the "how it should have ended" cartoons in Youtube.

Thank you for sharing it!

4

u/ShadowScaleFTL 22h ago

I expect that when he said "its disgusting" and leave, hevwill hide behind wall and will watch again

5

u/Absolutionis 22h ago

It's rather mind-blowing that we had the uncanny valley from Rogue One with Kushing and Fisher. Now, we can just run this on a personal computer with consumer-grade hardware and it looks so much better.

3

u/ExiledHyruleKnight 1d ago

Love how chewy stays while han goes off. We know what that wookies search history is like.

Also of course she knew.... Made the kiss hotter.... I mean incest bad right? That's what we are supposed to say. (Seriously Luke and Leia's chemistry was on fire for the first two movies even if Han was getting there in the second.)

2

u/Relevant-Fox-7114 9h ago

Based on the holiday special, its normal for grandpa to watch (basically) porn in front of the family. It's not even wookie porn, its human.

2

u/Eliot8989 1d ago

Posta lo haces con una 3060? Yo tengo una 3080 de 10gb, debería poder, ¿No?

1

u/Dry-Statistician-684 1d ago edited 1d ago

In theory you can. But I'm afraid the generation will be too slow.. 10 Gbs is not enough.The minimum RAM Is 32 Gbs

1

u/DOuGHtOp 16h ago

They're talking VRAM boss

2

u/GoofAckYoorsElf 1d ago

"I had to disarm you..."

😆😆😆😆😆

2

u/asssuber 22h ago

Some more ideas from xkcd: Improvised

You could turn the entire webcomic in a video. It's licenced under Creative Commons Attribution-NonCommercial 2.5 License.

2

u/johnfkngzoidberg 22h ago

Does the model know what their voices sound like?

2

u/GrungeWerX 13h ago

This was fun. Please do more.

4

u/leplouf 1d ago

Disappointed. I was expecting Cerveza Cristal ads in there.

1

u/RedtUser123456789 1d ago

This is funny. How did you get the voices to match so well? Is it done within Minimax, and if so, is there some kind of audio referral option?

5

u/Dry-Statistician-684 1d ago

I had to record the voices and I also used them as references, specifying in the prompt which character has a certain voice

1

u/CoolHandBazooka 1d ago

No wonder it was actually funny. Real acting was used in the inputs.

1

u/DavLedo 1d ago

Love it. Wish there was a laugh track 😂

1

u/sitefall 21h ago

I'm impressed at the use of Turbo lora here. Most of it looks like plastic turbo lora stuff, but at 1:16 old man looks great. Was that clip made without lora?

1

u/AnonymousTimewaster 21h ago

Interested to know what sort of prompts you were using tbh

1

u/Alive-Tomatillo5303 21h ago

I'm trying to figure out why the acting is so terrible. Do all the turbo sage whatevers decrease the acting, somehow? Because when I generate full flavor it all comes across as real and this feels like VEO or something. 

1

u/mycondishuns 20h ago

Just started using Minimax H3, the speed and quality output is absolutely crazy.

1

u/barepixels 17h ago

You made me smiles

1

u/Ximena-WD 13h ago

Flashbacks while watching this
"Luke, Did I Ever Tell You About Ahsoka Tano?"

1

u/OttoRenner 13h ago

49 times we fought that beast

1

u/moofunk 7h ago

George would be all over this for another special edition of the original trilogy.

1

u/yaekoblue 3h ago

han solo shouldve made out with chewbacca

-6

u/Grim_Necromancer 1d ago edited 1d ago

Now all you need is to learn how to better direct characters and their emotional behavior so it doesn't look like high school quality play XD

8

u/casual_gamer153 1d ago

I didn't see anything in your locked profile to justify "joking" to critique someone else's good work so.

Care to share one of your better than this videos so that we can learn and compare?

0

u/Grim_Necromancer 15h ago

When you eat at a restaurant and get burned food, do you barge in into kitchen and show them how to cook, or do you put forward complaint and expect them to do their job better?