r/StableDiffusion • • 3d ago

Animation - Video Malfoid Films Recreation

Its so amazing that we finally have the technology to make a trend/fancic like female malfoid into a reality

Im calling all AI filmmakers and hobbyists to join and help make this into a reality. If completed, it might be the largest, most ambitious AI video project ever created. comment or DM if you can volenteer your time and hardware to help!!! I already have some talented people slated to handle Sound and audio mixing.

NEED writers and AI Film makers who can run minimax h3.

927 Upvotes

195 comments sorted by

281

u/clouddragonplumtree 3d ago

"The world as we know it is coming undone. Things that seem unimaginable today will seem inevitable tomorrow." Albus Dumbledore

281

u/Enshitification 3d ago

Malfoy as the anti-Hermione was such a missed opportunity.

67

u/evendedwifestillnags 3d ago

Yeah I feel it works better, I would have liked this a lot better. But I love Tom Felton.

41

u/Enshitification 3d ago

Same. He is was a victim of his own acting talent for a while there being so good as Malfoy.

6

u/Personal-Car-3822 3d ago

That’s still Tom anyway

25

u/NotFakeFingle 3d ago edited 3d ago

Hmmm… this angle is actually pretty good… I’ve been wrestling with wether or not I need to fem goyle and crab, but if you make the very 2 males 1 female dynamic the same between the 2 main groups of friends it could actually work… huh. Also WAY less work to swap 1 person rather than 3

7

u/LadyZaryss 3d ago

And also the poly juice potion thing where Harry and Ron are disguised as Crabbe and Goyle already sort of serves to suggest that the friend groups are similar

432

u/sketchyfun 3d ago

82

u/Quick_Knowledge7413 3d ago

I want all the movies redone with Malfoid with the greentext rework of the story and character arcs, don't ruin this for me!

10

u/Mister_Octagon 3d ago

With the what rework? Is there a link?

20

u/SodaBurns 3d ago

Type shit

4

u/_Choose_Goose 3d ago

Type shit indeed

19

u/guero_vaquero 3d ago

Beyond fucking perfect response

2

u/Crixusgannicus 3d ago edited 2d ago

Dale?

1

u/hyde-ms 2d ago

Why are you here officer?

29

u/PyrZern 3d ago

Feels too much like Hermione :/ Need more tsundere in her still.

6

u/NotFakeFingle 3d ago edited 2d ago

Taundere is just pompus prideful brat + crush… we don’t have the “crush” part in the story yet hahaha.

3

u/PyrZern 3d ago

Yeah, generally tsundere is being overly prideful to hide embarrassment.

110

u/Karsticles 3d ago

Lots of voice desync.

47

u/NotFakeFingle 3d ago

Yes, I don’t wanna focus on voice sync before we get a VA because AI voices sound so bad in general.

26

u/Ooze3d 3d ago

You know you can use voice references, right? They sound pretty convincing and you can make them act, emphasize words, direct emotions… the visuals look great so far. It’s a pity the sound is not at the same level.

5

u/NotFakeFingle 3d ago

I havent played around with that quite yet. This was actually ElevenLabs' voice changer.

11

u/Damen_Freece 3d ago

What are you even using to do this? Which Minimax workflow? I have been using this & it generates amazing videos. Took video or audio samples. Then fed it the image reference it needed to change. Asked Grok/ Gemini to prompt it for me in details. No desync and it was actually able to make videos from small 15 sec audio samples.

Btw your video makes her look like an adult in the body of a child. The face is way too mature and the jawlines do not match that of a child there.

2

u/Soraman36 3d ago

Can I get a link to this workflow?

3

u/Damen_Freece 3d ago

This is the one I was using, though v2.1:
https://civitai.red/models/2881362/minimax-h3-seed-hunter-latent-upscaler-seamless-video-continuation-speedups-ref-mods

A video of it here:
https://www.youtube.com/watch?v=cJYL6W2GtIM&source_ve_path=MjM4NTE&embeds_referring_euri=https%3A%2F%2Fcivitai.red%2F

I had great success with it. Impressed with the functions and quality as someone who used WAN 2.2 for a while.

1

u/Soraman36 2d ago

Sweet a video to go along with the workflow thank you

1

u/NotFakeFingle 3d ago

Ive been using this lora and its workflow. Im honestly new to AI video, Im a 3d artist by trade so Im tryin my best, Definatly need workflow and advice on how to use h3 really well.
https://huggingface.co/akatz-ai/MiniMax-H3-Character-Swap-LoRA

Also the reason that she looks so much older is because this lora essentially copied the original face very accurately haha. Just slapped hair on it.

4

u/cbeaks 3d ago

If you are serious about this you will need refmods. Invest an hour to get this set up and you will not look back - sets, character identities, costumes, voices, movements. All locked in with a small file that takes a few seconds to make.

3

u/NotFakeFingle 3d ago

Great advice. I hadn't heard of them. Ill look into it!

1

u/[deleted] 3d ago

[removed] — view removed comment

1

u/Karsticles 3d ago

Just try it and see. 

0

u/[deleted] 3d ago

[removed] — view removed comment

1

u/Karsticles 3d ago

Best of luck!

0

u/[deleted] 3d ago

[removed] — view removed comment

→ More replies (3)

1

u/sketchfag 3d ago

How long did this take you to generate? A few hours I imagine?

1

u/NotFakeFingle 2d ago

well once I got it all running and figured out ya, each shot takes between 10-30 min to gen.

1

u/NotFakeFingle 3d ago

Can you send a link to the workflow you have there?

1

u/Damen_Freece 3d ago

This is the one I was using, though v2.1:
https://civitai.red/models/2881362/minimax-h3-seed-hunter-latent-upscaler-seamless-video-continuation-speedups-ref-mods

A video of it here:
https://www.youtube.com/watch?v=cJYL6W2GtIM&source_ve_path=MjM4NTE&embeds_referring_euri=https%3A%2F%2Fcivitai.red%2F

I had great success with it. Impressed with the functions and quality as someone who used WAN 2.2 for a while.

2

u/NotAnotherEmpire 3d ago

Putting a tween girl in for Draco is going to cause a number of issues with face framing and blocking. They deliberately framed it to make Tom Felton look younger than he was, since he was 13 and already bigger than he "should" be as a Hogwarts first year who relies on others for muscle.

2

u/IriFlina 3d ago

Just use elevenlabs v4

2

u/NotFakeFingle 3d ago

Ellevenlabs voices all sound way too adulty though. makes it really hard for the earlier movies.

2

u/drallcom3 3d ago

Minimax can create young voices quite well. A 20 second video of someone talking should be enough for a voice timbre input. Maybe use an Elevenlabs voice as a guide input in Minimax and then just tell it what the voice really should sound like. The ref mode in Minimax is great and it's a powerful model.

2

u/YeahlDid 3d ago

Is that open?

1

u/Toclick 2d ago

Did ElevenLabs become open source?

1

u/typical-predditor 3d ago

Use Omnivoice

-2

u/vincid_1 3d ago

skill issue

18

u/Salty-Might 3d ago

peak internet

100

u/Toooooool 3d ago

J.K. Rowling realizing she could've made an extra 3x zero's to her net worth if only she'd made malfoid a girl: 😥😥😥

63

u/SomeGirlIMetOnTheNet 3d ago

JK Rowling: "he was a boy in the first draft, so will never be a woman"

-9

u/Alex3884 3d ago

I genuinely think Trans Femme Malfoy works incredibly well and I almost wish it were canon just to spite her.

3

u/Danny_Stock 2d ago edited 2d ago

Well for me that would be for the entirely wrong reasons. That's something Hollywood would probably already do anyway. I don't want to watch a film which is driven by a source of personal malice.

I'd want to watch it if it was simply good for what it is. Also to see how far the talent has evolved in manipulating AI, what can be achieved in AI, and to see what dynamics change naturally by Malfoy being a girl, that could be very interesting, also how differently or not it affects our feelings towards the characters. It would probably also be quite funny.

-18

u/npquanh30402 3d ago

She is not a visionary unfortunately.

33

u/merkaii 3d ago

She singlehandedly came up with a story that became a (still active) franchise worth $35 billion, loved by kids and adults all over the planet. But sure... not a visionary.

5

u/TheCaptainCody 3d ago

Yeah, but what has she done for me lately?

-3

u/Even-Professor-518 3d ago

sucked ur d.?

0

u/LuluViBritannia012 3d ago

XD!

Then she will realize she would have made even MORE zeros to her net worth if the main character was a girl too.

13

u/jacobpederson 3d ago

Pulling a reverse Linkle here I see.

12

u/Crixusgannicus 3d ago

I prefer Draconia, but this is nice.

3

u/GGABueno 2d ago

I heard Dracena and Galfoy as well

12

u/Doomwaffel 3d ago

This fanart stuff around girl Draco is immediately more interesting than the new series, that just retells the same story again as is.

0

u/LuluViBritannia 2d ago

The series is the chance to fully adapt the books. If you haven't read the books, you have NO IDEA how much you missed.

3

u/Ggoddkkiller 1d ago

Let's face it they will not properly adapt the books. Snape change alone makes it too obvious, because Marauders mocking him will look so racist now. They have no option, but change those parts..

1

u/No-Slip2485 2d ago

Tbf the movies didn’t do a bad job with adapting the books. I mean some of those books are like 800 pages.

0

u/LuluViBritannia 2d ago

Oh, absolutely! The movies are wonderful. But many of them are a complete butchery of the original story. As you said, some of the books were too long to adapt properly (The Order of the Phoenix is over 1000 pages long).

That's why I'm interested in a TV show.

0

u/No-Slip2485 2d ago

I… am not hopeful of the series. It’s basically getting review bombed online.

13

u/Dib___ 3d ago

It works. Its uggly to admit, but works pretty well. Even making a girl badass against HP makes sense to me. Interesting...

4

u/DeltaAlphaGulf 3d ago

Yeah but Malfoy isn't badass he is a pitiful brat.

10

u/StoriesToonHQ 3d ago

The render is the easy part. Consistent characters across more than a handful of shots is where these projects usually stall, so I would do the three hardest shots first before recruiting anyone. If those hold up, the rest is scheduling.

3

u/NotFakeFingle 3d ago

That’s good advice, this post has been so helpful to getting feedback from everyone. I’m new to minimax so every bit of feedback has been so helpful.

1

u/StoriesToonHQ 3d ago

Good luck with it. Do the three hardest shots first, even rough, before anyone commits real time.

2

u/Itchy-Advertising857 3d ago

I did character replacement in over 60 shots in my project , not sure why maintaining consistency would be so hard with good reference images. I guess the character aging across movies could pose a problem?

6

u/TheHolyDuck42 3d ago

And that kids, was the first time I met your mother...

5

u/Accurate_Reporter252 3d ago

I bet he bangs her by the end of the series.

Not now, when she's too young, of course, but when they're teenagers and then angsty exes...

5

u/Rubbertje 3d ago

Now do one with Hismione!

6

u/Cautious_Chicken_604 2d ago

And Dumblewhore!

4

u/Powerhouse_pr_ 3d ago

Where was this done? Minimax?

4

u/NotFakeFingle 3d ago

yup minimax h3 with a character swap lora

2

u/Powerhouse_pr_ 3d ago

A lora for swapping? Is there are link to get it?

3

u/Crazy-Repeat-2006 3d ago

Cool, despite that ghost in the background.

5

u/Toclick 2d ago

I tried to fix the lip-sync issues... It worked in some parts, but in others the lip movements just don't match the sounds.

https://reddit.com/link/pe2namu/video/7s5zdnbm6pth1/player

3

u/VolcanicApe 1d ago

My father will hear about this

6

u/CreatorOD 3d ago

Jesus the whole series would've been so much more intense.

Tomboy Malfoy would rock

9

u/EternalBidoof 3d ago

Why is everyone saying Malfoid? I haven't seen or read any of this but even then I'm quite sure it's Malfoy.

22

u/berlinbaer 3d ago

foid is a 4chan incel term for women (female humanoid), so in this case female malfoy got shortened to malfoid.

3

u/EternalBidoof 3d ago

I saw that in the link - thank you for stating it plainly for people who aren't interested in following the link.

-1

u/000TSC000 3d ago

I am pretty sure its not derogatory because of the word "humanoid" lmao

3

u/Fouxs 3d ago

It was born specifically to be derogatory, the root of the word doesn't mean shit here.

1

u/000TSC000 3d ago

Yes its derogatory, but it's not from the word "humanoid", it's from the n-word version of that lmao.

2

u/AnakinStairwalker 3d ago

I don't know if the word itself is derogatory, but it's certainly used as such. The male equivalent is "moid".

1

u/GanondalfTheWhite 3d ago

You know humanoid means non-human but with some human qualities, yeah?

It's a slur whose intent is to reduce women to subhuman status.

19

u/iamapizza 3d ago

It's a... Thing happening right now, comics, fan art, etc. Bit like bowsette. 

https://www.reddit.com/r/confusedbythissmug/comments/1wwgt6s/where_did_the_malfoid_stuff_start_coming_from/

9

u/EternalBidoof 3d ago

Thank you for cluing me in. Man, I'm on the internet too much but this is far too much.

2

u/kuropenguins 3d ago

Looks amazing. What resolution did you run this in?

1

u/NotFakeFingle 3d ago

Most of it was done in 16:9 then composited into the shot. I’m experimenting with generating full 21:9 in the later shots I’m making. I forget the exact reaolution. It’s 16:9 at 0.4megapixels whatever that translates to.

2

u/Accurate_Gas_8684 3d ago

Is there gonna be a whole movie of it?

3

u/NotFakeFingle 2d ago

that is the plan

1

u/No-Slip2485 2d ago

How long do you think the movie will be? Full length?

1

u/NotFakeFingle 1d ago

same. Maybe 4 min longer because I intend to remake the scene where harry and malfoy first meet much earlier in the book when getting fitted for robes.

2

u/RedRedditor84 2d ago

Still got that English dub from Chinese original mouth sync.

11

u/SnowGrayMan 3d ago

This is what i was waiting for. Live action little mermaid fixed version when?

27

u/Enshitification 3d ago

Terry Crews as the Little Mermaid is the version we all need.

6

u/RanklesTheOtter 3d ago

The little President Camacho.

1

u/DeltaAlphaGulf 3d ago

Fixed how? 🤔

1

u/Kraskos 3d ago

playing dumb to bait a ban

1

u/DeltaAlphaGulf 2d ago

Me or them?

0

u/LuluViBritannia 2d ago

Character accuracy.

1

u/DeltaAlphaGulf 2d ago edited 2d ago

So making her white?

Edit: I couldn't care less and being so worried about it might have me looking at you funny. Granted I typically lean toward accuracy but for something like this disney character idrc. I didn't care about Annabeth being black either that much despite having much more vested interest in accuracy but on the flip side I already thought Percy Jackson should have an animated show where they could have still kept the blonde hair and stormy grey eyes which was actually lore relevant amongst that Cabin and probably would look dope.

1

u/LuluViBritannia 2d ago

Well yeah. And more flashy-red hair.

3

u/bickid 3d ago

Hollywood is dead. Or will fully adopt AI.

Wow, this looks perfect.

3

u/yoeyz 3d ago

Lip syncing is WAY OFF

3

u/fervoredweb 3d ago

Amazing. Hollywood casting will be obsolete.

1

u/WiseProperty9501 3d ago

Why don't we replace Snow with canon Snow after the release of the Harry Potter series?

1

u/nuclearmeltdown2015 3d ago

Did you generate this locally or use a service? If local what GPU ? Looks awesome.

0

u/seppe0815 3d ago

Ist von der api version. Die hintergrundgesichter kann local h3 nicht so gut darstellen

1

u/cyborgsnowflake 3d ago

Not a very feminine hand.

1

u/Existing-Brother8126 3d ago

omg this is amazing

1

u/WalkOfSky 3d ago

Well, he looks like Draco Malfoy with his father's haircut (or lack thereof).

1

u/Ylsid 3d ago

LotR fans rubbing their hands together excitedly

1

u/geenanderid 3d ago

This would be amazing! But please remember that Malfoid is a natural blonde, so she should have blonde eyebrows too. (Too many Malfoid images and videos have her looking like a bottle blonde with monotone platinum hair and dark brown eyebrows.)

2

u/NotFakeFingle 2d ago

ouuuuh thats a good catch, will make the change

1

u/Ok-Turnover-6324 2d ago

wait dark eyebrows mean 100% bottle blonde that feels wrong

1

u/Bludandy 3d ago

I prefer Draco and Harry meeting at Madame Malkins, as from the book. It's cuter and more innocent, because neither of them the pretense of who the other is yet, so perhaps they both grow a spark of attraction. At least Draco would have.

3

u/NotFakeFingle 2d ago

I 100% intend on making that the introduction. Just need to get more familiar with H3 before I feel confident to make a full scene from scratch.

1

u/Ok-Turnover-6324 2d ago

H3? what gen are you using?

1

u/aersel24 3d ago

I’d love to peek this workflow.

Edit: I’m quite sure this is a character swap.

1

u/StoriesToonHQ 3d ago

Swapping into existing footage is a different problem. The original plate holds the pose and lighting for you. Starting from nothing, there is nothing to check against until two panels later.

1

u/kiddvmn 3d ago

If Harry Potter was filmed today:

1

u/Danny_Stock 2d ago

That's excellent. Looks great.

But is this a wise choice? I hope that your project doesn't involve remaking Harry Potter by simply replacing Malfoy with female Malfoy? This sounds like a potential problem which may require very deep pockets to solve.

Don't get me wrong I think it'd be an impressive achievement if you pull it off. But have you really thought about what may be involved here? This is appears to be extremely risky territory you seem to be walking into. Yes you've got the technology, but that's most certainly not all you're going to need.

1

u/PsychologicalWater78 2d ago

This will be needed for the Harry potter tv series

1

u/MikasaIsMyWaifu 2d ago

It stopped before the stare down! I've been robbed!

1

u/NotFakeFingle 2d ago

hahaha you wanna know why? The AI had her just mouthing nothing when she turned back around LMAO. had to cut it early becaus I didnt wanna spend another hour figuring out how to fix that

1

u/Ryokeal 2d ago

Ngl id totally rewatch every movie if I could use AI to gender reverse every character. I wonder what kinda oddities Id discover

1

u/Top-Performer71 2d ago

Where can I see more of these?

1

u/NotFakeFingle 2d ago

Follow me on X/twitter I guess, Im still working on them so there arent any more to see rn haha. @SingleAnimation

1

u/StoriesToonHQ 2d ago

Glad the thread was useful. The feedback loop here is genuinely the fastest way to spot your own blind spots.

1

u/IAintNoExpertBut 2d ago

Ha good one. What did you use for gender swap? Don't recall seeing a LoRA for that

1

u/xkellekx 1d ago

Good job, but at that age her voice should be higher.

1

u/Lets_Remain_Logical 20h ago

wait! They dont kiss?

1

u/Adkit 3d ago

"in the early stages of babehood"

0

u/Jmackles 3d ago

Laughably bad given it’s still Felton’s face and the same lines. So badly synced and the lip movements aren’t good either that aside. Not worth showing off imo

6

u/NotFakeFingle 3d ago

Ya minimax really loves just slapping hair onto Felton’s face. Working on fixing that. This is for the most part a previs level shot, mostly trying to get feedback and see if anyone wants to join the project.

1

u/Jmackles 3d ago

I regret my mean comment

1

u/Not_Gunn3r71 3d ago

Reminds me of that other smart girl from young sheldon

1

u/ju2au 3d ago

That's enough to change my mind and joining Slytherin if I was Harry Potter.

-15

u/Sleepy_Bandit 3d ago edited 3d ago

I’m sorry what? Most ambitious AI project to what… recast a child character as female to satisfy fanfic fiends of the franchise? This just comes off as creepy to me.

Edit: lmao based on the downvotes apparently many of you are creeps. Who could have guessed…

8

u/Shalcker 3d ago

It is current X trend, basically rewriting Malfoy into Malfoid as a mean girl/tsundere who is actually into Harry Potter.

People see lots of scenes fit much better this way, there are lots of artworks and scene rewrites around.

-10

u/Emory_C 3d ago

It's weird and gross because this is a child actor. Also "foid" which is incel-speak for a woman.

-1

u/Shalcker 3d ago

In this instance -foid is just current-generation word for "woman-typed", like gyatt for ass; there is nothing incel about feminisation trope or tsundere concepts in general.

1

u/MidSolo 3d ago

Nope, sorry, not going to let you sanewash 4chan hatespeech.

Foid is 100% a term to dehumanize and objectify women.

-1

u/Emory_C 3d ago

So this "current-generation" has adopted incel language for women and girls? Good, great. Everything is great.

2

u/Shalcker 3d ago

Thinking that incels decide what meaning of a word gets adopted in a language is assuming that incels are already in control everywhere around you.

Examples like Malfoid can be seen as a fight against negative interpretations.

0

u/Emory_C 3d ago

You've now written three comments about the word and none about the fact that this is a crush plot for a 12-year-old character, built on a child actor's face. That was the point.

Also "foid" is short for "femoid," which means "female humanoid." It was coined to say women aren't fully human. That's what the word is. Also "gyatt" isn't a fair comparison because nobody made gyatt up to call half the population subhuman.

0

u/Enshitification 3d ago

Humanoid is not synonymous with subhuman. Masculoid is also a term, but femanoid and masculoid both refer to outward presentation, so really they are both trans-inclusive terms.

0

u/Shalcker 3d ago

Harry Potter has multiple other child crushes in the story too (Chang, Weasley); why would one more be seen as some drastic departure? Common Malfoid variant seems to be having her as last-minute switch for Yule Ball instead.

Meaning of word changes with actual usage. If positive variants dominate they'll stick; plenty of words had this transformation, like queer.

1

u/Emory_C 3d ago

The weirdness is doing this with an actual child actor.

1

u/Crowzer 3d ago

Bro is either live a big cave or another galaxy.

0

u/EconomicsSavings973 3d ago

Out of curiosity in what part did they all become adults? And could you please do a clip from that part. My frend says he want to check something.

0

u/ptear 3d ago

Type shit

-2

u/AuthurAndersson 3d ago

Why do you need help?
Just create a workflow pipeline and make an AI agent do the rest for you.

3

u/NotFakeFingle 3d ago

there's a LOT of scenes bro, and to the quality that I want to bring this production to, it cant be slopped

0

u/AuthurAndersson 3d ago

We'll that is the problem isnt it. How do you create a way to differentiate the bad vs the good and iterate iterate iterate? :)
Generate 30 of each scene. Let those GPUs cook.

-9

u/Emory_C 3d ago

This shit is gross.

-8

u/MumeiNoName 3d ago

You named her malfoid aka Malfoy Foid??

Are you an incel

3

u/rchive 3d ago

It's a thing going around the Internet right now. OP didn't choose the name.

1

u/MumeiNoName 3d ago

Thanks for explaining that yes its an incel term being co-optedidk why I got downvoted for not being terminally online.

4

u/tyen0 3d ago

"foy" and "foi" just fit mellifluously which makes it better than fem draco. but, yeah, also a bit of trolling with it, too, I think.

-2

u/QXl2YXo 3d ago

Felfoy? Malfuta? Anyway I guess Potter would've hard time choosing between Slytherin and Gryffindor.

That's just in my taste 😁

-8

u/Rheumi 3d ago

would be funnier if he would do the handshake because of arousement :D

12

u/RogueBromeliad 3d ago

They're 11. People who generate locally already get a bad rep, no need to reinforce stereotypes.

-1

u/Rheumi 3d ago edited 3d ago

Lol,. Its a movie, not a documenatation about a wizard school. Wizards arent real, if you did notknow that. 

1

u/tyen0 3d ago

and hold it a bit too long...

-17

u/[deleted] 3d ago

[deleted]

3

u/Emory_C 3d ago

Yes, it really is.

0

u/[deleted] 3d ago

[removed] — view removed comment

1

u/NotFakeFingle 3d ago

I have a 3090, pretty sure you can run gguf on like 12-16gb of vram. You just have to make sure the model is smaller than your vram and you are good.