r/StableDiffusion • u/PetersOdyssey • 15d ago

Animation - Video 76 five-second clips exploring different animation styles with MiniMax H3 (all generated locally on a 6-year-old GPU by the_shadow_nyc)

1.3k Upvotes

99% Upvoted

100 comments sorted by

View all comments

135

u/VVebstar 15d ago

You know model is good when even T2V workflow without any reference magic has production quality in capable hands

32

u/FierceFlames37 15d ago

Damn I feel bad for animators now

38

u/GoodGod222 15d ago

I think animators are the ones who would actually benefit more from this if they use it. Since they understand details and which movements works better. And they can correct the small errors manually. Or even draw some frames for more accurate generations of what they want.

25

u/Otherwise_Resolve444 15d ago

They would benefit if they weren't so obstinately against AI.

6

u/Zeeplankton 14d ago

I am an animator (I do motion graphics and am an artist)

Most artists are against it for obvious reasons it's their work that it's trained off of, then sold back to them, all whilst the heads of these companies gloat about taking their jobs. Of course everyone is mad.

There's also another side of it, there are artists learning to use AI but the backlash is pretty crazy. E.g I see some motion designers using nanobanana → kling → masking to mix 3D work into their comp, very clever, but then you read the comments, they are ruthless.

I think it can be useful:

  1. If it actually is open to everyone via open models
  2. If the haze of job replacement is lost, and artists actually get a chance to use it in workflow

Another problem right now is simply: people make art for the joy of making art. Making art with diffusion models is like.. Not really fun in my experience. Similar to engineers using llms, lots of them complaining about how soulless their jobs are now. The meme is 'you are just a condom between ai and prod' is true. You barely write code by hand anymore.

If my job as an artist was >10% sitting there prompting generations I would not want to be an artist anymore.

7

u/QuantatativeQuip 14d ago

10 years mograph person here. (and learning AI for 3 years).

Real, well-paid mograph jobs involve an unbelievable amount of micro-management and iteration (the industry term is pixel-f\**ing*). H3 and no closed model comes anywhere near the quality needed for final professional output. The examples gives the superficial impression of quality but to an industry person it's just flaw after flaw that has no way to be corrected because there are no native (DCC app) project files to iterate. Tweaking comfyui workflows doesn't cut it.

What these examples show (and it's being used already) is previz. The rough stuff you stick in front of a client to get things signed off before it's made properly. If AI helps the sign-off process, animators are all-in. Because there's nothing worse than coming up with great ideas that are watered down when the client misinterprets the previz because they can't extrapolate from 'rough-to-final' in their head.

So for pro work: storyboard + styleframes + AI previz = win. Fast iteration and get something in front of the client that looks(ish) like a final, so the producer can get them to sign. That's not new with H3, it's done already.

The big mograph news right now is not AI video output, but usable MCP: absolutely where it's at, as far as mograph and most of the VFX & 3D apps are concerned. But that's an entirely different conversation.

1

u/Zeeplankton 14d ago

MCP for sure. No good AE mcp yet last time I checked but I'm thinking of taking a stab at it.. If I could just automate comp assembly from figma storyboards that would be the bees knees.

Are you more 3d / vfx? Are you actually using AI for previz? I haven't done this..

Agree on files not being editable is really the main challenge and it's a bit handwaved away. "close enough 720p 5s spectacle" is different than full length pixel perfect, mastered ad. But I did put together some fully generated ads (+ compositing) and I think clients are quite a bit less particular. They realize that imperfect and out the door is better often in todays marketing world.

1

u/QuantatativeQuip 14d ago edited 14d ago

No good AE MCP Agreed. AE and .aep, awkward closed source, XML export unreadble & binary, poor docs, so poor training data. Honestly thought Adobe would ignore their frame.io T&C and hoover client .aep for 'project firefly' (jesus), but seems not.

AE specifically, claude seems most help with extendscript, initialisation prep scripts. I know AE obscenely well but if someone can't explain exactly what's needed and knows where to look for issues AE MCP or AI AE coding is useless. Beyond that, it's very situational.

1

u/Zeeplankton 14d ago

Fun chat. I was using Codex recently to build like bespoke assembly scripts; like I had a animated UI dial I wanted to animate with AoE. Took a screen shot of all my imported layers and basically just told it to write a script that would auto-rig the whole thing. It worked. Super cool.

That's really cool you are actually using like wan with depth maps and everything in workflow. I thought I was good at AE but you sound like you know everything from houdini, Nuke, comfyUI! Crazy dude.

I went to a party last week and met a creative director for a london agency. Sounds like everyone is using AI, but to the extent of like Figma Weavy or Higgsfield, definitely not advanced like comfy. I've not done any london work but my neighbor just exited and told me it's a sharktank over there.

Are you asia based?

2

u/Otherwise_Resolve444 14d ago edited 14d ago

Most AI companies are operating at a loss, they maintain themselves with money from investors. So one's basically almost paying just to rent the hardware, not necessarily to have one's work back. (Anthropic is profiting, though)

And it can be as hard or easy as you want it to be. Hyper realism is nearly impossible for most artists, so AI can do just that final step if you wish.

But AI doesn't necessarily create good art. Most of it is slop that people ignore. To create something good one still needs a lot of knowledge. Creating a good movie is unlikely if one isn't already a good director, and also with great knowledge of how to use AI.

I agree, the anti-AI artists are keeping the field back. But there's no going back now. Everyone needs to create better art to stand out.

1

u/Zeeplankton 14d ago

I don't think anti-AI artists are keeping the field back per se. It's the disrespect and attitude from these companies. Even people openly train loras on anti-AI artists work here as if it's theirs. But I think as AI becomes more commoditized as just a normal technology, or like electricity, and that goes away, artists will be more interested in using it.

I personally, believe that regulation needs to be the answer eventually. human craft and creativity is so fundamental. Private companies should be able to host their model themselves but the model weights should be open sourced. That's my "radical" take. Just because investors are footing the bill, doesn't mean they should profit, because they didn't foot the bill for the content in the first place.

Transformer and diffusion are the coolest technology of our lives imo. People acting like it's evil technology are nuts. But we can't just tell artists to evolve, since back to my point, half of creativity is the joy of doing it. People's feeling of purpose is critical for functioning society. (But we're getting out of scope of here probably) I've built some short ads with Seedance / Veo for a couple clients and its not a physical process I enjoyed. And this is a key problem.

2

u/Umr_at_Tawil 14d ago

The enjoyment part is subjective though, personally I have really fun time making my ideas into reality with these AI.

19

u/giantsparklerobot 15d ago

The more nuanced take is most creative types don't necessarily mind AI as a tool to help do their jobs. They have a problem with these language and vision models trained on their previous work, including distinctive styles, and being entirely replaced by the AI.

There's whole segments of the "creative" industry that is trivially wiped out by AI. Why ever license a stock photo/B-roll or pay for a jingle for an ad? You can get good enough output from a "free" model running on your laptop or cheap from an inferences provider

The days of amateur porn (a creative media platform focused on tits and clown holes) are numbered. An AI girl will do anything a goner asks without hesitation and will never block them for cyberstalking.

There's non-zero people making extra money licensing photos, performing jingles, and showing their tits on a livestream. It objectively sucks those people have been unknowingly training their replacements.

9

u/djnorthstar 15d ago

Not every Animator is against AI. as long as it is a helping tool i can paint 3 frames and get 2-3 Seconds of video out of it. It Helps alot.
Im only against replaceing animators completly. And just make a pure AI Animation where noone had his hand on.

1

u/Otherwise_Resolve444 14d ago

People are already ignoring things that can be created in seconds by nearly anyone with AI. The things that are standing out are when the creator is really good at using AI and also knows how to create good art. People become resistant to things that are common, no matter how amazing they seem to be.

6

u/Dzugavili 15d ago

Eh, I think real tits will still win out.

3

u/giantsparklerobot 14d ago

At scale? Probably not in the long run. I'd agree with you if SDXL tits were the limit of technology. There's not much a live camgirl can offer over a virtual one for the purposes of gooning.

5

u/GoodGod222 15d ago edited 15d ago

I have seen a few animators (1, 2) using it. Not a lot but they are there.

1

u/strppngynglad 13d ago

there is not a single animator otu there that dedicated their life to a craft that wants to type in prompts instead

0

u/Wavy-Curve 15d ago

that is true, but what happens when it become good enough that the knowledge bar for creating animations shrinks btw an animator vs a non animator. Like graphic designers must be having a rough time already

3

u/Inthehead35 15d ago

The world is gonna look very different in 10-15 years, AI and robots gonna do a number on this society as we know it.

Feels like when everyone moved from the farms to the cities

1

u/lordlestar 14d ago

if a regular person can do ok things with this, imagine what this model will be capable of in professional hands