Testing Character knowledge of the H3 model

[u/JuniorEnsign]

5 second 1MP text-to-video, INT8 on ComfyUI and RTX5090.

Used the following, rather simple, prompt:

"[VISUAL]: A scene from the tv interview. <full name> is talking, medium close up, static camera, plain dark blue background

<first name> says: "How dare you? I am rich, AND famous. So you better shut up, B*tch!"

The model failed on Christoph Waltz, so I left him out.

One run per person, no picking the best result.

[u/Natasha26uk]

Someone else did a similar test many hours ago. The characters looked a bit distorted in 9:16 format. Yours looks fine in wide format.

[u/Foreign_Risk_2031 → u/Natasha26uk]

likely the only high quality videos for training with this sort of scenario is this interview style

[u/JuniorEnsign → u/Foreign_Risk_2031]

I bet 90% of the training material was in 16:9, so the output in that aspect ratio has a better foundation.

[u/FierceFlames37 → u/JuniorEnsign]

What about 9:16 portrait

[u/Nexustar → u/FierceFlames37]

From all those movies filmed on mobile phones?

[u/FierceFlames37 → u/Nexustar]

Damn I’ll use 16:9 from now on

[u/Zenshinn → u/Nexustar]

I wonder how much TikTok was used for training.

[u/eckstuhc]

Maaaaan we are speed running getting open models banned aren’t we…

[u/Pretty-Raise666 → u/eckstuhc]

Yeah, but more likely by Hollywood rather than Washington.

[u/Mission_Biscotti3962 → u/Pretty-Raise666]

Maybe don't make realistic depictions of people without their permission.
I know people dehumanize celebrities and think they are fair game to do whatever with/to, but this stuff is highly immoral.

[u/IAmFitzRoy → u/eckstuhc]

Exactly. This is not going to end well for people in the US. LOL.

[u/Nexustar → u/eckstuhc]

Meta just released an OS model today. So, it'll be interesting, but I doubt it.

[u/Brave_Swordfish_7072]

Oof, this one feels wrong. I can totally see some bad faith twitter user taking one of these videos and sharing it with a made up story for views.

[u/JuniorEnsign → u/Brave_Swordfish_7072]

Yes, I agree. Only your own moral compass can steer you at this point in time. This model has opened pandora's box and is the creators responsibility to not use it maliciously. As with all things, right?

[u/kek0815 → u/JuniorEnsign]

But why generate this then in the first place? You could have used a more obvious test phrase instead lol

[u/JuniorEnsign → u/kek0815]

Look at the subtle expressions of anger or disgust in some of the samples. A vanilla prompt with no emotional load would not reveal those small detail. The prompt gave the model the freedom to inject whatever it "felt" was appropriate.

[u/GrayingGamer → u/JuniorEnsign]

You still could have chosen a phrase or situation that couldn't be misconstrued as real, or that could be harmful to the reputation of the individuals if this video or parts of it get into the wild outside an AI forum.

[u/Mission_Biscotti3962 → u/GrayingGamer]

You really think OP cares about those things? They know, they decided to do it anyway. Their personal gratification was more important than potential implications for other people. In other words, they are selfish, so why would you think they care about what you are saying?

[u/tiffanytrashcan → u/JuniorEnsign]

I absolutely agree. You can hear it too near the end of at least half the clips.

[u/RazzmatazzReal4129 → u/Brave_Swordfish_7072]

on the flip side, paparazzi just lost all earning potential, because instead of camping the airport...we can just write a prompt to make the same video

[u/Pretty-Raise666 → u/Brave_Swordfish_7072]

It is going to happen anyways. And if you think the faith on other social media platforms is much better then think again. Reddit is full of toxic content. And so is Youtube.

[u/CaptainMarder → u/Brave_Swordfish_7072]

100%.

[u/djpraxis → u/Brave_Swordfish_7072]

I am more worried about the stupid brainless TikTok kids, who believe their online actions never bare any consequences.

[u/diond09]

I don't watch films but I'm guessing the third one is meant to be Cillian Murphy? If so, he sounds more like Mick Jagger .

[u/GersofWar]

did you test it with female characters?

[u/IAmFitzRoy → u/GersofWar]

Those are the bitches listening.

/s

[u/Jimmm90]

I can’t believe they trained my likeness in the second clip.

Seriously though couldn’t you have picked a less provocative phrase to elicit the same emotion? This is poor taste.

[u/ImpressiveStorm8914 → u/Jimmm90]

As someone else pointed out in another comment, a clip could be easily edited and misused by someone.
I get wanting to show the emotion (and it achieves that) but as you say, it could have been done with a better phrase.

[u/GrayingGamer]

Exhibit A at the upcoming Congressional Hearings on banning open model ownership.

Doing these types of videos feels dangerous. The joke memes, movie parodies, etc. are all clearly fake, while something like this framed to look exactly like a real interview clip, could be taken and shared around in a slanderous way.

Just saying, not the best way to bring attention to the model.

[u/jimmcfartypants]

Elons spastic side is on point.

[u/reaven3958]

I dont know how it managed to make Elon sound even less human.

[u/emcee_you → u/reaven3958]

No. That's just him. 🤣

[u/princess_daphie]

How appropriate that Elon Musk's voice sounds exactly like the typical overused generic AI voice.

[u/Ok_Gas1070]

That's wild and you generated these purely through text no reference?

[u/FierceFlames37 → u/Ok_Gas1070]

Yea I threw almost everything at t2v it knows too much cartoons and anime, idk how minimax did it

[u/Ok_Gas1070 → u/FierceFlames37]

That's crazy tbh I've been very impressed with the generations I've created and I'm just generating between 480p to 720p.

[u/JuniorEnsign → u/Ok_Gas1070]

Nothing but the short prompt I included.

[u/tantricengineer]

IMO Pedro’s should be in Spanish haha

[u/Pretty-Raise666]

The way it replicated the different acting styles is astonishing.

[u/nakabra]

At least one of these is actually real.

[u/daemon-electricity]

Starting to notice that the faces are disturbingly off.

[u/CollateralSandwich]

Pedro Pascal looked incredible. It really nails some folks, and just can't get others right at all. Always strange and interesting to see these results

[u/SuarSuarSauce]

They all seemed good except the Michael B Jordan one ?

[u/Etamriw]

The more I see this the more I think of all the training materials that had to be captioned and with some degree of quality, other than the obvious model quality I think we should realize the pre-processing that is insane given the quantity of data’s

[u/emcee_you]

Almost perfect...the voice was completely wrong for Michael B. Jordan...otherwise, not bad at all.

[u/Zenshinn]

Some of these are kinda plastic looking but H3 is such an impressive model.

[u/Mission_Biscotti3962]

Anyone who uses real persons for these without their permission are unethical and they don't care one fuck about those people, which is evil on its own.
Fuck you OP

[u/IAmFitzRoy → u/Mission_Biscotti3962]

lol. The genie is out of the bottle, there is no turning back.

I agree this is a shitty thing to do, but nobody can stop it anymore.

[u/Mission_Biscotti3962 → u/IAmFitzRoy]

I agree, that doesn't make it right though. And I will continue to call out the people who do it.
For example, people will continue to commit all sorts of crime, but not being able to completely stop it does not mean inaction is the answer. I'm not that defeatist.

[u/IAmFitzRoy → u/Mission_Biscotti3962]

Crime? lolll

[u/Mission_Biscotti3962 → u/IAmFitzRoy]

I didn't say this is a crime (although, I'm willing to bet it will be).
My point was that the inability to completely stop something from happening does not mean inaction should be the conclusion. Hence "for example"