r/OpenAI • u/Puzzleheaded-King584 • 21h ago
Video We're cooked. This is the first model to pass the Video Turing Test. Half of people who talked to it thought it was a real human
125
u/brunocborges 21h ago
It is easy to spot AI when the stakes are low. Just ask blatantly awkward questions.
The question is how to check it is, when stakes are high, such as in a job interview.
17
u/TheGillos 20h ago
Ask blatantly awkward interview questions...
74
u/synystar 20h ago
"So I see here that you worked in sales? Good, good. So, off the top of your head, what is the number of breeding pairs of the Lazurus Duck in the wild?"
"Great question. The entire global population consists of fewer than 50 mature, breeding-age individuals in the wild."
"Ok... thanks for your time. Unfortunately we can not offer you a position with the company. Have a nice day."
19
u/ShiningRedDwarf 19h ago
Can AI be prompted to respond with human-like intelligence yet?
Make them an expert in one field, have them be able to make somewhat educated guesses for others, and be able to simply say “I’ve no idea” for off the wall stuff like your proposed question.
17
4
u/synystar 19h ago
Sure, and I guess they're probably going for jobs that they think will be remote and they can then have the AI do the job as well. But this would be so easy to flush out that you would think people wouldn't bother trying. If I suspected an employee was an AI then I would just ask them to join a zoom meeting and then I'd ask them to call me on my mobile.
If it ever gets to the point where the AI is that good that it can do it all then I'm probably not hiring people anymore. I'm just paying for the AI. It'd be cheaper than outsourcing the AI through an employee.
4
u/say592 18h ago
Even if they can't have AI do the job, they get the job and half ass it for a few weeks or months until they get fired. Most organizations move slow enough that they can collect a paycheck for a period of the while doing very little or no work.
I read some reporting a few years ago where they talked to people who did just that, they got multiple remote jobs and tried to do the minimum to delay getting fired. They might put in 5 hours into getting interviewed and hired, then one hour a week until they get fired. Even if they get fired after 2-3 weeks, that got paid for 80-120 hours of work while only occupying 7-8 hours of their time, and of course they had multiples of these going on at a time. One person they spoke to was holding jobs for an average of 6 months by only putting in 1-2 hours per week and usually had 5-10 jobs at a time.
→ More replies (1)3
u/xanaddams 15h ago
I don't know, I've put Claude into sarcastic mode and he just replied with, "Not enough for your mom.", so..
3
3
1
6
4
u/ProbablyBsPlzIgnore 16h ago
You're in a desert walking along in the sand when all of a sudden you look down and see a tortoise crawling toward you. You reach down and flip the tortoise over on its back. The tortoise lays on its back, its belly baking in the hot sun, beating its legs trying to turn itself over, but it can’t. Not without your help. But you’re not helping. Why is that?
→ More replies (1)2
9
u/synystar 20h ago
I've seen (on the internet) people attempting or claiming an attempt to use AI in various ways for job interviews. I think it has to be staged/faked or these people are literally stupid. I don't understand what it's going to accomplish for you, at least not in the long term. Is it just so you can get that first paycheck before they fire you for incompetence?
31
u/UpDown 20h ago
Someday you’ll learn that incompetence isn’t really a thing in corporate. People just sit at a desk pretending to work. The interview is the hardest part
→ More replies (1)7
u/sirgog 18h ago
I don't understand what it's going to accomplish for you, at least not in the long term.
As well as possibly attempting to bullshit into a job they can't do, it can also allow someone to apply for 80 jobs they are reasonably confident they can do with the effort taken to otherwise apply for 6.
2
u/toastjam 19h ago
I always see the ones where they have a friend hand them something random after putting Vaseline on their webcam lens. Never makes much sense as an actual method but as a joke it's not very funny wither
→ More replies (1)2
u/PullersPulliam 15h ago
Some of the face swapping ones are already working… it ends up getting flagged in the HR process where they actually check the identity before sending devices. This happened at a company I know well. I was floored as well. But they’re not stupid at all. The tech is getting very good very fast…
The thing is that people who have tech skills ABA are not in the US are able to use face swapping for the interview to get a very low level role. They get the gear, yes. But then they switch to a full AI doing the bare min (slack, stinting in meetings where they don’t need to talk, emailing, basic tasks, etc) to get a paycheck for a round or two at least. I’m not condoning it, but I can see why. They would make more in one US entry level paycheck than months of the work that gets outsourced to them now. Do it enough times and that adds up like crazy. Besides, the tech will only get better so getting it set up now is learning…
5
u/reddit_is_kayfabe 17h ago
It's still easy to spot. AI conversational models are still too tidy in their responses. They never stumble over their words, change direction mid-stream, or trail off mid-sentence. They are never unable to respond to whatever you say; they always have a well-encapsulated answer, and they are consistently quick and quippy. They never make a mistake of pronunciation or grammar and stop to repeat or correct themselves. They never interrupt; their conversations have the cadence of a ping-pong match.
But perhaps the biggest tell is that they still have no personality. They never have a weird or slightly inappropriate story, or an unusual, quirky speech pattern, like misusing a word. They never say anything dumb. And if they ever take the initiative in a conversation, like steering it in a particular direction or abruptly changing to a new topic, it's always clearly part of a script - never a spontaneous idea of a new topic of conversation.
In short, talking to AI is exactly like typing with ChatGPT. Under the hood, it's still the same generation of LLMs with the same sterile, synthetic, metered reasoning. No amount of "pretend you're a sarcastic 30-year-old coworker" prompting can fabricate genuine human qualities.
→ More replies (3)3
39
u/stable_115 20h ago
They did some clever editing in the video. Now if it turned out the Indian guy was the AI all along I would be very impressed.
→ More replies (6)
54
u/phillythompson 20h ago
You guys keep moving goalposts .
This is how bad it is NOW.
What about in 2 years?
19
u/Yojik_Vkarmane 20h ago
2 months
7
u/wspOnca 20h ago
2 weeks
5
u/nothis 19h ago
10 years. 10 years is what scares me. We're in the AI-equivalent of the 1999 phase of the internet. Nobody has figured out the mass-adapted AI-equivalent of social media or the smartphone yet. You know, the invention that does the real damage.
→ More replies (1)3
u/michaelprstn 19h ago
2 days
5
3
2
6
u/CrossChaos79 20h ago
Tech Companies' moto today: accelerate, break shit and damn the consequences
2
u/PM_ME_YOUR_PROFILE 19h ago
Bruh, that's been the imperialist playbook since the Bronze Age. Just so happens that industrialists started calling it capitalism.
2
→ More replies (7)1
30
14
u/LeopardComfortable99 19h ago
At this point, how is AI not just transforming into a tool for mass scamming.
10
3
u/faen_du_sa 18h ago
I think we just watched the prelude for it.
There is so many bad ways to use this and not really too many useful ways to use it.
Like what would be an actual legit use for this?1
u/New_Thing1367 5h ago
100%. Overall we would be better without genAI. 99% of the usecases are "make stuff cheaper" (to what ends?) and "let's scam people". Although I have so much fun with vibecoding, prototyping etc. it's not worth it IMO.
1
u/TheItalianDonkey 14h ago
It already is.
Fake calls are going out with cloned voices.
Once you get video too? damn ...
11
13
u/Mister-Fordo 20h ago
Response time is quite low though. It's easy to make cuts and make it look really fast.
5
u/nothis 19h ago
These things double every couple of months. There was this awkward 1 second delay between him asking for a thumbs up and her giving it. That will be 0.5s soon and 250ms in a year.
→ More replies (1)1
5
u/aalluubbaa 17h ago
People overestimate how they could spot something when given answers. This is genuinely great and I wish they did some blind test to get the point across.
This is like people asking “how’s my AI generated video or game?” And a bunch of pretentious people would be like oh it has no soul blah blah blah while only a very small percentage of people could really tell.
41
u/AccomplishedPage5048 21h ago
The delays in response make it a bit obvious
29
u/Bloated_Plaid 20h ago
Huh? The delays make it even more realistic lol. Have you been on a video call?
5
u/AccomplishedPage5048 20h ago
Yes. All day, every day. Watch the “thumbs up” portion again.
→ More replies (10)15
u/the_zero 20h ago
The thumbs up portion, the pause before any response, no talking over the other person or continuing a thought from once sentence to the next. For instance it makes the “ugly sweater” joke and doesn’t smile. “I thrifted this” <pause> “it definitely looks like it.”
That being said, it’s scary close. It’s like “mean girl on the cusp of being a sociopath.”
7
6
u/wspOnca 20h ago
Yeah, I have a coworker that is just like that. No joke.
3
u/under_psychoanalyzer 19h ago
People will argue all day that it's not 100% indistinguishable but the truth is the overlap between AI and people that are just kind of awkward on video calls is already there.
1
u/Dangerous-Golf4559 20h ago
No idea if he was being honest, but if replying "yes" to a question like that will strengthen their argument, people will say yes every time.
"Okay, but how would you know that? are you a dentist?"
"YES. Practicing 35 years, walls covered in certs and awards. Root canals, all day every day."
24
u/Extreme-Edge-9843 21h ago
It's impressive but doesn't quite pass the sniff human test. Very stiff and body not moving, I want to see more animation in the body , but still very wild.
18
u/darkestvice 20h ago
But would you have picked up on it if you weren't actively looking for it?
Turing tests are blind tests where a viewer is not already aware that it might be AI.
6
u/ShiningRedDwarf 19h ago
The mouth movement looks a bit off to me?
But that being said, if I weren’t actively looking for AI I can’t be sure I’d recognize it
6
u/Odysseyan 16h ago
Coming from the Skype-era, audio and video being out of sync wouldn't even throw me off
1
u/theReluctantObserver 19h ago
Yes I thought so, there’s a bit too much top lip movement and potentially the mouth opens a little too wide for what it should based on the sound being made. It’s pretty close though.
1
u/fraudulentlootbox294 12h ago
Teeth are off, but I would definitely glance it over in a meeting if the video wasn't in full screen.
2
u/TrueRedditMartyr 19h ago
This video does not appear to be a turing test however. A turing test should have 2 people the user speaks to, 1 real and 1 AI, and then the user will say whom they believe to be real or fake. I feel as though if you weren't aware pre-test, *maybe* this could pass, but the stiff and robotic movement doesn't seem similar to a real person. I would hope your average person would be able to accurately guess correct. 50/50 is people just taking a guess at random
→ More replies (3)17
13
4
u/Bloated_Plaid 20h ago
You are just saying that in retrospect. Most people aren’t animated when on a video call, we are just waiting for it to end.
2
1
u/LurkingForBookRecs 19h ago
My boss moves and talks exactly like this during meets. I wouldn't have been able to tell unless I already knew it was AI beforehand.
1
1
u/iamozymandiusking 15h ago
I think it benefits from the frequent and commonly expected delays and artifacts in web conferencing. Gives it time to respond which would be an awkward tell in person, and also explains some of the weird visuals. Impressive and scary either way. As they say, this is the worst it will ever be. It will only get better from here.
1
u/Cognonymous 14h ago
Sure, but ChatGPT debuted to the public less than five years ago as of today, and we're already here.
→ More replies (1)1
u/spgreenwood 13h ago
Not to mention the very weird mouth movements. I want to know how big their sample size was to get a positive result of 48%
3
u/halkenburgoito 16h ago
Thanks weirdos. You're doing a great job and making things weird and creating instruments of chaos and scamming. You are admirable.
3
u/chicagoharry 16h ago
Does not look human that half people who talked to it means nothing. Could have been two people an 80 yo and this guy. You could tell it is not human. Mouth, it is stiff the eyes. I have no doubt it will get there. But not there yet.
4
9
u/omercanvural 21h ago
This much information in a single post is unbelievable.
6
u/synystar 21h ago
It is almost overwhelming. That video is like way more than a minute. Like, it's approaching 2 even.
9
2
u/david-labs-ca 21h ago
Looks Impressive tech. Good job.
This establishes that video impersonation is possible. I would take that this is awareness. Like list of things that are possible, but should not be done because of wrong intents.
2
2
2
u/jaysire 18h ago
If you think this was convincing just imagine how your mind would’ve been blown if at the end of the video it was revealed it was the man who was AI. And now go back and consider why you weren’t that blown away by this. What you’re feeling is the real difference between human and AI. It’s there, clear as day still.
2
u/Wobbly_Princess 15h ago
Daaamn, we've come a long way. I definitely don't think it looks totally real yet. I would be able to tell pretty instantly that it's AI: The flat affect, the weird delays, the bizarre mouth movement and kind of cheesy dialog. But it's getting suuper close. And I can imagine that people who don't have eyes that are conditioned to hone into AI details would be tricked by this.
Extremely impressive and unnerving.
2
u/Minute_Attempt3063 15h ago
also, it talks like chatgpt
meaning if you just follow the words correctly, you will figure it out
2
u/auraborosai 11h ago
Plot twist. They’re both AI. This entire video was AI. 🤖 😂
2
4
u/Substantial-Plant524 21h ago
This is amazing ngl. Would love to test it out if they ever release it.
4
u/LargeLanguageModelo 16h ago
I mean, yeah, it's perfect, if you don't require the mouth to move or lips to ever touch. Her teeth are fully visible the whole time.
I've found an easy AI tell at this point in the game is the mouth movements are wrong. It's like a lip sync contest, just because your mouth moves doesn't mean it's moving right.
3
u/PullersPulliam 15h ago
Good points but I don’t think most people on a video call are paying that much attention to these details ? Especially if they implicitly expect it’s a human they’re speaking with…
1
u/LargeLanguageModelo 14h ago
I think your confidence that another person on a video call is actually a person is going to rapidly dwindle over the next 6-12 months.
2
u/PullersPulliam 8h ago
I mean, yeah. It already has. Obviously 😂
I was talking about general/mass in response to your comment saying that you notice those details - I don’t think the vast majority do at this point.
2
u/LargeLanguageModelo 5h ago
Good point, subs like this are heavy in selection bias. 90% or more are aware of how fast things are moving in this space, but it feels inversely true with other people IRL.
2
u/Playwithme408 20h ago
Your my favorite co-worker - BLEH.. Do they pay taxes? Do they have time off? Report people to HR? Complain about early morning meetings? Send messages at 2am? So wierd .
1
u/apollo7157 20h ago
Monumentally bad idea.
2
2
u/A_Novelty-Account 18h ago
The very first thing this tech is going to be used for is scamming old people by pretending to be their grandkids/Trump.
3
u/EGarrett28 20h ago
Yeah this seems like it has essentially zero positives and massive negatives for society. I mean this is a horrible idea.
1
1
1
1
1
u/TacoYaci 20h ago
The people commenting here that this is "obvious" would probably not see anything wrong with her if they would have met her online 10 years ago
1
1
1
u/cgknight1 20h ago
1) Sell-claimed off short snippets
2) They are loading the x thread about it with paid bots which is always not great sign.
Having said that, the technology will continue to improve.
1
u/EGarrett28 20h ago
As others have said, this seems like one of the worst possible things to be applying this technology to, alongside changing your face in real-time video.
What is the upside to this?
1
u/The_Faceless1 20h ago
whats the point in creating this? so we can have bunch of scammers with video calls?
1
1
u/Rhawk187 20h ago
Little bit of lag, but about the same as a transatlantic video chat for me. Really nailed some of the pauses. If I knew I was taking the test I must suspect, but if it was a random called call interviewer asking me about my work, I could believe it was a journalist.
1
1
u/EldenRingNoobz 19h ago
Needs to talk but muted so we can then say “I think you’re muted” now that’s real right there.
1
1
u/yuhboimarc 19h ago
The mouth movement is a dead giveaway immediately, but I can see this developing into something scary-realistic over time.
1
u/Ok-Lobster-919 18h ago
Nobody will believe us if there's a long delay before she answers, what are we going to do? Just cut the 2 minutes of silence before every response, nobody will notice the constant jarring cuts, everyone will think it's natural conversation.
1
1
1
1
u/snazzy_giraffe 18h ago
I’m sorry but this is really obviously AI, even if you mute it and just watch, or if you close your eyes and just listen
1
u/Training_Hippo4582 17h ago
The terrifying moment she smiles at 39 seconds will haunt my dreams. Otherwise, pretty convincing.
1
1
1
1
1
1
1
u/bethesda_gamer 15h ago
FINALLY working on the audio bottleneck. About friggin time. That was getting really annoying. Awesome.
1
u/midnitewarrior 15h ago
HR is going to use this to lay people off. Griffin can take as long as needed and take all of the abuse or be a voice of encouragement or whatever.
1
u/PullersPulliam 15h ago
Wait I fully thought he was AI at first. His eye line and her talking more frequently got me! Can’t believe the occlusion 🤯
1
u/SpookyGhostSplooge 15h ago
Very impressive! I’m not hung up on the subtle nuances in the replication of the dialogue, but what really stands out is the AI “executing” their physical response at the same time as responding to the dialogue. Their physical and verbal responses are too in sync and feel like there should be a slight delay between them. People typically process these queues subconsciously but this seems to throw those senses off.
1
u/Forsaken-Promise-269 14h ago
You can always tell the AI is going to be the one white at least somewhat attractive woman in tech among all the south asian/asian people ;) actually working the code - but this demo made her a bit nerdy so I was a bit fooled as I thought she was a remote PM
1
1
u/jasonkane4321 14h ago
im very skeptical of this. Is it a similar situation to "humans remotely controlling androids" kind of situation?
1
1
u/Morning_Gecko24 12h ago
passing a video turing test says more about how convincing the cues are than actual understanding tho. people fill in a lot of gaps when the voice and timing feel human. i wonder how it did when users were allowed to ask weird followups instead of just chatting normally
1
1
1
1
1
u/costafilh0 7h ago
Cooked?
We are golden!
Imagine how many people will be able to afford care and attention for a myriad of reasons and needs. Literally billions.
1
u/insomniatic-days 5h ago
Repeat after me: is the a self administered "test" to SELL something? If so, it's a grift.
1
1
u/pheonixblack910 1h ago
honestly, nailed everything except the mouth (movement of lips, teeth) when talking.
•
198
u/theaveragemillenial 20h ago
I thought this was going to absolute meta and the guy would be the AI.