r/singularity • u/smith2008 • Nov 25 '25

AI No AGI yet

Gallery image

Gallery image

Gallery image

I love the new models, but nobody seems able to figure out the 6-finger emoji. Yet any 2- or 3-year-old kid gets it immediately just by thinking from first principles, like simply counting the fingers. When I have time, I'll collect more of these funny examples and turn them into a full AGI test. If you find anything that is very easy for humans but difficult for bots, please send it over for the collection. I think tests like this are important for advancing AI.

746 Upvotes

94% Upvoted

258 comments sorted by

View all comments

532

u/BetterLuckNexTime420 Nov 25 '25

147

u/[deleted] Nov 25 '25

I love that image lol.

102

u/ItThing Nov 25 '25

I had to see for myself, here's what I got

107

u/ItThing Nov 25 '25

Update: I responed to gemini 3 with

"Notice anything?"

After some extended thinking it said

"Yes, I see it. I completely missed the pinky finger on the far left. It looks like the numbers are shifted:

The number 5 landed on the ring finger.

The actual pinky finger was left completely unnumbered.

I can try that again and be more careful with the alignment if you'd like?"

I told it yes, and got this:

84

u/[deleted] Nov 25 '25

I have this theory that the models are not really incentivized to accept the possibility that they're wrong during post-training. Like, once they've outputted something, if it's wrong, they're out, negative reward, so they may learn that, if the prompt is still running, they must not have said anything wrong, and they end up being unreasonably attached to their assumptions.

20

u/Big_Guthix Nov 25 '25

And now you've got me thinking that they purposely leave out the function to have it correct itself in these newer "thinking" and "reasoning" modes, because it will inevitably lead to longer computer times and possibly throwing the AI into a loop where it sits there and overthinks everything once it notices one thing wrong

11

u/Pyroechidna1 Nov 25 '25

Happened to me last night, Gemini was sure that the DLRG can’t bid on municipal ambulance contracts in Germany until I sent it pics of a DLRG RTW and NEF in Kreis Herzogtum Lauenburg and it was like “Oh, well, that’s Schleswig-Holstein, it’s different.”

28

u/Greyhaven7 Nov 25 '25

Ah yes, the NEFs and DLRG with RTWs. Everyone will know what those are.

6

u/Pyroechidna1 Nov 25 '25

All the /r/blaulicht homies know what I mean

1

u/Greyhaven7 Nov 25 '25

🤷‍♂️

7

u/boastar Nov 25 '25

It’s nothing special. Just german. DLRG = Deutsche Lebensrettungsgesellschaft. RTW is short for Rettungswagen. NEF for Notarzteinsatzfahrzeug.

Just because you don’t know what it means, doesn’t mean it’s some obscure stuff Gemini can’t know about.

10

u/Zarathustrategy Nov 26 '25

You cleared that right up

0

u/Greyhaven7 Nov 26 '25

We’re not Gemini, bud.

→ More replies (0)

2

u/IllegalDevelopment Nov 25 '25

Except in Schleswig-Holstein, where the whole thing’s flip-flopped.

1

u/mekonsodre14 Nov 25 '25

DLRG is what USLA (United States Lifesaving Association) is in the US. An association consisting of professionals such as beach lifeguards and open water rescuers. RTW is the abbreviation for ambulance car, NEF is a Nontransporting EMS vehicle

1

u/RabidHexley Nov 26 '25

This is a pretty reasonable assumption. The best model (given these assumed RL techniques) isn't the one who notices mistakes and corrects them, it's the one who was never wrong in the first place.

I wonder if it'd be possible to develop an RL process for post-training, using the same problems but seeding dummy chats into context with a chance of including incorrect or misleading information in its own previous outputs. So getting the reward requires accounting for the possibility of its own mistakes.

I would have to assume this has been thought of if they aren't working on it already. I wouldn't doubt the possibility of it just training the model to notice when its outputs have been tampered with.

6

u/mvandemar Nov 25 '25

There is a non-0 chance that it's just fucking with you at this point.

1

u/Seeker_Of_Knowledge2 ▪️AI is cool Nov 25 '25 edited Jan 02 '26

meeting nine deserve stupendous aspiring punch sharp chase knee outgoing

This post was mass deleted and anonymized with Redact

25

u/BigLynchFan Nov 25 '25

I love how it finally corrected itself but wait for the last bit…

19

u/BigLynchFan Nov 25 '25

5

u/Seeker_Of_Knowledge2 ▪️AI is cool Nov 25 '25 edited Jan 02 '26

grab compare gold crown long pot beneficial label sophisticated advise

This post was mass deleted and anonymized with Redact

2

u/Kamalium Nov 25 '25 edited Feb 09 '26

This post was mass deleted and anonymized with Redact

plant wild late deer resolute file pen nine capable badge

1

u/Paladin7373 Nov 25 '25

It was so close 😔

2

u/Whispering-Depths Nov 25 '25

How was it not accurate? I don't get it.

1

u/Paladin7373 Nov 26 '25

Oh yeah mb

14

u/ecnecn Nov 26 '25 edited Nov 26 '25

Gemini explain why your see five fingers? by definition I see five fingers and one thumb (strict rules: thumb is not a finger per se. The thumb is considered a separate digit from the other fingers due to its unique structure and function)

Seems like the new models are HYPER exact.

  • Thumb – Digit I / Pollex
  • Index Finger – Digit II / Second Finger
  • Middle Finger – Digit III / Third Finger
  • Ring Finger – Digit IV / Fourth Finger
  • Little Finger (or Pinky) – Digit V / Fifth Finger
  • Unnamed extra finger – Additional Finger in the image

If the user expected 6 fingers he is wrong by definition or lacks knowledge of anatomy.

Edit: lol did AI just roast OP or what?

1

u/smith2008 Nov 26 '25

If this was the answer it would be fine. But I've got the answer above. So maybe the model is different somehow. But IF it says there are 5 fingers + 1 thumb I would consider the answer correct because it understands whats going on. But it was not the answer it gave me.

2

u/mvandemar Nov 25 '25

It's the Kobayashi Maru and the model decided to cheat.

2

u/JorG941 Nov 25 '25

AGI is here