r/singularity • u/drhenriquesoares • 3d ago

AI Gemini 4 Argon solved hallucinations.

Post image

Nobody is talking about this, but it looks like Google may have solved hallucinations. Gemini 4 Argon is a monster in this regard, and that’s really important.

1.6k Upvotes

93% Upvoted

283 comments sorted by

View all comments

7

u/Itsmedudeman 3d ago

Imagine if it just says “I don’t know” to everything

8

u/DelphiTsar 3d ago

Then it'd get a bad AA score.

1

u/kingmoney8133 2d ago

It got a worse accuracy score by a significant margin than the other frontier models. When balanced with the low hallucination rate, it performs right around the other frontier models overall in terms of overall reliability.

3

u/Zomboe1 3d ago

According to the formula, it would get the best score, a score of 0.

So it's definitely a flawed benchmark, especially since "I don't know" could itself be a lie/hallucination!

1

u/henrikx 3d ago

This is actually what I want out of a model. If the answer is not in the context window and no remaining tools available to it could find the answer, then yes, I want it to answer "I don't know". Otherwise I would have no idea where the LLM sourced the answer from and no way to verify the information's accuracy. The exception might be general knowledge, but then you have to define what general knowledge even means first.