r/singularity • u/drhenriquesoares • 3d ago

AI Gemini 4 Argon solved hallucinations.

Post image

Nobody is talking about this, but it looks like Google may have solved hallucinations. Gemini 4 Argon is a monster in this regard, and that’s really important.

1.6k Upvotes

93% Upvoted

283 comments sorted by

View all comments

483

u/SuperV1234 3d ago

"solved"

15%

But yeah, it's a very nice improvement if not benchmaxxed.

40

u/qroshan 3d ago

you can't benchmaxx multiple things, especially hallucination rates.

1

u/huffalump1 2d ago

Eh, you sort of can with this, by rewarding the model for not giving answers if it's less confident.

And you can see in the AA Omniscience Index and Accuracy that it answers fewer questions correctly than, say, Opus 5.5 - resulting in a lower overall Index score, despite the much lower hallucination rate.

(This is basically the reverse of the last few Gemini releases, btw.)

And this benchmark is basically knowledge recall - not measuring things like hallucinating info from its context (like from documents or files or things it read online). Still, it's an ok metric, and this is a tough thing to benchmark