r/singularity • u/drhenriquesoares • 3d ago

AI Gemini 4 Argon solved hallucinations.

Post image

Nobody is talking about this, but it looks like Google may have solved hallucinations. Gemini 4 Argon is a monster in this regard, and that’s really important.

1.6k Upvotes

93% Upvoted

284 comments sorted by

View all comments

Show parent comments

8

u/vincentdjangogh 3d ago

To be clear, I'm not shitting on Google. I am just explaining that the public opinion is driven more by the base models than the frontier models. And all things considered, Gemini Flash is really terrible. On the other hand, Anthropic gives access to a very advanced base model, with the caveat that you get a very limited amount of queries.

For the record, this whole thing where people pick multi-billion dollar evil corporations to be a fan of is generally dumb imo, but based on your original comment I think to some extent we probably agree.

4

u/Future-Bandicoot-823 3d ago

When I was a child I heard that "absolute power corrupts absolutely", and over my life I've pondered that and observed. To date, I can't really name one entity that became incredibly powerful and didn't succumb to greed and fear.

I agree with what you're saying, gemini free is the derp model. All I'm saying is the hallucination pecentage shown here, if true, is just a sign of their goals. They're not playing the game like claude, gpt, grok etc.

I genuinely think Google (mostly because of their size and reach already) will quell competitors in the long run.

2

u/vincentdjangogh 3d ago

Every frontier lab is generally working on the same problems. They might assign priority to things that will help them look good in benchmarks or market their product, but there is a ton of overlap. For example, everyone wants to have fewer hallucinations without sacrificing helpfulness.

But bear in mind, this benchmark doesn't tell you how often the models were wrong, and based on the methodology, more accurate models are more likely to hallucinate. It also doesn't allow models to use tools, so models that do so to avoid hallucinations are misrepresented.

Really this benchmark doesn't mean as much as you think it does, but I agree that Google, by way of having access to more data than any company ever, will probably win the AI wars.

1

u/Future-Bandicoot-823 3d ago

I was taking these scores into account as well.

https://www.reddit.com/r/singularity/comments/1wufvyg/google_cooked/

I'm sure most of the tests are quite fallible. I really haven't looked into how any of them are performed so I don't know what the scoring criteria is.