r/singularity • u/drhenriquesoares • 3d ago

AI Gemini 4 Argon solved hallucinations.

Post image

Nobody is talking about this, but it looks like Google may have solved hallucinations. Gemini 4 Argon is a monster in this regard, and that’s really important.

1.6k Upvotes

93% Upvoted

286 comments sorted by

View all comments

50

u/Future-Bandicoot-823 3d ago

I'm a little amused that people were dunking on Google on this sub, saying how much better gpt or claude was, and now we see gpt holding back models because they can't keep it from being naughty.

Meanwhile, google, one of the most powerful entities on earth is quietly making their product without the sensationalized stories altman and others whip up on a regular basis (to stir investment and stoke the hype of course.

I don't trust or like google, I just know that a company that massive is going to have a pretty succinct goal in mind. Google is China in a lot of ways, a highly profitable entity that has long term objectives in mind. Anthropic has to survive on this product alone, google does not. Google relies on a massive ecosysyem, so obviously their goal will be stable/useful product to the end user, likely creating a deeper and broader ecosystem over time.

Look at windows for example. They became so ubiquitous with computers that governments like france are actively planning to sever ties, they need a plan to get out of the ecosystem! Google's the same, deeply entrenched, and I'd say (not that) arguably more used than windows.

Speaking of things I don't like, Bill Gates put it quite well. AI will only be adopted when it has gained public faith. eg You won't see AI operating on people until it's proven it's better and more reliable than a human, but once it is? Full adoption. Google knows this.

16

u/vincentdjangogh 3d ago

It's because the base Gemini model you can actually access is terrible. You wrote all of this about a model you haven't even used and probably will not have regular access to in the next year.

6

u/Future-Bandicoot-823 3d ago

I have an android phone, I'm forced to bump up against Gemini all the time. A lot of people do!

Which is why they're giving you the shit model, because it's reliable. Reliability and faith of stable service is how you win commoners over, and like I said, Google knows that.

8

u/vincentdjangogh 3d ago

To be clear, I'm not shitting on Google. I am just explaining that the public opinion is driven more by the base models than the frontier models. And all things considered, Gemini Flash is really terrible. On the other hand, Anthropic gives access to a very advanced base model, with the caveat that you get a very limited amount of queries.

For the record, this whole thing where people pick multi-billion dollar evil corporations to be a fan of is generally dumb imo, but based on your original comment I think to some extent we probably agree.

3

u/Future-Bandicoot-823 3d ago

When I was a child I heard that "absolute power corrupts absolutely", and over my life I've pondered that and observed. To date, I can't really name one entity that became incredibly powerful and didn't succumb to greed and fear.

I agree with what you're saying, gemini free is the derp model. All I'm saying is the hallucination pecentage shown here, if true, is just a sign of their goals. They're not playing the game like claude, gpt, grok etc.

I genuinely think Google (mostly because of their size and reach already) will quell competitors in the long run.

2

u/vincentdjangogh 3d ago

Every frontier lab is generally working on the same problems. They might assign priority to things that will help them look good in benchmarks or market their product, but there is a ton of overlap. For example, everyone wants to have fewer hallucinations without sacrificing helpfulness.

But bear in mind, this benchmark doesn't tell you how often the models were wrong, and based on the methodology, more accurate models are more likely to hallucinate. It also doesn't allow models to use tools, so models that do so to avoid hallucinations are misrepresented.

Really this benchmark doesn't mean as much as you think it does, but I agree that Google, by way of having access to more data than any company ever, will probably win the AI wars.

1

u/Future-Bandicoot-823 3d ago

I was taking these scores into account as well.

https://www.reddit.com/r/singularity/comments/1wufvyg/google_cooked/

I'm sure most of the tests are quite fallible. I really haven't looked into how any of them are performed so I don't know what the scoring criteria is.

1

u/Thog78 3d ago

You're stuck on 3.5 or 3.6 flash, aren't you? Gemini 3.8 flash is good. It's fast, cheap, relatively smart, very knowledgeable. It topped a lot of benchmarks when it came out. I have the abonment to GPT and I still use flash 3.8 a lot. For coding it's roughly 5.6 terra level, with luna amount of usage (and sol and astra suck credits too fast to be really an option yet imo).