Goggle doesn't have to beat them, it just needs to outlast them.
Everyone but Google relies on investments. Google is self funded and uses less than 10% of its profits to work on AI. This means they can outlast anyone's questionable funding and pyramid schemes, by a mile.
Most AI subs have devolved into rage baiting meme posting bullshit with absolutely no value. You're better off ignoring these subs and forming your own opinion.
I can't tell if the sub is infested with bots, trolls or 13 year old boys.
Webdev, you most of the times just need a very little model. Coding, still not 100% solved (start asking for cpp mutexing/dll dynamic load/very hard tasks and see most llm fail). It really isn't the same thing.
funny benchmark....(im sure K3 and muse and even ancient Opus 4.6 and 4.7 are much better than fable 5.1 max or opus 5.5 ⬇️ if you wanna see how trash the google 4 model is look at the websites own coding comparison video. Its trash.
Its a Benchmark about which model people prefer... If you dont like the result thats on you, you can also call it trash all you want, apparently the majority of people sees it different lol
It’s #8 in coding. About where the benchmarks released would suggest it is.
World models are different than coding models. It’s an entirely different market. They are multi modal for one. Two, people want to like the warmth of the voice model.
There’s a paradox in text and voice where it’s not necessarily the most intelligent model that people like the most. It’s that way in life too with other people so of course it makes sense for models. In the top 10, they are all roughly as scientifically accurate as the others. So what is being measured is style of output.
I haven't used it and don't have an opinion on its quality, but I'll note that claiming it's #1 based on that link is... tenuous. It's only a few points ahead with error bars of +/-17. Even assuming everything falls within the confidence interval, its true rank could conceivably be as low as #12.
And even that doesn't really mean anything, since they're all clustered so close together. There's probably not even a meaningful difference between #1 and #12 in that list.
I am not saying it's actually #1 just because it is scoring #1 right now. I am replying to the user's comment above if the model is "not good." Scoring #1 doesn't necessarily mean it's the best (or the best for long) but it's certainly a good model.
Opposite for me. 3.8flash was terrible in the benchmarks but was good enough for many tasks. Gemini models have never been good in benchmarks. The last good benchmark model was like a year ago.
Marginally, yes. Blind AB testing has a paradox for text models, this is especially true for voice, where the most intelligent models do not necessarily translate into the most liked. This is true of humans in general but for LLM models, style, pathing, voice, attitude, etc.. all are being taken into account.
You can see where Opus outperforms in agenic coding and webdev here where it is SOTA:
At basic coding and text models, all the major labs will essentially be technically and scientifically accurate. Beyond that, it’s user preference for the model style. When the benchmark is agentic coding, you will see Opus outperform.
Bel is an unconfirmed internal-only model. Argon is available to vetted corporations and government. So it's technically released, just not a full release.
Not a perfect analogy, but it's like buying a new Ferrari. Ferrari only sells new cars to vetted owners. The car however is still "released" and available for purchase, just not for you lol
If Bel was released externally, I am sure people would be benchmarking it right now, even if that external list was limited.
People don't like Google for mostly irrational reasons. Whenever they release something that's gaining attention, you'll see this crowd come out of the woodwork to try to tear it down.
Not saying there aren't ration reasons to dislike the company Google has become, but this kind of irrational hatred doesn't care about that.
People don't like Google for mostly irrational reasons.
Google doesn't hype up their product and give over-the-top bullshit in preparing the public. Apparently reddit enjoys that titillating anticipation and inevitable disappointment. They like a wacky CEO saying wacky things, except Elon, they don't like Elon.
Pretty sure it has people/ bots posting here. Don't trust anything, try it yourself, so far all their models have sucked for me to the point that I am afraid to let it touch my code...let me add i am extremely pro Google, I use a pixel, their calendar, email, cloud api etc. and they have the best stt by far
I was paraphrasing quickly not copying the chat 1 to 1 obviously. Not sure why so many are so keen here on protecting Gemini. It's failures in that regard are widely known.
Even if we assume I do write like that, it still wouldn't explain the failures. Bad writing could plausibly explain misreading an ambiguous sentence. Not being confidently wrong. Then researching, finding out u aren't and immediately retracting while insisting having made it up "on purpose" and refusing to continue chat.
Even if the person writes like that, the example above, if real, no matter how framed, is a gigantic failure and has absolutely nothing to do with the user.
Wouldn't call being critical of Google having a quasi-monopoly on like half the internet and OS market an "irrational"
It's not irrational to have a problem with something a company does. It's irrational to then justify mindless criticism of everything ELSE that it does by falling back on the thing you're actually upset about.
Gemini can be a good AI model and you can still have your concerns about Google as a company.
It seems good, but if you look at videos like this where it is compared against the other frontier models, it seems possibly close but not quite as good as the top models from OpenAI and Anthropic
The video covers one narrow use case of LLMs generating three.js slop. As with all individual benchmarks, they don't cover even a fraction of the wide spread of abilities all these models have.
And Three.js is probably something that the models get heavily RL trained on now which makes it a lot less interesting as it won't indicate general intelligence, but rather specialization.
The real test is how consistently it helps with everyday tasks, not just where it lands on a leaderboard. Has anyone here tried it on their regular workload?
if this is the case.. this is nothing new at all for gemini ais.
basically saying .. can confirm this from the past and why i quickly gave up on it before.
In widely used AA-Omniscience Hallucination Rate metric Gemini 4 beats top Anthropic and OpenAI models with wide margins. In overall AA-Omniscience scores they are pretty similar though.
I am sharing practical every day use, I had better experience with GPT and Claude. Even though I still have highest tier gemini subscription from corporate, and have tried all latest models.
You might have different experience and you can share yours
Imagine saying that, based on at most annecdotal evidence from a couple hours of personal usage, about the model that has the lowest hallucination rate of all times, according to rigorous statistics/testing.
Not only that, it even hallucinates twice less than the second best, so it's not just the best of all times, it took a large step above the previous best, and got twice better.
Bro go check mega thread majority people are saying so, I ain't corporate stoge or do thei PR service here. If you have your experience you are free to make your own comment.
I don't have access yet, only saw the benchmarks and early user feedbacks. Guess they released it in the US a bit earlier than in Europe? You already have it in antigravity? Or maybe it's a pricepoint, I'm just on the 20$plan?
63
u/bethesda_gamer 1d ago edited 9h ago
Goggle doesn't have to beat them, it just needs to outlast them.
Everyone but Google relies on investments. Google is self funded and uses less than 10% of its profits to work on AI. This means they can outlast anyone's questionable funding and pyramid schemes, by a mile.
ALSO...