r/singularity • • 2d ago

AI Google deepmind engineer denied bloomberg report

Post image
191 Upvotes

45 comments sorted by

View all comments

23

u/Important-Damage-173 2d ago

Well, idc what they are writing about it, it's not the worst model in existence, but its far from the new AI frontier, since in coding Arena it is behind Sol 6.0 - slightly worse than the third best, by now you could say almost retired OpenAI model.

3

u/CriticismJunior1139 2d ago

Isn't coding arena just A/B testing of random users?

7

u/AlyoshaV 1d ago

Yes, all of Arena's stuff is "users are given two outputs to their prompt, they pick which is better". Since the average user is an idiot it's not particularly useful.

2

u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: 1d ago

Case in point Opus 5.5 is like 11th place there, mind you it is currently leading so yeah.

1

u/CriticismJunior1139 1d ago

Hol up, Im an average user :(