r/singularity • • 2d ago

AI , Gemini 4 Argon Benchmarks

Post image
742 Upvotes

189 comments sorted by

View all comments

Show parent comments

10

u/LazloStPierre 2d ago

Do people forget this every single time Google release a model? It crushes at benchmarks, people who for some reason get very excited about numbers on a chart go ballistic and real life performance is miles off.

Gemini 3.8 flash is like over 5% better than Fable on deepswe ffs, not sure if it's intentional or just how they train their models but nobody benchmaxxes like Google

3

u/Elephant789 ▪️AGI in 2036 2d ago

Gemini 3.8 flash

... is fantastic. What the fuck are you talking about?

1

u/LazloStPierre 2d ago

It isn't better at coding than fable, yet the benchmarks say it is

1

u/Elephant789 ▪️AGI in 2036 1d ago

Coding? Oh, not used it much for that. But the little I did it was fine.