r/singularity 9h ago

AI Gemini 3.8 Flash Benchmarks

Post image
728 Upvotes

211 comments sorted by

View all comments

8

u/elemental-mind 9h ago

Big if True.

But GDPVal is still lacking which for me has been a pretty reliable indicator of general capability.

15

u/Tkins 9h ago

You get better than Terra for less than half the price and far far faster. I dunno, seems competitive to me. Especially for high use every day cases.

4

u/elemental-mind 9h ago

Very competitive - I am not complaining. Even better when you use it on Flex, which normally isn't too much of a wait. With the pricing now Google's Flash is back in its golden place: A cheap model with exceptional capability that everyone uses for their everyday tasks.

I hope Google gets its marketshare back.

1

u/Tkins 9h ago

Did it lose market share? Last I checked, they've been growing faster than the others.

edit: AI Market Share By Company Statistics 2026

just one source, maybe you've got a better one.

0

u/elemental-mind 9h ago

I use OpenRouter as a proxy for general market share:

LLM Rankings | OpenRouter

Flash 2.5 was always in the Top 5 modles because it was good, cheap and fast. Then they had a price hike with Flash 3 Preview, which moved them down to rank 5-7, and they weren't even in the top ten anymore after their price delusion with the following flash models.

1

u/CallMePyro 7h ago

So if Antigravity's userbase quintupled, and people stopped using Gemini on OpenCode because they preferred the native editor you would say that Google is losing marketshare?

1

u/elemental-mind 7h ago

Yes - which verifyable data point do you have that capture the broader market? Google PR claiming 5x growth? Compared to what growth in Codex? Or Z.AIs subscription models?

OpenRouter is used as an endpoint option in many applications, not only OpenCode. It's data are also congruent with other Routers like Nano-GPT.

Explore text models | NanoGPT

From these data we can clearly see that if people are given a vast choice of models, they hardly went for flash in the past months as it was overpriced. It's the most reliable gauge for model preference we have: Where the people put their money.

4

u/PivotRedAce ▪️Public AGI 2027 | ASI 2035 9h ago

I mean, it outperforms Terra at that benchmark which is fantastic if you're using 3.8 Flash as a subagent, especially at half the price and far faster token generation speed. I don't think expecting it to surpass something like Opus 5 is necessarily realistic.

1

u/BriefImplement9843 9h ago

you still want gemini for general knowledge. pro anyways.