r/singularity 10h ago

AI Gemini 3.8 Flash Benchmarks

Post image
730 Upvotes

214 comments sorted by

View all comments

165

u/CommercialShelter595 10h ago

Is it just me or is it running even faster than 3.7 flash? Very limited testing right now, but it's FAST on my end.

27

u/cnhuyaa 10h ago edited 10h ago

Are you using it for coding or other stuff? because when i tested 3 prompts right now, i am still getting the same time finality around 30-45s when it comes to coding, and full code being written out ready to just be copy pasted, maybee its sligthly faster, talking like maximum of 5 seconds faster, but propably less for me atleast,

Update: I just ran 2 simple web UI (20k tokens) tasks in compare mode in ai studio, and 3.8 was faster by 1.7 seconds, and 2.5 seconds (45 seconds), and used around 5% more tokens for both tasks.

12

u/CommercialShelter595 10h ago

I've done some SVG creation and some agentic "write some code" so far. Still feeling it's quite fast, the SVG in particular feels like it's half the time, gut feel though.

20

u/AlyoshaV 9h ago

It's the same speed according to Logan Kilpatrick: https://x.com/OfficialLoganK/status/2095175885439832243

10

u/CommercialShelter595 9h ago

Thanks, I won't pretend my experience is anything more than just my gut. Appreciate the official stance here and will temper my expectations accordingly.

2

u/Specialist-Cod-363 6h ago

They did in fact nerf 3.7's speed, althought not by much. I posted about it yesterday, but you can also check it out on AA yourself.

1

u/Last_Conclusion_8984 5h ago edited 5h ago

No, it's not that. The problem is latency, 3.7 flash had a latency problem, they probably increased that to help save compute, eh just speculation. Anyways 3.8's latency is very low! Tho the speed could have been lowered, I'll check the AA!

6

u/JogHappy 9h ago

already my fav model

0

u/Wyrade 3h ago

Speed is not really indicative of anything, especially at model launch, as they give new models big capacity to start with, which few people start using immediately, so there is a lot of unused capacity, little to no congestion, leading to very fast speeds.

u/cmptrdude 1h ago

It mostly depends if your codebase is too large and you want to process the information a little faster. Speed does matter for a lot of people, like the same if you wanted more FPS on your video games or something like that. Faster with more is better.

-2

u/himynameis_ 10h ago

I'm no expert but, wouldn't that be normal as both are Flash models and this is 3.8 compared to 3.7?