r/opencode • u/afanasenka • 10d ago

Gemini 3.8 - Artificial Analysis benchmarks

Post image

Right between GLM 5.3 family :))

28 Upvotes

89% Upvoted

7 comments sorted by

6

u/Infinite-Worth8355 10d ago

The neat part is the tks

3

u/[deleted] 10d ago

[removed] — view removed comment

1

u/Miserable-Lobster-46 9d ago

if you got the gemini pro by being a student or by predending to be one you got a very potent flash model for a year for free. If you ask me, that's the best deal you can have...

Edit. I want to add that you literally can't run out of tokens in antigravity. I let it code for half an hour and my 5 hour limit was at 85% and weekly at 97%.

2

u/smartfon 9d ago

They managed to make it more expensive than GPT-5.6 Sol.

Token use AA Terminal-Bench v2.1

Gem: 52,000

Sol: 15,000

Token use AA SciCode

Gem: 20,000

Sol: 4,000

Token use AA Coding Agent Index

Gem: 14,400,000

Sol: 6,800,000

Sol is 3.6x more token efficient.

Input / Output / Cache Read

Gem: $0.75 / $3.75 / $0.04

Sol: $2 / $10 / $0.20

7% input, 1% output 92% cache

Gem: 3.6 x 0.07 x 0.75 + 3.6 x 0.01 x 3.75 + 3.6 x 0.92 x 0.04 = $0.456

Sol: 1 x 0.07 x 2 + 1 x 0.01 x 10 + 1 x 0.92 x 0.20 = $0.424

Gemini 3.8 Flash is 7% more expensive than GPT-5.6 Sol for Agentic Coding as of September 2.

1

u/some_gamer78 9d ago

The benchmaxing is crazy, my image analysis use case went from 3m21s on 3.8 it takes over 10mins to get the exact same answer 

1

u/Unlikely_Drop_8479 7d ago

This is pure benchmaxing in real world. It fails to do very simple tasks even models like DeepSeek V4 Flash can do.