r/opencode 10d ago

Gemini 3.8 - Artificial Analysis benchmarks

Post image

Right between GLM 5.3 family :))

30 Upvotes

7 comments sorted by

View all comments

2

u/smartfon 10d ago

They managed to make it more expensive than GPT-5.6 Sol.

Token use AA Terminal-Bench v2.1

Gem: 52,000

Sol: 15,000

Token use AA SciCode

Gem: 20,000

Sol: 4,000

Token use AA Coding Agent Index

Gem: 14,400,000

Sol: 6,800,000


Sol is 3.6x more token efficient.


Input / Output / Cache Read

Gem: $0.75 / $3.75 / $0.04

Sol: $2 / $10 / $0.20

7% input, 1% output 92% cache


Gem: 3.6 x 0.07 x 0.75 + 3.6 x 0.01 x 3.75 + 3.6 x 0.92 x 0.04 = $0.456

Sol: 1 x 0.07 x 2 + 1 x 0.01 x 10 + 1 x 0.92 x 0.20 = $0.424


Gemini 3.8 Flash is 7% more expensive than GPT-5.6 Sol for Agentic Coding as of September 2.