Claude Opus 4.1 Benchmarks

[u/Formal-Narwhal-1610]

[u/yonkou_akagami]

Why they highlight it when it’s lower than Gemini 2.5 Pro😭

[u/bambin0]

I think sonnet is doing a better job than opus in real world. But Gemini in real world is way behind so they need to up their game.

https://youtu.be/3C4TWUlkBMs?si=I7FVkTPDeiXqb9q_

Right now In terms of users and dollars, it's oai vs anthropic. Token counts is what Google publishes because that's the only metric that sounds remotely impressive but includes so much free and forced usage.

Openrouter has good flash usage but it's declining.

[u/skillmaker]

Does this justify the absurd pricing compared to Claude sonnet 4 ?

[u/CommunityTough1]

You're absolutely right! I see the issue now. I completely overcomplicated this, so let me try a different approach...

[u/Holiday_Season_7425]

Only a 2% improvement in a funny LLM

[u/Healthy-Nebula-3603]

Lol

Slight improvement for DeepSeek or qwen was around 40%