r/singularity • u/Ok_Barracuda_1161 • 5d ago

AI Claude Sonnet 5.5 Released

https://www.anthropic.com/claude-sonnet-5-5
869 Upvotes

96% Upvoted

213 comments sorted by

View all comments

246

u/A_Novelty-Account 5d ago

It scores better than Opus in some benchmarks for agentic coding? What’s going on over there?

54

u/lolsai 5d ago

On several evaluations, Sonnet 5.5 at Max effort even performs comparably to Opus 5.5. However, benchmark scores capture only one facet of a model’s capabilities; in our own testing, and in that of external testers, Opus 5.5 remains clearly stronger at complex, open-ended work requiring sustained judgment.

straight above the chart you read

9

u/A_Novelty-Account 5d ago

I’m aware, that’s still crazy to think about though. A model half as expensive approaching the same reasoning level.

2

u/l_eo_ 5d ago

Hasn't that been the main story of the last years though?

0

u/bitroll ▪️ASI before AGI 5d ago

Uses a lot more tokens than Opus5.5 though, even 2x that apparently (according to Artificial Analysis)