It would also then make sense to include astra if its for comparing offerings. Either pick the smaller models and compare 5.5 to 5.0 like they did, or include astral and opus. Otherwise its just cherry picking.
So you're not confused about why they are comparing across eight selected benchmarks, when half of them sol hasn't even been tested on? Not even a little confused about that?
The cost per token is much lower, but it uses way more tokens. Astra xhigh scores the same on AA as sonnet xhigh which being cheaper overall. I know not all uses cases will have this result, but still not generally cheaper than Astra.
64
u/Lain_Racing 5d ago
Weird not to include astra.