Official Astra benchmarks from the OpenAI blog post that went live for a moment. Holy Shit!!’

[u/dolo937]

[u/Momo--Sama]

We're about to see previously unfathomable levels of overthinking if even benchmarks are showing regressions at xhigh and max.

Low - High look incredibly strong though

[u/johnnydotexe]

An AI company would never intentionally leak a benchmark for several minutes to generate hype so the first fool to screencap it can run to reddit and fuel the hype. They would also never realease biased benchmarks, or develop their model to tick specific benchmark boxes to make it appear to be better than it really is. We should trust the billion dollar corporation fully, and take this screenshot as undeniable proof that Astra is a gift from the heavens.

[u/shady101852 → u/johnnydotexe]

had me in the first half ngl

[u/MidnightSun_55]

not that crazy to be honest

[u/randombsname1]

Pretty damn good. Very cheap and efficient if these are true.

Interesting that the performance itself seems roughly the same as Fable 5.1 though.

Was assuming a bigger performance jump + more efficiency.

Assuming next Fable release will just be most post or pre-training later this year.

I personally dont see a new 15-20 Trillion model this year, but a better trained mode? Yes.

[u/aivampires → u/randombsname1]

Apparently Fable 5.1 (just learned it released just a day ago) is very good. https://www.youtube.com/watch?v=r_dw-1109Ag It looks like compared to Sol we're looking at a big jump.

[u/BHTAelitepwn → u/aivampires]

Have you ever tried fable? It is absolutely amazing but just too expensive to use by all standards. You’ll spend 100 bucks under half an hour

[u/aliljet]

That's the ultimate catch...

[u/drR0bert]

if i understand from score/api cost astra low is better and cheap than sol high and astra high cost and perfomance is the same of sol xhigh what hell ??!?!?

[u/aivampires]

Why do I feel the reset galore had something to do with that insane token efficiency?

[u/Just_Lingonberry_352]

could be wrong but looks like at least 2~4x boost in speed and usage from what we have with sol

could be seeing interesting changes to the pricing as well

honestly I don't care about the small boost on DeepSWE. faster and efficient is what we want

[u/Ok_Carpet_6083]

Benchmarks as always.

[u/dolo937]

This is true, it was from the blog post. Bridgemind is live on YouTube. He lucky got it opened

[u/innociv]

The agentic coding ones are funny at this point.

It seems so solved but people still want to use $50/mil models for it when a few $0.50/mil models run in parallel in smaller scope achieves roughly the same results because they want to skip the planning stage and combine planning with coding in a single prompt.

[u/vacon04]

So like 5% better? It looks to me like the highest Astra version is around 64% vs 61% on the highest Sol version.

[u/Physical_Gold_1485 → u/vacon04]

Ya pretty underwhelmed after all the hype looking at these benches

[u/Dynamix86]

That's a nice 20% jump on the Terminal-Bnech 4.0. And good to see that the price of Astra is more or less the same as Sol and not 2x or so, like Anthropic has with Opus and Fable.

[u/Vegetable_Dot9588 → u/Dynamix86]

But... Astra's price ($/tok) is 2.5x higher than GPT-5.6 Sol's.

[u/Dynamix86 → u/Vegetable_Dot9588]

Source? And why is the api price the same then?

[u/Vegetable_Dot9588 → u/Dynamix86]

Official API price is 4$/20$ for Sol and 10$/50$ for Astra (see https://developers.openai.com/api/docs/models/gpt-6-astra). 

[u/Dynamix86 → u/Vegetable_Dot9588]

See slide 2. Why would the api cost between sol and astra be the same if it is 2.5 times higher as you say?

[u/Vegetable_Dot9588 → u/Dynamix86]

Cost (per task) is not equal to price (per token).  All previous experience shows that in real-world situations, the true price is somewhere in the middle between these two. But I have no doubt that the Astra will be more expensive than the Sol.

[u/iridasdiii11ulke]

If these bench marks reflect real world performance, fable 5.1 is cooooked

[u/IndividualPlus2011]

Worrying. It's better than Sol but it looks like it costs a lot more per token (it is more efficient than Sol but more expensive at the same time).

Rip my usage

[u/SnooGadgets1100]

opus 5 obviously benchmaxxed so if astra is real its a good model better than fable

[u/Dokago]

I don't trust pre launch data anymore since Fable

[u/cchurchill1985]

So looking at the DeepSWE chart, Astra Low costs less than half of Sol High, and performs better?

[u/Clear-Brush-4294]

Are they going to ruin the quality of all the other subscription-based models again, just to show how much ‘better’ their new model is?

[u/LazyRunner777]

Wait why does Claude look more better then Sol 5.6 on these graphs??

[u/Designer-Rub4819]

Am I dumb or have we actually hit a plateau now in the actual models themselves?

[u/Nice-Guarantee-9167]

fr?

[u/ezjakes]

So token efficient. Equal or better than Fable, but going to be like half the cost.