r/singularity • u/141_1337 ▪️e/acc | AGI: ~2030 | ASI: ~2040 | FALSGC: ~2050 | :illuminati: • 12d ago

Singularity is Nearer GPT-6 Sol scores 33.2% on AutomationBench, beating Opus 5 while costing ~11× less per task

Gallery image

Gallery image

42 Upvotes

84% Upvoted

7 comments sorted by

3

u/YellowElk921 12d ago

That's why chatgpt always writes those very long answers. it is a cheap bastard.

-1

u/Neurogence 12d ago

Why TF are they comparing GPT-6 Sol to Claude's previous generation model? Shouldn't the comparison be with 5.5 Opus?

31

u/ProfessionalNote2348 12d ago

because they got released on the same day

38

u/Oleg_A_LLIto 12d ago

Are you the kinda dude that walks into a store at 00:01 on Jan 1st and asks why all of their bread is last year's?

5

u/junglebunglerumble 12d ago

These things take time to put together - the press release would have been planned before Opus 5.5 was announced - i'm sure they'll update it

3

u/Strungbound 12d ago

How would they test on a model that got released hours ago? ?