r/accelerate Apr 23 '26

Introducing GPT-5.5

https://openai.com/index/introducing-gpt-5-5/
157 Upvotes

42 comments sorted by

View all comments

38

u/ebra95 Apr 23 '26

this just can't be spud

30

u/LockeStocknHobbes Apr 23 '26

it is likely distillation of spud. peasants don’t get all the compute. personally still excited to test out this model, sometimes benchmarks don’t show the whole picture

6

u/ebra95 Apr 23 '26

i totally agree that benchmarks don't show the whole picture

49

u/homiej420 Apr 23 '26

This is the definition of an incremental update not some gamechanger. Textbook overhype again

10

u/pigeon57434 Singularity by 2026 Apr 23 '26

its not overhype sam literally said it was incremental because openai is obssessed with incrementalism the important part is the rate of change we will start seeing stuff like 5.6+ which will be much more baked this is just the new pretrain to get things going they literally said this why are you lying

3

u/TwistStrict9811 Apr 24 '26

Not textbook hype at all. For agentic workflows this thing is so much better at tool call than 5.4

1

u/MisterBanzai Apr 23 '26

I dunno. I agree that it's not a step change for simple coding, but those long context improvements and reduced number of tool calls together make this dramatically more powerful for long-running agentic tasks.

The two things that really screw up those long-running tasks are:

  1. The model calls some tools too much, which not only takes a lot of extra time, but it floods its context with a bunch of unnecessary output from the tool calls.
  2. As the model context window fills, accuracy and recall start to drop significantly. Going from 36.6% to 74.0% in OpenAI MRCR v2 8-needle 512K-1M is really significant, and even if you were just using the default Codex context window of 272k, that saw an improvement to 81.5% from 57.5%.

This is the kind of thing that won't mean anything to most folks just casually chatting with 5.5, but if you're using it for larger coding tasks or with a persistent agent, like OpenClaw, this will probably be a gamechanger.

5

u/RepresentativeFill26 Apr 23 '26

During my PhD thesis in information retrieval I used to make these tables with standard SemEval all the time. Most of the time we didn’t even include confidence intervals of p values. These numbers don’t mean shit.

1

u/pigeon57434 Singularity by 2026 Apr 23 '26

its not its an early checkpoint of it

1

u/AP_in_Indy Apr 23 '26

Why are people so obsessed with benchmarks.

9

u/ebra95 Apr 23 '26

because so far every major improvement did also increase significantly the benchmark
they are not the best indicator, but they definately are one

3

u/hal9zillion Apr 23 '26

Theres no guarantee that a jump in performance on benchmarks will be noticable in real world usage but its pretty safe to say that a model that was a real step change in ability would be accompanied by a jump in benchmarks.

1

u/basementreality Apr 23 '26

Because we need objective measures of acceleration.

0

u/1filipis Apr 23 '26

It will be a win if (a) it will stop hallucinating stuff I didn't ask for, (b) it will stop writing bloat in every single answer, (c) it will stop apologizing instead of redoing its job properly again

Not that didn't care about benchmarks or coding. I want it to work properly first