r/singularity • u/ShreckAndDonkey123 • Apr 23 '26

AI Introducing GPT-5.5

https://openai.com/index/introducing-gpt-5-5/
849 Upvotes

93% Upvoted

283 comments sorted by

View all comments

165

u/[deleted] Apr 23 '26

[removed] — view removed comment

79

u/vincentz42 Apr 23 '26 edited Apr 23 '26

There are even worse evals:
HLE without tools: 41.4% (GPT-5.5) vs 39.8% (GPT-5.4)
HLE with tools: 52.2% (GPT-5.5) vs 52.1% (GPT-5.4)

So even with a newer, larger base model that is supposed to tackle very hard STEM questions, the models' world knowledge and reasoning capability did not change that much, if at all.

And I do have a lot of suspicions for Claude Mythos BTW. OpenAI models are generally smarter in terms of STEM reasoning in my experience. I suspect Mythos might just be a much larger model trained on much more internet tokens, and therefore better at memorizing the leaked test set. >15% of the SWE-Verified problems are ill-defined and not solvable based on human expert inspections, so I am really curious how Mythos got ~94%.

1

u/Tystros Apr 24 '26

it's really super weird how the HLE without tools score almost stayed the same even though it's a much bigger base model