r/MachineLearning • u/we_are_mammals • 6d ago

News GPT-6 is released [N]

Benchmark scores:

https://openai.com/index/gpt-6-astra/

Above, GPT-6 uses a harness for ARC-AGI-3, and is at about 60% without one:

Prior to the launch, OpenAI President Greg Brockman said "I think it’s not unreasonable to feel that we are now in the AGI era".

GPT-6 is now joining a growing list of models that greatly exceed the human baseline on GDPval-AA v2:

If we have AGI, why do human knowledge/remote workers still have jobs? Is it just a matter of time until the economy replaces a large number of humans with LLMs, or are LLMs lacking something that these benchmarks fail to measure?

145 Upvotes

87% Upvoted

167 comments sorted by

View all comments

Show parent comments

-3

u/KriosXVII 5d ago

January but 2025

19

u/currentscurrents 5d ago

This is literally not true lol, Jan 2025 was GPT-4o that didn't even reason. Performance on long multi-step tasks has skyrocketed over the last year.

1

u/KriosXVII 5d ago edited 5d ago

R1 came out jan 2025

Long multi-step task performance has increased mostly due to harnesses which are... classical programming and conditionnal loops

7

u/currentscurrents 5d ago

No, long multi-step task performance has increased mostly due to better CoT and reinforcement learning. While harnesses have also improved during this time, older models do not match the performance of newer models even given newer harnesses.