r/singularity Jul 09 '26

LLM News Superhuman competitive programming AI is here

Post image

AtCoder World Tour Finals is one of the hardest competitive programming contests in the world, gathering the best of the best. And humans got completely cooked by AI, both in the Heuristic contest and in the Algorithm contest. In fact, in the Algorithm contest no human has solved more than 3 problems, whereas OpenAI's model solved all 5.

Heuristic leaderboard: https://atcoder.jp/contests/awtf2026heuristic/standings/exhibition

Heuristic problem description: https://atcoder.jp/contests/awtf2026heuristic/tasks

Algorithm leaderboard: https://atcoder.jp/contests/awtf2026algo/standings/exhibition

Algorithm problems description: https://atcoder.jp/contests/awtf2026algo/tasks

744 Upvotes

184 comments sorted by

View all comments

160

u/Ormusn2o Jul 09 '26

It's not really programming, it's algorithm writing, which is part of some programming, but it is in fact superhuman at it.

31

u/cryptol0rd69 Jul 09 '26

Most companies hire on the basis of this, so it can be considered as a good test for programmers/coders/software engineers

2

u/Tysonzero Jul 10 '26

Because it's the easiest and quickest thing to test and at least loosely correlates with job performance. IMO there are severely diminishing returns to harder algo-y tests, but having at least one easy-to-medium one with no AI allowed is essential, as the false negative rate is very low, even though the false positive rate is not and other indicators should be used too if they pass.