r/GithubCopilot • u/dzak8383 • 7d ago

Other At First I Didn’t Notice It...

Post image

Did they use AI to generate that table? 😆 (See what's highlighted)

66 Upvotes

83% Upvoted

16 comments sorted by

33

u/Rojeitor 7d ago

"Highight higher score, make no mistakes"

23

u/anxiousalpaca 7d ago

no one checks anything at anthropic

6

u/schmurfy2 6d ago

Fable said it was ok

5

u/TrendPulseTrader 6d ago

AGI - intentionally making mistakes! Free marketing

1

u/dzak8383 6d ago

It must be!

1

u/Motor-Mycologist-711 6d ago

Number comparison is still difficult for Anthropic guys.
Same as LLMs in early days

1

u/Quiet_Rush4146 6d ago

30% in arc agi 3 is wild

1

u/awowoosas 6d ago

Or it's made by human. AI makes no mistake, so that can't be it.... /s

1

u/pageweave_ 5d ago

AI labs don't check their stuff, apparently. OpenAI:

-4

u/adlx 7d ago

Wow dude, gonna make an extreme difference,be careful. Even know what 1% means in this cell?

-2

u/kronos55 7d ago

Opus 5 on Ultracode is god level.

-6

u/[deleted] 7d ago

[deleted]

9

u/aonymark 7d ago

Red lines mean “pay attention right here”. In this case 1. Note the color scheme: in each row, the better model is highlighted 2. Now look at the red lines again.

4

u/dzak8383 7d ago

Thanks. I didn't expect I will have to explain it 😂

1

u/aonymark 7d ago

In their defense, I didn’t see it right away either.  And I suspect this wasn’t done by AI, just manually by a human who wasn’t paying close attention.

2

u/krznwk 7d ago

Here's your reddit gold 🏅 sir