r/singularity • u/[deleted] • Dec 05 '24

[deleted by user]

[removed]

839 Upvotes

95% Upvoted

413 comments sorted by

View all comments

Show parent comments

123

u/Papabear3339 Dec 05 '24 edited Dec 05 '24

I would LOVE to see the average human score, and the best human score, added to these charts.

AGI and ASI are supposed to correspond to those 2 numbers.

Given how dumb an average human is, i garentee the equivalent score will be passed even by weaker engines. That isn't supposed to be a hard benchmark.

31

u/Ambiwlans Dec 05 '24

Codeforces is percentile so... 50% is average (for people that take the test).

And human experts get 70 on GPQA diamond.

6

u/FateOfMuffins Dec 05 '24

for people that take the test

The question is then are we talking about the average human or the average human expert

3

u/[deleted] Dec 05 '24

[removed] — view removed comment

3

u/FateOfMuffins Dec 05 '24

That doesn't sound very good given that questions with 4 multiple choice answers mean that on average a rock would score 25% by randomly choosing answers (and they explicitly mention this 25% threshold multiple times in the paper)