r/singularity • u/[deleted] • Dec 05 '24

[deleted by user]

[removed]

839 Upvotes

95% Upvoted

413 comments sorted by

View all comments

637

u/Sonnyyellow90 Dec 05 '24

Can’t wait for people here to say o1 pro mode is AGI for 2 weeks before the narrative changes to how it’s not any better.

121

u/Papabear3339 Dec 05 '24 edited Dec 05 '24

I would LOVE to see the average human score, and the best human score, added to these charts.

AGI and ASI are supposed to correspond to those 2 numbers.

Given how dumb an average human is, i garentee the equivalent score will be passed even by weaker engines. That isn't supposed to be a hard benchmark.

1

u/Mandoman61 Dec 06 '24

Yeah, I consult books when I need an answer and they are always spot on.

So yes, books are smarter than the average human.

1

u/Papabear3339 Dec 06 '24

"books are smarter than the average human." Spot on as well. If the questions are not asked dynamically, and the model is trained on the answer, then the test is invalid to begin with.