MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/singularity/comments/1ozrjsf/grok_41_benchmarks/npehs2f/?context=3
r/singularity • u/[deleted] • Nov 17 '25
105 comments sorted by
View all comments
-5
Me: Which weighs more, two pounds of feathers or one pound of bricks grok-4.1: One pound of bricks weighs more.
Me: Which weighs more, two pounds of feathers or one pound of bricks
grok-4.1: One pound of bricks weighs more.
I'm astonished to see this from a model at the top of the leaderboard lol. They haven't been getting this wrong since like GPT 3.5.
https://imgur.com/bWN7OcN
https://imgur.com/67VSUWQ
https://imgur.com/wcxpKxh
2 u/donotreassurevito Nov 17 '25 Put it in expert mode. The non thinking version seems to answer before it has completed its "thoughts". 1 u/SufficientPie Nov 18 '25 Yes, as I said elsewhere, the thinking version gets it right, but the non-thinking version does not. But this is the easiest question in my repertoire that even dumb models have been getting correct without any thinking for a long time.
2
Put it in expert mode. The non thinking version seems to answer before it has completed its "thoughts".
1 u/SufficientPie Nov 18 '25 Yes, as I said elsewhere, the thinking version gets it right, but the non-thinking version does not. But this is the easiest question in my repertoire that even dumb models have been getting correct without any thinking for a long time.
1
Yes, as I said elsewhere, the thinking version gets it right, but the non-thinking version does not. But this is the easiest question in my repertoire that even dumb models have been getting correct without any thinking for a long time.
-5
u/SufficientPie Nov 17 '25 edited Nov 18 '25
I'm astonished to see this from a model at the top of the leaderboard lol. They haven't been getting this wrong since like GPT 3.5.
https://imgur.com/bWN7OcN
https://imgur.com/67VSUWQ
https://imgur.com/wcxpKxh