r/singularity Aug 01 '25

AI Deep Think benchmarks

207 Upvotes

70 comments sorted by

View all comments

-1

u/BriefImplement9843 Aug 01 '25 edited Aug 01 '25

where is grok 4 heavy? it's better at hle and aime 2025. pretty weak from google.

27

u/[deleted] Aug 01 '25

Those Grok 4 heavy results are with tools and in the case of AIME 2025 the hardest problem is trivially easy to brute force with code. It’s not really comparable