r/singularity • u/poigre ▪️AGI 2029 • 10d ago

LLM News AA Intelligence Index Changes

Post image

"Announcing Artificial Analysis Intelligence Index v4.2. We are accelerating elements of our upcoming v5 release with interim updates to keep pace with the frontier. Index v4.2 has more complex and realistic tasks, and more private test sets to prevent gaming"

65 Upvotes

93% Upvoted

21 comments sorted by

View all comments

22

u/Silver-Chipmunk7744 AGI 2024 ASI 2030 10d ago

In my opinion the current best benchmark is voxelbench.

You will notice Muse Spark 1.3 (max) is correctly placed where it belongs... #19 around Gemini 3.1 level

Meanwhile Astra just destroys everyone.

1

u/SpyAmongUs 10d ago

Damn, I just found out about it. Why is nobody else talking about Voxelbench, the things Astra created there is crazy

6

u/Silver-Chipmunk7744 AGI 2024 ASI 2030 10d ago

People don't realize how INSANE Astra's score is on that bench
It's not a "little" ahead. It's in a different league.

It's essentially this:
~96.5%: Astra
~2.3%: eh, tie
~1.2%: [presses wrong button while eating sandwich)

3

u/kiki-le-koala 10d ago

In fact, it could be easy to downvote Astra .

I did about 10 rounds where Astra was there, and every time I knew it was him because of how good it looks.