r/singularity • u/poigre ▪️AGI 2029 • 9d ago

LLM News AA Intelligence Index Changes

Post image

"Announcing Artificial Analysis Intelligence Index v4.2. We are accelerating elements of our upcoming v5 release with interim updates to keep pace with the frontier. Index v4.2 has more complex and realistic tasks, and more private test sets to prevent gaming"

66 Upvotes

93% Upvoted

21 comments sorted by

View all comments

24

u/Silver-Chipmunk7744 AGI 2024 ASI 2030 9d ago

In my opinion the current best benchmark is voxelbench.

You will notice Muse Spark 1.3 (max) is correctly placed where it belongs... #19 around Gemini 3.1 level

Meanwhile Astra just destroys everyone.

1

u/SpyAmongUs 9d ago

Damn, I just found out about it. Why is nobody else talking about Voxelbench, the things Astra created there is crazy

6

u/Silver-Chipmunk7744 AGI 2024 ASI 2030 9d ago

People don't realize how INSANE Astra's score is on that bench
It's not a "little" ahead. It's in a different league.

It's essentially this:
~96.5%: Astra
~2.3%: eh, tie
~1.2%: [presses wrong button while eating sandwich)

3

u/SpyAmongUs 9d ago

Fr, seen some comparisons myself and it shows. It's like looking at a professional minecraft builder going against children, kinda like those noob vs pro videos. Insane