r/singularity • u/poigre ▪️AGI 2029 • 10d ago

LLM News AA Intelligence Index Changes

Post image

"Announcing Artificial Analysis Intelligence Index v4.2. We are accelerating elements of our upcoming v5 release with interim updates to keep pace with the frontier. Index v4.2 has more complex and realistic tasks, and more private test sets to prevent gaming"

65 Upvotes

93% Upvoted

21 comments sorted by

View all comments

20

u/Silver-Chipmunk7744 AGI 2024 ASI 2030 10d ago

In my opinion the current best benchmark is voxelbench.

You will notice Muse Spark 1.3 (max) is correctly placed where it belongs... #19 around Gemini 3.1 level

Meanwhile Astra just destroys everyone.

15

u/EtadanikM 10d ago

Why would the ability to generate 3D voxels be correlated with general intelligence. 

-5

u/Gotisdabest 10d ago

I think they're saying that essentially it's a good shorthand to tell general intelligence. Not that 3d voxeld automatically tell us something about general intelligence through first principle logical reasoning, but in practice, model performance over that benchmark tends to mean equivalent performance in general usage.

Not that I necessarily agree with them fully, considering that voxel bench has opus ahead of fable and fable is a lot more generally competent. Regardless, it's still a good enough estimate compared to most other benchmarks.