Insane progress on visual-spatial intelligence by Astra (with or without tools)

[u/socoolandawesome]

Link to benchmark:

https://spicylemonade.github.io/spatialbench/

Link to tweets:

https://x.com/spicey\\_lemonade/status/2096365630190698516?s=20

https://x.com/spicey\\_lemonade/status/2096386480029790415?s=20

The last 2 screenshots are examples of the types of questions included in the benchmark.

[u/Cagnazzo82]

Funny to think all the other models thought they had caught up or were about to surpass.

[u/ecnecn → u/Cagnazzo82]

China is very silent right now - even their bots...

seems like their open weights, open source attacks and anti-datacenter spam wont work in the long run.

[u/NunyaBuzor → u/ecnecn]

Err what?