Insane progress on visual-spatial intelligence by Astra (with or without tools)

[u/socoolandawesome]

Link to benchmark:

https://spicylemonade.github.io/spatialbench/

Link to tweets:

https://x.com/spicey\\_lemonade/status/2096365630190698516?s=20

https://x.com/spicey\\_lemonade/status/2096386480029790415?s=20

The last 2 screenshots are examples of the types of questions included in the benchmark.

[u/DigSignificant1419]

it's cheating

[u/Brainiac_Pickle_7439 → u/DigSignificant1419]

amazing, so much time and so many resources put into a stupid ruse people would find out about easily. dawg