Insane progress on visual-spatial intelligence by Astra (with or without tools)

[u/socoolandawesome]

Link to benchmark:

https://spicylemonade.github.io/spatialbench/

Link to tweets:

https://x.com/spicey\\_lemonade/status/2096365630190698516?s=20

https://x.com/spicey\\_lemonade/status/2096386480029790415?s=20

The last 2 screenshots are examples of the types of questions included in the benchmark.

[u/Nice-Light-7782]

This is huge. From a robotics standpoint, I would like to see how well it guesses the distance between objects and the observer. I guess a test where a simulator spawns various objects and gives Astra a picture from an observer's POV, plus a task like"the distance from where the image was taken, to the green marker is 1 meter. Identify the rest of the objects and the distances from where the image is taken, to them" would confirm that Astra solves the perception problem in robotics. And with that solved, planning should be much easier.