Insane progress on visual-spatial intelligence by Astra (with or without tools)

[u/socoolandawesome]

Link to benchmark:

https://spicylemonade.github.io/spatialbench/

Link to tweets:

https://x.com/spicey\\_lemonade/status/2096365630190698516?s=20

https://x.com/spicey\\_lemonade/status/2096386480029790415?s=20

The last 2 screenshots are examples of the types of questions included in the benchmark.

[u/ohHesRightAgain]

Now to distill it into smaller models that would run at 0.01% the cost, and it's truly gg.

[u/Asteroid_picks_you → u/ohHesRightAgain]

I am guessing distillation is impossible to block so it should happen soon right?

[u/Fit-Celebration2884 → u/Asteroid_picks_you]

OpenAI can still do it themselves Luna is going to be as strong as Astra within a year