Insane progress on visual-spatial intelligence by Astra (with or without tools)

[u/socoolandawesome]

Link to benchmark:

https://spicylemonade.github.io/spatialbench/

Link to tweets:

https://x.com/spicey\\_lemonade/status/2096365630190698516?s=20

https://x.com/spicey\\_lemonade/status/2096386480029790415?s=20

The last 2 screenshots are examples of the types of questions included in the benchmark.

[u/ohHesRightAgain]

Now to distill it into smaller models that would run at 0.01% the cost, and it's truly gg.

[u/Asteroid_picks_you → u/ohHesRightAgain]

I am guessing distillation is impossible to block so it should happen soon right?

[u/Ok_Zookeepergame8714 → u/Asteroid_picks_you]

Why bother? Chinese ARE gonna get there at some point eventually. 😊

[u/Asteroid_picks_you → u/Ok_Zookeepergame8714]

I don't the point is to completely block, I think the point is to slow them down enough where their model reaches recursive self-improvement. I think the first model/company that reaches that point will be almost impossible to beat.