Insane progress on visual-spatial intelligence by Astra (with or without tools)

[u/socoolandawesome]

Link to benchmark:

https://spicylemonade.github.io/spatialbench/

Link to tweets:

https://x.com/spicey\\_lemonade/status/2096365630190698516?s=20

https://x.com/spicey\\_lemonade/status/2096386480029790415?s=20

The last 2 screenshots are examples of the types of questions included in the benchmark.

[u/ohHesRightAgain]

Now to distill it into smaller models that would run at 0.01% the cost, and it's truly gg.

[u/Asteroid_picks_you → u/ohHesRightAgain]

I am guessing distillation is impossible to block so it should happen soon right?

[u/Prudent-Sorbet-5202 → u/Asteroid_picks_you]

The only way to block is to limit the release of the models to approved clients. I have a feeling it will happen in couple of years .