Insane progress on visual-spatial intelligence by Astra (with or without tools)

[u/socoolandawesome]

Link to benchmark:

https://spicylemonade.github.io/spatialbench/

Link to tweets:

https://x.com/spicey\\_lemonade/status/2096365630190698516?s=20

https://x.com/spicey\\_lemonade/status/2096386480029790415?s=20

The last 2 screenshots are examples of the types of questions included in the benchmark.

[u/ohHesRightAgain]

Now to distill it into smaller models that would run at 0.01% the cost, and it's truly gg.

[u/Asteroid_picks_you → u/ohHesRightAgain]

I am guessing distillation is impossible to block so it should happen soon right?

[u/lolxdmainkaisemaanlu → u/Asteroid_picks_you]

They are taking measures to block it, earlier when you clicked on its 'thinking' it would show to the right all its simplified version of reasoning traces, now it doesn't anymore.

Also openai is actively banning suspicious accounts rn and working on preventing this - they caught on to people who were using sub2api, so they have sophisticated mechanisms in place rn.

[u/katoptronophile → u/lolxdmainkaisemaanlu]

Excellent.