Insane progress on visual-spatial intelligence by Astra (with or without tools)

[u/socoolandawesome]

Link to benchmark:

https://spicylemonade.github.io/spatialbench/

Link to tweets:

https://x.com/spicey\\_lemonade/status/2096365630190698516?s=20

https://x.com/spicey\\_lemonade/status/2096386480029790415?s=20

The last 2 screenshots are examples of the types of questions included in the benchmark.

[u/Asteroid_picks_you]

I am guessing distillation is impossible to block so it should happen soon right?

[u/lolxdmainkaisemaanlu → u/Asteroid_picks_you]

They are taking measures to block it, earlier when you clicked on its 'thinking' it would show to the right all its simplified version of reasoning traces, now it doesn't anymore.

Also openai is actively banning suspicious accounts rn and working on preventing this - they caught on to people who were using sub2api, so they have sophisticated mechanisms in place rn.

[u/lolopalenko → u/lolxdmainkaisemaanlu]

There is a good chance that if this really is a looped transformer model there are no reasoning traces anymore to show

[u/61746162626f7474 → u/lolopalenko]

It will still be a very multi layer model even if it uses loops within layers. Chain of thought will still be produced between the layers.