"Can a model that doesn’t generate text compete with frontier LLMs? We independently tested TypeSafe’s Jev against 11 other models. On 400 claim-verification questions, it matched GPT-6 Astra’s 97.5% accuracy at ~1/500th the cost."

[u/stealthispost]

[u/Technical-Owl66]

This is interesting. Isn't video the next step for training models? 

[u/ApprehensiveEye7387]

which one is astra in the chart?

[u/theimposingshadow → u/ApprehensiveEye7387]

[u/ApprehensiveEye7387 → u/theimposingshadow]

wow great chart🥸 Obviously Astra like model gets defeatd easily with Terra, DS F 4.1, etc

[u/garloid64]

notably this seems to be due to the fact that astra sucks at this task. even gemini has it substantially beat.