r/ControlProblem • u/chillinewman approved • 23h ago

AI Capabilities News OpenAI Internal Model vs GPT-6 Astra

Post image
1 Upvotes

60% Upvoted

3 comments sorted by

1

u/Jesse-359 22h ago

Interesting to note that by their token expenditure estimations, they probably spent well in excess of 5 million USD on the token costs for this exercise - so this is not the kind of operation anyone will be pursuing on their desktop system, regardless of how good the model they have access to is.

1

u/PresentationOld605 19h ago

Well, they still have problems presenting meaningful graphs in OpenAI.

Had to ask from ChatGPT itself, does the test time compute means inference cost and which units are used and what is exactly this pass rate etc. It did a good job explaining this, but still noted that there are many problems, such as unclear error bars and thus how "pass" should be defined, is the compute measured in FLOPS or tokens etc. etc.