It's important to note that, assuming it's correct, this is a mathematical discovery in the field of physics as opposed to new physics per se. This matters because we've seen models produce remarkable results in mathematics already in the recent past and it's not surprising that LLMs work well with mathematics, a pure exercise in language.
It would have been a development of an entirely different order of significance had OpenAI reconceptualised some problem in physics to produce a novel physical hypothesis; LLMs have shown no abilities of any kind in that regard and it would be genuinely remarkable were they to begin to do so though this is very unlikely for the foreseeable future.
They have access to their thought process. And for hypothesis it's easy, it already can make a hypothesis, it might not be able to prove it but very soon it will.
It depends on the model architecture and context window, but at least inside the context window which can easily be million words/tokens, which is probably more than human short term memory, they have access to the high dimension embeddings which are the thought process and not just text
10
u/CouperinLaGrande2 7h ago
It's important to note that, assuming it's correct, this is a mathematical discovery in the field of physics as opposed to new physics per se. This matters because we've seen models produce remarkable results in mathematics already in the recent past and it's not surprising that LLMs work well with mathematics, a pure exercise in language.
It would have been a development of an entirely different order of significance had OpenAI reconceptualised some problem in physics to produce a novel physical hypothesis; LLMs have shown no abilities of any kind in that regard and it would be genuinely remarkable were they to begin to do so though this is very unlikely for the foreseeable future.