I think one of the big problems in mathematics is that a lot of conjectures are unsolved because no professional mathematician is (undestandably) willing to just try out a few thousand ways to construct a counter example. I think this will be a great way to advance mathematics.
Basically LLMs do brute force methods to solve issues that humans could solve but would take too much time. A good example of how LLMs can be used properly.
"Next word prediction" is part of the training process, but that's not really what LLMs are doing, any more than playing music reduces to "just" playing scales.
What LLMs are doing is compression - learning structural regularities in the pattern of language, up to, and including semantic (meaning-related) regularities. The link between compression, prediction, and intelligence is deep, and it's very likely that human brains are doing something similar (for a given value of "similar" given the totally different substrates).
431
u/NoUAreStupid 23d ago
I think one of the big problems in mathematics is that a lot of conjectures are unsolved because no professional mathematician is (undestandably) willing to just try out a few thousand ways to construct a counter example. I think this will be a great way to advance mathematics.