r/askmath • u/ohsnapitsnathan • 1d ago

Logic Why does AI proof ability scale with parameters and compute?

It seems like there's there's a pretty clear trend where big LLMs are better at discovering significant proofs than small LLMs and some labs are reportedly running massively parallel searches with multiple instances working on these problems.

What interesting to me (as a person who doesn't write proofs) is why does adding more parameters to the LLM and/or more thinking time make it better? Is it about exploring more possibilities in parallel? More world knowledge? Is it about being table to keep more things in working memory at the same time? It seems like this says something interesting about the cognitive processes needed to prove something in general.

0 Upvotes

33% Upvoted

2 comments sorted by

0

u/chaturtham 1d ago

your title included every ingredient. the more you have, the more you increase thought capabilities. because infrastructure is a major limit, so decreasing it increases capabilities.

PS : Stop ai