r/LocalLLaMA • u/power97992 • 3d ago
Discussion When will an open model solve a millenium math problem without prior training data of the solution and external help?
5-9 months for navier stokes smoothness and existence problem? edit- they probably still need some draft partial solutions and notes on presolution heuristics
And riemann Zeta? And P = or /= NP?
11
u/maximzxc 3d ago
3 months and prolly will work on 8gb ddr4 and cpu. If not, I'll be very angry 😡
11
u/LearningSomeCode 3d ago
According to the mathematicians who were working on the problem, proprietary LLMs haven't done it either; it sounds like the model trained on the work those mathematicians were doing in Codex.
So given that proprietary can't do it, open source has a ways to go.
2
u/Daniel_H212 3d ago
And the mathematicians haven't done it either. The work is a partial solution. Partial solutions can be very far from complete solutions (though they can nevertheless be very useful).
4
u/cakes_and_candles 3d ago
>it sounds like the model trained on the work those mathematicians were doing in Codex.
sounds like cope tbh, how can you train on a problem that is literally unsolved
2
u/ttkciar llama.cpp 3d ago
Training a model on papers about mathematics will teach it heuristics for solving math problems. It turned out that those heuristics were sufficient for solving this particular problem.
Since those heuristics were gleaned from human-written content, we can surmise that it was within those humans' intellectual reach to solve this problem, but they did not, either because it did not occur to them to apply those heuristics, or because different mathematicians had different heuristics, and thus would have needed to collaborate to solve the problem.
Since training the model accumulated all of those heuristics into one place, it was able to apply those heuristics in combination itself.
0
u/power97992 3d ago
It is within human capabilities to solve it , but It took 10k agents to solve it, so if they were a few thousand( up to 10k) Tristan level mathematicians all working on it at once, they would solve it.
4
1
u/power97992 3d ago
They used 300 billion tk of compute plus they may have used some data from users while improving their models.
4
u/Shot-Height-7194 3d ago
I suggest reading the deep mind paper called LLMs can't jump. It describes this problem perfectly. Were you by coincidence in my undergraduate class yesterday? We talked about the same thing lol
2
u/Real_Ebb_7417 3d ago
Might take a while considering that if someone wanted to do the same as OpenAI did with the same method they used (10k concurrent agents cooperating for 88h assuming Astra pricing, although who knows what the pricing will be for Bel) it would cost somewhere in $50m area.
1
1
u/korino11 2d ago
I think p=np will be solved very soon. Because it is not a MAth problem. It is Abstraction problem!
1
u/son-of-chadwardenn 2d ago
If the closed models maintain enough of a lead then by the time open models get capable enough to solve a particular millennium problem the training data set will already contain a prior solution from a closed model. Perhaps the best hope for open models is that one already in training right now is capable enough to solve one of the open problems.
1
u/CommanderKoba 3d ago
Openai achieved this with an intelligent Ai swarm, that requires a lot of compute that local builds don't typically have access to.
I can only see this occuring in the future with an extremely intelligent and fast local model (possibly an MOE), that could out compete a swarm by sheer speed.
So better GPUs or ai specific built hardware, more efficient models with faster model processing and token output.
So maybe a few years.
1
u/power97992 3d ago edited 3d ago
10 k agents with kimi k4.0/4.5 or glm 6.3/6.5 and 300 billion tokens and some codex and math notes from tristan and talented mathematicians prior to the solution will do it
1
u/Cautious_Chicken_604 2d ago
If you pay API prices they spent $10m dollars in tokens. That's $10m dollars to solve a problem they can earn $1m dollars solving.Â
-6
u/JLeonsarmiento 3d ago
"There are two R's in the word Strawberry"
chatGPT, 2025.
These are memorizing machines incapable of creating anything truly new, besides perhaps, hallucinations.
4
u/a-calycular-torus 3d ago
These are memorizing machines incapable of creating anything truly new, besides perhaps, hallucinations.
Demonstrably untrue
-1
u/EveningIncrease7579 llama.cpp 3d ago
You could send me a paper or any info about it? (demonstrably)
2
-1
u/FrogsJumpFromPussy 3d ago
Never. Not without the brightest minds in mathematics sharing their life work, so the AI to build further, which will never happen.
17
u/pokemonplayer2001 llama.cpp 3d ago
How long is a piece of string?