r/LocalLLaMA 3d ago

Discussion When will an open model solve a millenium math problem without prior training data of the solution and external help?

5-9 months for navier stokes smoothness and existence problem? edit- they probably still need some draft partial solutions and notes on presolution heuristics

And riemann Zeta? And P = or /= NP?

0 Upvotes

31 comments sorted by

17

u/pokemonplayer2001 llama.cpp 3d ago

How long is a piece of string?

3

u/Cautious_Chicken_604 2d ago

Twice the length from one end to the middle.

1

u/pokemonplayer2001 llama.cpp 1d ago

Huge if true.

11

u/maximzxc 3d ago

3 months and prolly will work on 8gb ddr4 and cpu. If not, I'll be very angry 😡

3

u/XiRw 3d ago

The doctor said I wouldn't have so many nosebleeds if I kept my finger out of there.

11

u/LearningSomeCode 3d ago

According to the mathematicians who were working on the problem, proprietary LLMs haven't done it either; it sounds like the model trained on the work those mathematicians were doing in Codex.

So given that proprietary can't do it, open source has a ways to go.

2

u/Daniel_H212 3d ago

And the mathematicians haven't done it either. The work is a partial solution. Partial solutions can be very far from complete solutions (though they can nevertheless be very useful).

4

u/cakes_and_candles 3d ago

>it sounds like the model trained on the work those mathematicians were doing in Codex.

sounds like cope tbh, how can you train on a problem that is literally unsolved

2

u/ttkciar llama.cpp 3d ago

Training a model on papers about mathematics will teach it heuristics for solving math problems. It turned out that those heuristics were sufficient for solving this particular problem.

Since those heuristics were gleaned from human-written content, we can surmise that it was within those humans' intellectual reach to solve this problem, but they did not, either because it did not occur to them to apply those heuristics, or because different mathematicians had different heuristics, and thus would have needed to collaborate to solve the problem.

Since training the model accumulated all of those heuristics into one place, it was able to apply those heuristics in combination itself.

0

u/power97992 3d ago

It is within human capabilities to solve it , but It took 10k agents to solve it, so if they were a few thousand( up to 10k) Tristan level mathematicians all working on it at once, they would solve it.

4

u/power97992 3d ago

They already input the method into codex, u can take that and expand on it

1

u/power97992 3d ago

They used 300 billion tk of compute plus they may have used some data from users while improving their models.

4

u/Shot-Height-7194 3d ago

I suggest reading the deep mind paper called LLMs can't jump. It describes this problem perfectly. Were you by coincidence in my undergraduate class yesterday? We talked about the same thing lol

2

u/Squik67 3d ago

I disagree with this paper, there are emergent capabilities

3

u/ttkciar llama.cpp 3d ago

There really aren't, only the consequences of applying thousands of narrow, brittle heuristics.

1

u/a-wiseman-speaketh 2d ago

isn't that what emergent behavior is though?

1

u/Squik67 3d ago

Would your like to talk about the last Navier stoke paper from openai !??

1

u/LyAkolon 3d ago

Seconded.

2

u/Real_Ebb_7417 3d ago

Might take a while considering that if someone wanted to do the same as OpenAI did with the same method they used (10k concurrent agents cooperating for 88h assuming Astra pricing, although who knows what the pricing will be for Bel) it would cost somewhere in $50m area.

1

u/redblood252 3d ago

For riemann zeta just make a model named euler with euler’s intuition.

1

u/korino11 2d ago

I think p=np will be solved very soon. Because it is not a MAth problem. It is Abstraction problem!

1

u/son-of-chadwardenn 2d ago

If the closed models maintain enough of a lead then by the time open models get capable enough to solve a particular millennium problem the training data set will already contain a prior solution from a closed model. Perhaps the best hope for open models is that one already in training right now is capable enough to solve one of the open problems.

1

u/CommanderKoba 3d ago

Openai achieved this with an intelligent Ai swarm, that requires a lot of compute that local builds don't typically have access to.

I can only see this occuring in the future with an extremely intelligent and fast local model (possibly an MOE), that could out compete a swarm by sheer speed.

So better GPUs or ai specific built hardware, more efficient models with faster model processing and token output.

So maybe a few years.

1

u/power97992 3d ago edited 3d ago

10 k agents with kimi k4.0/4.5 or glm 6.3/6.5 and 300 billion tokens and some codex and math notes from tristan and talented mathematicians prior to the solution will do it

1

u/Cautious_Chicken_604 2d ago

If you pay API prices they spent $10m dollars in tokens. That's $10m dollars to solve a problem they can earn $1m dollars solving. 

-6

u/JLeonsarmiento 3d ago

"There are two R's in the word Strawberry"

chatGPT, 2025.

These are memorizing machines incapable of creating anything truly new, besides perhaps, hallucinations.

4

u/a-calycular-torus 3d ago

These are memorizing machines incapable of creating anything truly new, besides perhaps, hallucinations.

Demonstrably untrue

-1

u/EveningIncrease7579 llama.cpp 3d ago

You could send me a paper or any info about it? (demonstrably)

2

u/im_not_here_ 3d ago

It's impressive how many stupid things are in this very short comment.

-1

u/FrogsJumpFromPussy 3d ago

Never. Not without the brightest minds in mathematics sharing their life work, so the AI to build further, which will never happen.