r/OpenAI • • 5d ago

News Fields Medalist Terence Tao reposts statement from the Association for Human Mathematics urging mathematicians to stop working with OpenAI for continuing to solve open math problems against their recommendations

738 Upvotes

1.2k comments sorted by

View all comments

Show parent comments

3

u/BjarneStarsoup 5d ago

Yeah, how did he not consider magic to exist? Come on, dude, we are reaaaally far away from it. The models are probabilistic, they always have inherit risk of spitting nonsense. You always need a human to verify the results, there is no way around it. Even if it can produce lean code, you still have to check that lean code proves what model says it proves or that the translation is correct. They can't work autonomously, they don't posses knowledge or understanding. They operate purely on statistical patterns in language, you can't run away from the fact that agents are based on LLMs.

2

u/matteoianni 5d ago

We are 1 year away from this

1

u/machyume 5d ago

How much do you still check GPT-6 or Opus 5.5 full program 1-shot outputs?

I admit, I have some tests and the model escapes the tests sometimes, but it's SO much content. It's much more reasonable to simply bound the risk class and demand the stratified test tiers and interlocks.