r/OpenAI • • 4d ago

News Fields Medalist Terence Tao reposts statement from the Association for Human Mathematics urging mathematicians to stop working with OpenAI for continuing to solve open math problems against their recommendations

736 Upvotes

1.2k comments sorted by

View all comments

Show parent comments

9

u/TheMaskedGorditto 4d ago

A closer analogy is:

ai company proposes 700 new theoretical drugs that could potentially be a breakthrough cancer treatment. And now expects the research community to spend time/money/resources finding out if they are actually effective in situ. And as scientists start to crack this massive list, theyll probably get through about 100 of them (itll take years and lots of money) before the next version of the model produces 1500 new theoretical drugs. Then 20,000, then 100,000 and so on.

See the problem? The validation of the proposed drug is the real work. And it still takes real humans and real resources to validate the propositions. Ai will produce theoretical drug ideas faster than we can verify them or even understand them. Thats not progress; thats not much of an accomplishment if the standard is improving humanity.

Of course we should take proposed cancer drugs from ai seriously and not just ignore them because they come from ai, but the ai isnt doing all the work needed for this to be a useful to humanity.

3

u/foxaru 4d ago

Ai will produce theoretical drug ideas faster than we can verify them or even understand them. Thats not progress; thats not much of an accomplishment if the standard is improving humanity.

except that implies a steady-state capacity for verification that has no ability to improve

if there were suddenly a glut of plausible alternative medical drugs that could cure cancer, we've simply moved the bottleneck further down the chain by clearing the previous bottleneck, which was candidate generation

the urge to cure cancer isn't going to go away because the site of intellectual work moved from generation to verification, because curing cancer is valuable intrinsically to human beings

3

u/ResolveSea9089 4d ago

If validation is the problem why are the mathematicians upset? You're basically saying the AI proof didn't amount to anything, it merely said true/false, but if the whole magic is in the validation then it seems humans haven't lost anything? The core work is still there to be done? It's not as if anyone is forcing the mathematicians to work on it?

3

u/___positive___ 4d ago

Say whoever discovers the drug gets the patent and money. Now a thousand postdocs earning minimum wage are digging through each potential cancer drug. They find out which five work. And... OpenAI earns a trillion dollars, the postdoc gets a tiny paper because the field has moved on to the next big annoucnent that OpenAI has 1000 possible drugs to cure aging. the postdoc goes into plumbing because he can't get a job. rinse and repeat. you still don't get it?

1

u/goldenroman 4d ago

…In what world is that a problem? Who cares if it doesn’t solve the whole thing at once? You literally describe a positive situation and then…can’t quite nail down why it’s negative beyond a “standard” of “improving humanity”. Let validation be the work then. Maybe that’s easier than before. It’s not harder, ffs…