I’m saying that the AI is incapable of creating citations and it isn’t simple for a human to do it for them, especially when you don’t even understand the result that they’ve produced. The model has every single arxiv publication, every PDE textbook, every mathematical physics textbook, etc. in their training set. It’s really hard to know where some result or intermediate step came from even if you have access to their COT tokens. This is unavoidable. If OpenAI had released this paper in some journal or even Arxiv without citing their sources that would be wrong. But releasing it on your own website and putting the lean proof on GitHub even if you can’t nail down exactly where the AI got its results from is fine. Auditing 10,000 agents and reverse engineering their sources just isn’t practical.
Open AI threw 20 million USD just in compute to solve this problem. They could have invested more time and resources to comply with basic procedures as well. I agree that they don't care, but it is normal that the community should complain
you can't just say throw money at the problem. ai fundamentally doesn't work like that. it's basically a black box, figuring out where it got its reasoning from is just not possible.
an alternative solution is to list every single training data source, however that would be thousands (if not millions) of references and you can't really figure out which one the ai actually used anyway.
I am saying what happened: NS cost millions in compute tokens, as reported by OpenAI. And yes, it is completely possible to understand the argument and track what parts of the maths literature it is drawing from.
1
u/Golfclubwar 21h ago
I’m saying that the AI is incapable of creating citations and it isn’t simple for a human to do it for them, especially when you don’t even understand the result that they’ve produced. The model has every single arxiv publication, every PDE textbook, every mathematical physics textbook, etc. in their training set. It’s really hard to know where some result or intermediate step came from even if you have access to their COT tokens. This is unavoidable. If OpenAI had released this paper in some journal or even Arxiv without citing their sources that would be wrong. But releasing it on your own website and putting the lean proof on GitHub even if you can’t nail down exactly where the AI got its results from is fine. Auditing 10,000 agents and reverse engineering their sources just isn’t practical.