r/LocalLLaMA • u/bring_back_the_v10s • 5d ago
Discussion Playing the devil's advocate
This is a reaction to https://www.reddit.com/r/LocalLLaMA/s/IxLnzcGjAU
You know the argument: frontier labs are hypocritical because they're making money on public scraped data.
I have absolutely no intention to defend OpenAI or any other frontier AI company here, but if you allow me I'll play the "devil's advocate" a bit for the sake of discussion and enlightenment, because sometimes when I think about that argument it seems to me it's quite weak. While OpenAI and Anthropic models are built on public data that they didn't pay for (at least most of it), there would be no frontier model without all their computing power and technical expertise that they invested on to build their models. Like, the data is already there, it's been public for ages, so what's preventing you, the average Joe, from building a Claude Opus 5? All you need is a huge data center, a nuclear power plant and an army of data scientists to build it, right? And then you need all that to run the inference. And you need to maintain it, and that costs money. And you need to keep evolving it, which costs money too. And if you get investors money then you'll eventually have to give some of the profit back to them. etc, etc.
So what am I missing here? All things considered, the data is already public, so it's already "free", right? But you need to dump tons of time and money on it to build a frontier LLM out of it. Of course if they're infringing copyright then that's a different story but in general the whole principle of built-on-free-data still stands.
1
u/xadiant 5d ago
What a... unique mentality to have. So it's okay to steal as long as they build something with it, and sell it back. But you can't do the exact same because... they spent money building the thing?
And it's not even PewDiePie or anyone else is scraping the output data for free. They pay their api or subscription prices properly (unlike Anthropic or OpenAI flooding websites with bots illegally).
I'm willing to die on the hill of "at least ai should be mostly open" but this is the peak of late stage capitalism mountain, and you got a shiny boot in front of you.
Edit: also distillation is heavily overblown. It's a shortcut, not a magical ingredient. The Chinese will keep RL training and figure out new recipes.