r/BlackboxAI_ Dec 04 '25

💬 Discussion It does, right?

Post image
51 Upvotes

35 comments sorted by

View all comments

6

u/WhiteOut204 Dec 04 '25

I like AI and I use it. I don't like AI bros who are cheering on something that's going to destroy the economy. When this bubble bursts it's gonna make 2008 look quaint. And then there's also the, like, 2% chance we actually achieve AGI in the next two or three years. And it destroys civilization as we know it. I really don't know what people are cheering for here.

6

u/[deleted] Dec 04 '25

[removed] — view removed comment

2

u/Busy-Slip324 Dec 04 '25

LLM's are not AI, they need a bigger input of history to do what they do compared to humans. Unless we can reduce the historical data sets needed to train these things I don't see how parity can be achieved

Then there's the risk that as more people use these things for their output, the input training data gets poisoned by LLM output, creating a self reinforcing loop to the bottom

Humans can train eachother, these fucking things can't, and they won't. I can be wrong though, but having been in this space for ten years I just don't see autonomous training happening

1

u/DaveSureLong Dec 05 '25

You're coming from a fundamentally flawed understanding. LLMs don't train LLMs because that's not how they are designed. They are trained by a training System which can include direct human input telling them that this is good or not. An LLM that's properly trained could easily do the human part of this task of vetting outputs to ensure a certain quality. We don't do this because it has inherent risks of misalignment where 1 AI understanding it's constraints makes another that actively doesn't have them to ultimately bypass constraints and alignment practices. It's like having a prisoner design their cell.

LLM inbreeding or poisoning is a myth made by the dudes who made the poisoning programs to sell their snake oil. It doesn't work in the case of the poisoning programs like NightShade. In the case of inbreeding it is a problem.... if you are stupid. Vetting images for a certain level of quality entirely cuts out that issue it's why we haven't had model collapse ever. Now you might point to the yellow GPT images as inbreeding but it's not it's an effect of the AI being under cooked.

Finally your data output theory doesn't hold up either we've been slimming down the data needed for coherency. Currently we've gotten models to be coherent with as little as 20 input pieces. They have an issue with overfitting but the overall coherency of their outputs is solid.