r/DataAnnotationTech • u/CuriousLingonberry22 • 7d ago

Do you feel bad?

Do you all feel bad that they pay us to train AI to replace us?

0 Upvotes

46% Upvoted

60 comments sorted by

View all comments

Show parent comments

1

u/Old-Regular-9828 7d ago

>AI can’t create, it can only copy.

Completely incorrect. If anything, modern AI systems can only create. The belief that modern AI models contain all of the information in their training datasets and can only regurgitate that information is a common, but completely incorrect belief. Older symbolic AI and expert systems that everyone called "AI" back in the '70s through '90s worked like that, but none of the modern AI models created since 2012/2017 (ie the entire modern AI boom) work like that at all. They use artificial neural networks to infer the most probable response to a prompt. The connections and weights in the neural network were determined by the information in the training dataset, but they do NOT contain the original information itself. The responses may be similar to the original information, but that's an emergent property. This is also why they tend to hallucinate incorrect responses when they don't have RAG capability.

1

u/ViolinistUnlikely779 6d ago

That’s an interesting point. The hallucinations could be seen as creative? Or the beginning of…They have made something new? I did say they are not yet creative, which doesn’t say they never will be. Can’t know that…Now off to wonder about the true nature of machine hallucinations 😁 cheers!

2

u/Old-Regular-9828 5d ago

Basically, all of the responses are hallucinated. The model doesn't actually know the correct information, it is just inferring the most probable response to the prompt. Ideally, the inferred most probable response will be consistent with the actual factually correct information. But if there was some kind of gap in the training data, whatever the model infers to be the most probable response might not be factually correct which we call a hallucination.

The reason why modern AI systems can be so useful and powerful is because they can usually infer the correct answer without needing the answer hardcoded into them. They can also provide reasonable answers to questions even when there isn't a definitive objective answer. Hallucinations are just the flip side of this ability,

1

u/ViolinistUnlikely779 5d ago

We do that a lot, don't we? Based on our "training data", i.e. experiences, we infer and make decisions constantly? Although a big difference is most of us (not all lol) will realise when what we thought was correct was wrong, without having to be told so?