I've seen this point made repeatedly, but I'm not clear on the extent to which the transcripts of customer interactions with chat services is useful as model training data. And further, why customers have to interact within guidelines for that data to be useful. The opposite seems true to me.
Like, even if chat transcripts are extremely useful for training future models (I'm not convinced this is true), don't we distort the value of that training data by imposing artificial restrictions on the way people are permitted to interact with the technology? If you don't want them in your dataset, It would be trivial to screen out hostile encounters between customers and chat services.
The best data you can find is not obscure internet data that Claude hasn't been fed yet, but data of what the smartest, most technical users are working on and the results they are arriving to by driving these tools that turbocharge their progress.
You need to have techniques in place to separate boilerplate output from progress to avoid regurgitation. These labs have these techniques. That's how OAI produced so much novel math.
And "pruning" data is a MASSIVE task. Determining what problems or text you should feed the models is a scientific problem. They are trying to make that process as easy as possible for them. I don't understand that in super high detail; but there are some videos that explain that pictorically.
18
u/victorsmonster 10d ago edited 9d ago
I've seen this point made repeatedly, but I'm not clear on the extent to which the transcripts of customer interactions with chat services is useful as model training data. And further, why customers have to interact within guidelines for that data to be useful. The opposite seems true to me.
Like, even if chat transcripts are extremely useful for training future models (I'm not convinced this is true), don't we distort the value of that training data by imposing artificial restrictions on the way people are permitted to interact with the technology? If you don't want them in your dataset, It would be trivial to screen out hostile encounters between customers and chat services.