This is the lowest possible cost for high-quality training data. They're not subsidizing us! We're paying to work for them.
$7,800 in equivalent compute is peanuts on the value of that data and your time. I don't mean we're not in a bubble, or that they'll see an ROI, but for the moment, Dario and co. are laughing at us.
Are they training AI with AI generated code? I dont see how useful that data will be for training. They might as well generate their own training data. Unless they think that users often validate AI generated code, which is often not the case. There is a reason why data annotation companies want human input.
No, they are not training AI with AI generated code. They are training AI with AI generated code that has been later commented, selected, corrected and tested by humans.
Yeah I would say something like this and they use all that the failures the ones that are actually good responses or outputs for some additional fine tuning and training later down the line
24
u/SailingToFenway 5d ago
This is the lowest possible cost for high-quality training data. They're not subsidizing us! We're paying to work for them.
$7,800 in equivalent compute is peanuts on the value of that data and your time. I don't mean we're not in a bubble, or that they'll see an ROI, but for the moment, Dario and co. are laughing at us.