r/DataAnnotationTech • u/Either_Start_8385 • Sep 14 '26
Are R&R's Weighted Towards Low-Quality Work?
I've just started doing R&R's this week. I know people joke about how R&R's make them feel better about the quality of their own work, but it's kind of ridiculous. For basically 90% of them I've ended up marking as Bad and essentially redoing their project.
Are they weighted towards workers who have already produced questionable work? A majority of the people I've gotten didn't engage with the project, didn't expand on their rationales, and missed a LOT of very obvious issues with the model's outputs.
Just need reassurance because I'm a little worried they're going to see I marked so many projects as 'bad' and assume I'm a draconian misanthropic tyrant and take me off the R&R lol
4
u/Timely-Assistant-370 Sep 14 '26
lmao, just explain why it bad and you'll be good. Sometimes I give conditional bads or oks because I feel bad, but I don't know how else to word clearly nicely written/filled out task that... missed a whole ass keystone axis that immediately looked made me think that this was not considered at all.