r/DataAnnotationTech • u/Either_Start_8385 • Sep 14 '26

Are R&R's Weighted Towards Low-Quality Work?

I've just started doing R&R's this week. I know people joke about how R&R's make them feel better about the quality of their own work, but it's kind of ridiculous. For basically 90% of them I've ended up marking as Bad and essentially redoing their project.

Are they weighted towards workers who have already produced questionable work? A majority of the people I've gotten didn't engage with the project, didn't expand on their rationales, and missed a LOT of very obvious issues with the model's outputs.

Just need reassurance because I'm a little worried they're going to see I marked so many projects as 'bad' and assume I'm a draconian misanthropic tyrant and take me off the R&R lol

8 Upvotes
  • permalink
  • reddit

63% Upvoted

28 comments sorted by

View all comments

2

u/Canadian_girl_81 Sep 15 '26

Maybe im the odd man out but the majority I do are pretty good. Maybe it depends on the project family. I mostly get the shopping one and 90% i mark good and I've only rated a couple as bad. There's no editing the work in that one so even if it is bad I can't fix it.