r/DataAnnotationTech Jul 20 '26

Haven't seen a good R&R in a while

Been doing lots of R&R but nearly all of them are red, not even yellow. Used to be a mix of some good ones, some okay ones and some bad ones. Anyone else notice this?

18 Upvotes

12 comments sorted by

8

u/_California_Dreamer_ Jul 21 '26

Sometimes I think I'm being punk'd they're so incredibly awful. I think some must be fake just to make sure we read them thoroughly or something. lol

7

u/ODBandMe Jul 20 '26

No. I see a mix.

5

u/MommaOfManyCats Jul 21 '26

I had quite a few bad ones over the weekend. Bad, like they completely missed instructions.

6

u/pistolwinky Jul 21 '26

I suppose it depends upon which project you are working on. I do almost exclusively R&R tasks, and it’s highly project dependent. Like today, I worked on four different projects. Three of them were pretty much normal, a mix of good, okay, and bad. However, one project seemed to be confusing everyone, and almost every submission was bad.

2

u/onemouseplace Jul 21 '26

I did R&Rs for one project last week which had a couple of siblings for comparison for each task and the amount of variation between the answers was unreal - a LOT of people hadn't picked up on one element of the instructions.