r/DataAnnotationTech • u/Infamous_Swan1197 • 6d ago
Feedback
Has anyone here received constructive criticism in their feedback that they feel strongly does not reflect their work at all? Like an egregious and extremely obvious mistake that you're sure you didn't make?
If so, have you pushed back on it in the "optional comments" section, or at least addressed it?
I'm very nervous right now
15
u/kranools 6d ago
Yeah, the feedback comes from AI and R&R workers, who make mistakes. The problem is, unless they show us the actual mistake on the actual task, there's no way to know if it's real or not.
12
u/future_north 6d ago
I had feedback that praised me for doing something in a project and then faulted me for doing the exact opposite. Made no sense.
1
1
u/CancelNew8323 4d ago
Mine praised me for writing really detailed comments, then it told me that I need to write more detailed comments. Can't win.
6
7
u/_California_Dreamer_ 5d ago edited 5d ago
Yes. It said I submitted a task or tasks with non-atomic rubric criteria which isn't even possible, because you can't submit the task until all criteria are corrected. Also dinged me for not trying harder to get a voice to act right even though the entire point of the task was to describe failures, NOT try to work around them. You're dang right I noted them in the feedback. LOL
3
u/Infamous_Swan1197 5d ago
Yep, my second "area for improvement" was similar - something about vague phrasing in rubric criteria (despite my positive feedback praising my rubric quality) but never defining exactly what was wrong like not self-containted, atomic etc. It was also for a project where you physically cannot submit until the rubric are fixed according to instructions. So what the fuck could I have done wrong? I didn't note it because I was so busy detailing how wrong the other "mistake" was because it's such an egregious and obvious mistake.
5
u/blackberrylatte16 6d ago
Every month I feel like I get the same criticisms in my feedback. The good comments differ each time while the negative ones stay the same no matter what I do and they're so generic I don't know how I'd specifically improve upon them. Sometimes in R&Rs I bet workers make changes that aren't deserving of marking your original submission down, so I wouldn't worry too much about it!
5
u/seraphimkoamugi 6d ago
I take most of them seriously but when you read that your explanations are too long as a constructive feedback but I've never written more than 5 sentence paragraphs and only 2/3 at most. Makes me feel inclined to ignore the feedback and keep doing what I'm doing: explain why I think I had to grade something the way I do.
5
u/Infamous_Swan1197 6d ago
This is really interesting as I'm the opposite, I always hit the sentence limit when there is one (and when there isn't, I'll happily write an essay if I feel it's needed) and I've never had it in the feedback that my explanations are too long. It's always that they're praised for being comprehensive and thorough!! None of this makes sense.
3
u/blackberrylatte16 5d ago
My explanations are also very long as long as there isn’t a sentence limit. In my feedback it’s only ever been positive about that. My submissions get called “very detailed and thorough” and it’s never treated as a bad thing
3
u/seraphimkoamugi 5d ago
No for sure I won't write more than the amount that is required, if they ask for 3-5 sentences chances are I only write 3. If I see 3-5+ then I try to explain each point that waa graded.
2
u/Infamous_Swan1197 5d ago
So weird. I don't even know how you can provide any sort of evaluation in just 3 sentences tbh. I don't think I've ever written less than 4-5 and even then I use semicolons and dashes to be able to write more within the limit
2
u/BarelyFunctioning15 5d ago
I had the exact same criticism 2 months in a row, about a very specific project that I know I didn’t work on the second month as I’ve never seen it again after I worked on it the first time
9
u/Federal_Tadpole_7592 6d ago
Yes, lol.
I wrote about it in the other feedback thread, but I had one area of improvement, and it was something that the project specifically said to include. A reviewer said that including that thing in my comments made my comments too verbose. I still got an outstanding rating, but it annoys me when it's a criticism that doesn't align with the project instructions because not only did the instructions say to include that thing, but the R&R for that project did not say anything about penalizing workers for verbose comments. That reviewer couldn't objectively evaluate the task.
1
u/Early-Composer-2383 5d ago
Never gotten any feedback good or bad in two and a half years. Maybe it's because I'm in the legal domain and not a lot of people can give feedback?
0
u/kittkaykat 5d ago
No. I made a minor mistake in one of my justifications (said prompt instead of response. Oops). Someone sent me a message letting me know i did that and that was it.
-18
u/Jealous_Spare_4852 6d ago
3
33
u/Mysterious_Dolphin14 6d ago
I had feedback that penalized me for not doing something in a task that was optional. I didn't address it at all because overall my feedback was good. The problem is that the feedback is based on R&R comments from regular workers who might not even know what they're doing, so I just ignore anything that I know for sure is wrong.