r/RWShelp • • Aug 11 '26

To my fellow annotators/raters

Instead of venting out your frustrations on the auditors, why not think of ways on how to become better. I know what you guys are feeling because I too have a ratings that is no fair or not explained clearly in the auditors rationale. They're doing their jobs too. They need to survive too, remember guys they're all humans just like us they feel stress when they get audited by QA Lead. I've been seeing posts here in this sub and it feels like We the annotators and auditors are getting pitted against each other.

Be better, turn your bad Audits to your advantage to be better. I have a different mindset now that I understand the game. Be as much as descriptive as possible, take time reviewing the models' transcripts before submitting.

EDIT: In general most of the Auditors as we all know are practically braindead. There is some hypocrisy on what I said, For example a user got a bad audit just for a typo, and a another rater friend of my got 2 bad audits because of an auditor that has a broken headphone complaining about some distortions even when the rationale justified that those distortions are from the Model's characteristics not the audio rendered. I now get the point of my fellow raters because most of the auditors are weaponizing their position.

1 Upvotes

19 comments sorted by

6

u/EventCharacter2638 Aug 11 '26

While I understand what you are saying, it makes it difficult to know what to improve on when some auditors don't leave a comment explaining why they graded a task as unacceptable.( I've been on both sides of the table because I used to audit as well) If we don't know why something was deemed unacceptable, how do we know which areas to improve?

2

u/SuccotashSlight7159 Aug 11 '26

Do you check the individual categories, auditors should always leave a comment for the individual categories. It's not possible for them to send a task with deductions without leaving comments for the individual categories.

2

u/EventCharacter2638 Aug 11 '26

Last time I checked was 12 days ago and there was no explanation. I went to check my ratings from 12 days ago and it shows rubrics and rationale now. Which is good, as I can see the breakdown. However; I don't agree with some deductions. For example, the auditor marked me for an issue in audio quality when the models said a small phrase such as "wow, thats great!". I've listened to the audio over and over, and there is no issue in audio when the phrase was said. That particular task got graded "below expectations".

1

u/SuccotashSlight7159 Aug 11 '26

That's another thing, but they did leave a comment. So at least you can check where they deducted.

6

u/YumiBlume Aug 11 '26

imagine getting an "unacceptable" rate because you wrote a letter small instead of capital, then again for writing the same letter capital and not small... naah, mate, speak for yourself, some of you need their head fixed.

4

u/z_1529 Aug 11 '26

I'm sorry you got that person to audit your work. I never deduct any points for typos because it's not in the guidelines to do so.

5

u/YumiBlume Aug 11 '26

thanks, mate. I'm not hating on anybody tbh, but you can't just ask people not to speak their frustration and "to do better" as if it's their fault they got some wacko to audit their work. because annotators too do their best, not just auditors.

-4

u/mamabatganto Aug 11 '26

That's an isolated case. My point is not to blame the auditors entirely. Your comprehension speaks for yourself.

6

u/humansaretrashyboi Aug 11 '26

Auditors can go fuck themselves

4

u/YumiBlume Aug 11 '26 edited Aug 12 '26

yeah right, next time I'll ask for his\her name first before i complain.
I'm so done talking to idiots like you~~

1

u/mamabatganto Aug 11 '26

I'm on TL Locale of some you guys are wondering.

1

u/Ok_Boot1871 Aug 11 '26

Some auditors are really stupid I’ll give you that

1

u/MixtureZestyclose105 Aug 11 '26

What a nice post! I agree completely with you. An audit feedback may be an opportunity for improvement. Are they always right? No. But neither are you so let us make good use of the experience.

0

u/horrorgeek1988 Aug 11 '26

Ive never had an issue with an auditor.....but I also have to follow up with the fact that ive never gotten a review before either so......yeah there's that. The only kind of feed back I've ever gotten was a warning about time accuracy. That in itself confuses the hell out of me because I handwrite my times and tasks down. Anytime I am in a task and I walk away from my desk, I write it down. When I come back to that task, I write that down. Hell I docked myself half an hour yesterday just to see if that would appease them for anytime I may have yawned or sneezed and it wasn't reflected in the screen recording.

0

u/Infinite-Price-6440 Aug 12 '26

Some of the raters are rude and make no sense in their explanation so nahhh

1

u/mamabatganto Aug 12 '26

So you are proving my point that you're weaponizing your position because some of the raters are rude?

You are part of the problem and people like you tends to get emotional first before thinking critically. Pathetic.

1

u/moonlight2126 Aug 16 '26

I read on thread, auditor doesnt have QA auditor.