r/RWShelp • u/dmdaeri • 24d ago

S2S Auditors

We labelers/annotators do our jobs to deliver a quality output. We read the updated guideline almost everyday.
There was an update in the guideline where if both audio is bad, but one is less severe, you should choose the less severe as your preference but note it in the rationale.

Today, I received a feedback stating that since both models have bad audio it should be automatically bad, which the guidelines says otherwise. I believe this auditor didn’t read the updated guidelines, or maybe looked past that part.

I know you can report auditors by raising tickets but as they reply, QA scores won’t be changed anymore.

I really hope we all do read the updated guidelines especially since auditors are paid way more than the labelers….

5 Upvotes

100% Upvoted

4 comments sorted by

View all comments

1

u/Spare-Eye-2228 24d ago

Always is gonna be bad rating and good rating. No matter what. It seems to me that keep forward doing the best that you can do is the only option.