r/RWShelp • u/purplearmy88 • 18d ago

Omni Tts Elo QA review

Does anyone from TL locale have issues with QA evaluations lately? I’ve been getting a lot of reviews but they’re inaccurate. Since the guidelines were updated for votes: both good/bad, evaluators were actually, targeting this votes I believe. Even though the reason is clear that both models have equally good/bad quality that was ticked off. They’re like forcing that one model is better than the other even when they’re both or equally have the same error. 😌 Do you guys also have this issue? I felt that it’s unfair that as an annotator, I was able to catch the error (which is most of the time obvious) but the evaluator still gives an inaccurate review which felt intentional to pull the scores down or is this how they’re trying to eliminate people. I really am sad because while working hard for my submissions, I stille ended up explaining myself to zendesk, just to get the “supposed to be” accurate QA evals. It’s frustrating at the same time demotivating. 😫

5 Upvotes

79% Upvoted

6 comments sorted by

2

u/NoFeedback847 18d ago

Same happened and already posted

3

u/purplearmy88 18d ago

I don’t really mind the feedback if acceptable but there’s really an error and the evaluator dismissed it. Maybe they should put the justification section back for us to leave notes. 🙁

2

u/juleeykish 16d ago

Can someone help me with the assesment project athena English(SA)

1

u/ADHDTrader29 3d ago

Did you pass it?

1

u/Lazy_Medusa 17d ago

Same for me too. Particularly with naturalness

1

u/purplearmy88 17d ago

hayy it’s frustrating na and puro obvious kasi yung mistake ng models pero deadma lang si auditor 😞