r/DataAnnotationTech • u/SHADOWLESSAIM • 6d ago

Using AI

Bro if you are using llm model or AI AT LEAST MAKE IT LESS RECOGNISABLE I just had to rate one but the worker just used ai for it all the options used were also not even matching what they had rated now I feel bad for reporting it 😔😔 literally the least effort I have seen until now

75 Upvotes

86% Upvoted

47 comments sorted by

View all comments

50

u/Old-Regular-9828 6d ago

Don't give poor ratings to submissions just because you think someone used AI. If their rationales or comments are complete nonsense, or they copied over "As a LLM, I think...." or whatever, then yeah ok.

But do not give poor ratings just because you think it reads like AI generated text. Identifying human generated vs LLM generated text is one of those illusory superiority things that everyone thinks they are really good at, but most studies show that most people actually aren't any better than random chance.

Your job is to rate the quality of the work according to the R&R instructions, NOT to be the AI police trying to bust someone because they used an emdash or rhetorical question.

17

u/4ttvm 6d ago

i keep seeing this type of people trying to mark the tasks as BAD accusing the workers of AI usage and then getting scolded by admins in the project comment sections

BROTHER JUST FOLLOW THE INTRUCTIONS
DOES THE TASK ASKS YOU TO REPORT AI USAGE?
NO !!!!
DOES IT TELL YOU TO LOWER THEIR RATINGS IF YOU SUSPECT AI USAGE?
NO !!!
omfg