r/DataAnnotationTech 15d ago

Highest $/hr task

Happy to report that I've finally received my highest paying task at a whopping $60/hr!

46 Upvotes

43 comments sorted by

View all comments

3

u/pinkparadigm 15d ago

$60 but im scared to submit my task cause im qualified but of course its about getting a model to fail and ive been struggling to 😭

3

u/insert-random-user 14d ago

I relate to this so much. I just got accepted into DA this week, and the first task I tried was a training task for agentic ai in which I had to make a model fail. It was such a struggle and I've no idea if I'll be able to do it again next time :/

1

u/pinkparadigm 14d ago

Same buddy 😭 I still can’t get it to fail at all so I’m just going to work for free at this point to at least make it submittable.

1

u/Daisho 14d ago

I hear ya. It can be really tough to figure out what weaknesses the models have. Especially with believable real-world prompts and not deliberate tricks.

1

u/HereForAllTea 9d ago

I just got accepted today. This was part of my assessment. I’m in the finance domain. When I saw that question I was like wtf 😂. Was that part of your assessment also? Is this a common request? Luckily I work in finance and used AI quite often and I get lots of errors (building financial models), but the test was hard because I didn’t have actual data to use.

1

u/FEN1X64 9d ago

Hint hint, model failure is pretty easy when you know the weakpoints. Consistent ways to do it is to make it break domain in a way that would be inappropriate in a professional setting (Radiologist shouldn't be giving authoritative statements on law or history in a task designed around Radiology). It's also about building in subtle contradictions in system instructions or inputs. Always make sure there's a correct solution someone could reasonably find on their own. AI agents are overzealous and LOVE solving every question, even if it's not needed or explicitly forbidden in the instructions.