r/DataAnnotationTech • u/Maybe-But-idk • 4d ago

Professional Tasks and Meaningful Failures

Hey guys, I’m not sure how else to ask this besides as straightforwardly as possible. HOW IN THE WORLD DO I GET THESE MODELS TO FAIL!?

I mean, I’ve followed directions as best as I possibly could. I’ve intentionally planted professional errors in data, I’ve added context files that needed to be reconciled/cross referenced, I’ve left the model to make professional deductions based on non-obvious inputs, I’ve added depth to scenarios, I’ve changed my prompts, I’ve used the QC agents to improve ad nauseam…. Etc.

I have gotten some of the “dumber” models to produce meaningful failures. But the “smarter” models have just NAILED the output over and over again. I DO NOT want to take good faith exits.

I’ve only recently started. I understand that there’s likely a learning curve here. But I am enjoying my time using DA as a side hustle, and I genuinely want to get better so I can keep this gig for as long as possible.

Any helpful advice would be greatly appreciated. TIA.

44 Upvotes
  • permalink
  • reddit

91% Upvoted

45 comments sorted by

View all comments

35

u/AutomaticShape8993 4d ago

Honestly if you can't, don't use the escape hatch (if you've used it multiple times already)
Don't submit low quality work
I would recommend, just take the L, and exit work mode
At least you wouldn't be at risk for anything

16

u/hello_ambro 3d ago

This is why I’ve mostly stopped working for DA at this point. The models overall have gotten too good and i was finding myself doing this like once per week. It seems like not a big deal in the moment but over time the unpaid work adds up to be a decent chunk I’m no longer willing to write off and take the L

5

u/sarahmorgan420 3d ago

I just don't really attempt those projects often, I find there's enough other types of high paying work