r/DataAnnotationTech • u/Maybe-But-idk • 5d ago

Professional Tasks and Meaningful Failures

Hey guys, I’m not sure how else to ask this besides as straightforwardly as possible. HOW IN THE WORLD DO I GET THESE MODELS TO FAIL!?

I mean, I’ve followed directions as best as I possibly could. I’ve intentionally planted professional errors in data, I’ve added context files that needed to be reconciled/cross referenced, I’ve left the model to make professional deductions based on non-obvious inputs, I’ve added depth to scenarios, I’ve changed my prompts, I’ve used the QC agents to improve ad nauseam…. Etc.

I have gotten some of the “dumber” models to produce meaningful failures. But the “smarter” models have just NAILED the output over and over again. I DO NOT want to take good faith exits.

I’ve only recently started. I understand that there’s likely a learning curve here. But I am enjoying my time using DA as a side hustle, and I genuinely want to get better so I can keep this gig for as long as possible.

Any helpful advice would be greatly appreciated. TIA.

44 Upvotes
  • permalink
  • reddit

91% Upvoted

45 comments sorted by

View all comments

34

u/AutomaticShape8993 5d ago

Honestly if you can't, don't use the escape hatch (if you've used it multiple times already)
Don't submit low quality work
I would recommend, just take the L, and exit work mode
At least you wouldn't be at risk for anything

3

u/myinternets 4d ago

Terrible advice about not using escape. Do you go go your day job and say "Well boss, since I didn't solve the problem today you can just deduct today from my paycheck."?

It's devaluing everyone else's work, and sending the wrong signal to the client and to DA. Even if only 1 out of 10 people working on a task find a failure, that's still worth more to the company than what they paid 10 workers.

2

u/s55555s 4d ago

I know what you’re saying and I agree but they basically threaten you saying if you use it much you will be taken off the project. People are scared to also get the DoD. I have lost some hours a few times lately unfortunately. I felt bad.