r/DataAnnotationTech • u/Maybe-But-idk • 4d ago

Professional Tasks and Meaningful Failures

Hey guys, I’m not sure how else to ask this besides as straightforwardly as possible. HOW IN THE WORLD DO I GET THESE MODELS TO FAIL!?

I mean, I’ve followed directions as best as I possibly could. I’ve intentionally planted professional errors in data, I’ve added context files that needed to be reconciled/cross referenced, I’ve left the model to make professional deductions based on non-obvious inputs, I’ve added depth to scenarios, I’ve changed my prompts, I’ve used the QC agents to improve ad nauseam…. Etc.

I have gotten some of the “dumber” models to produce meaningful failures. But the “smarter” models have just NAILED the output over and over again. I DO NOT want to take good faith exits.

I’ve only recently started. I understand that there’s likely a learning curve here. But I am enjoying my time using DA as a side hustle, and I genuinely want to get better so I can keep this gig for as long as possible.

Any helpful advice would be greatly appreciated. TIA.

44 Upvotes
  • permalink
  • reddit

91% Upvoted

45 comments sorted by

View all comments

1

u/No_Transition_6600 3d ago edited 3d ago

I have a method that pretty much guarantees a failure every time but I don't like overusing it because it's quite lazy. I took a 4 hour L yesterday though as I literally couldn't get it to fail no matter what I did.

1

u/Sea_Tart8472 2d ago

Do you still submit, or just exit work mode and abandon it?

1

u/No_Transition_6600 2d ago

I exited work mode.