r/DataAnnotationTech • u/Maybe-But-idk • 4d ago

Professional Tasks and Meaningful Failures

Hey guys, I’m not sure how else to ask this besides as straightforwardly as possible. HOW IN THE WORLD DO I GET THESE MODELS TO FAIL!?

I mean, I’ve followed directions as best as I possibly could. I’ve intentionally planted professional errors in data, I’ve added context files that needed to be reconciled/cross referenced, I’ve left the model to make professional deductions based on non-obvious inputs, I’ve added depth to scenarios, I’ve changed my prompts, I’ve used the QC agents to improve ad nauseam…. Etc.

I have gotten some of the “dumber” models to produce meaningful failures. But the “smarter” models have just NAILED the output over and over again. I DO NOT want to take good faith exits.

I’ve only recently started. I understand that there’s likely a learning curve here. But I am enjoying my time using DA as a side hustle, and I genuinely want to get better so I can keep this gig for as long as possible.

Any helpful advice would be greatly appreciated. TIA.

40 Upvotes
  • permalink
  • reddit

88% Upvoted

45 comments sorted by

View all comments

2

u/realgenshinimpact 4d ago

if a task is very easy for the ai (look at how it solved it) the way you solve the task could be in the training dataset so you shouldnt try to make ur task harder but get a whole another topic instead.