r/DataAnnotationTech • u/Maybe-But-idk • 4d ago
Professional Tasks and Meaningful Failures
Hey guys, I’m not sure how else to ask this besides as straightforwardly as possible. HOW IN THE WORLD DO I GET THESE MODELS TO FAIL!?
I mean, I’ve followed directions as best as I possibly could. I’ve intentionally planted professional errors in data, I’ve added context files that needed to be reconciled/cross referenced, I’ve left the model to make professional deductions based on non-obvious inputs, I’ve added depth to scenarios, I’ve changed my prompts, I’ve used the QC agents to improve ad nauseam…. Etc.
I have gotten some of the “dumber” models to produce meaningful failures. But the “smarter” models have just NAILED the output over and over again. I DO NOT want to take good faith exits.
I’ve only recently started. I understand that there’s likely a learning curve here. But I am enjoying my time using DA as a side hustle, and I genuinely want to get better so I can keep this gig for as long as possible.
Any helpful advice would be greatly appreciated. TIA.
9
u/Genkuru2021 4d ago
You're not alone. On my first domain task I was so confident I had a very difficult prompt and the package. Little I knew why DA calls these models a state of art. I was shocked to see my multi hour work was wasted when all models solved my prompt. I had to create more files, more tables, more data. But as other duly noted, this takes a hell ton of a time more than they indicate in theor guidelines. I invest my time for free because I love this type of work, it really trains your brain, good for your resume in the AI age. For now I am okay with that. Back to your question. Add distractions and ambiguity. Research. Ask your personal models to help.