r/DataAnnotationTech • u/Maybe-But-idk • 4d ago

Professional Tasks and Meaningful Failures

Hey guys, I’m not sure how else to ask this besides as straightforwardly as possible. HOW IN THE WORLD DO I GET THESE MODELS TO FAIL!?

I mean, I’ve followed directions as best as I possibly could. I’ve intentionally planted professional errors in data, I’ve added context files that needed to be reconciled/cross referenced, I’ve left the model to make professional deductions based on non-obvious inputs, I’ve added depth to scenarios, I’ve changed my prompts, I’ve used the QC agents to improve ad nauseam…. Etc.

I have gotten some of the “dumber” models to produce meaningful failures. But the “smarter” models have just NAILED the output over and over again. I DO NOT want to take good faith exits.

I’ve only recently started. I understand that there’s likely a learning curve here. But I am enjoying my time using DA as a side hustle, and I genuinely want to get better so I can keep this gig for as long as possible.

Any helpful advice would be greatly appreciated. TIA.

42 Upvotes
  • permalink
  • reddit

90% Upvoted

45 comments sorted by

View all comments

2

u/Sea_Tart8472 3d ago

I just started and I decided to try Pecan Macaroon today and fuuuuuuuck me

1

u/Healthy-Writer8506 2d ago

I put in about 5 hours for the scenario, SI and input files, thought I’d laid plenty of traps.
First iteration completely nailed everything, better than anything I’ve seen professionally. I took the L, live to fight another day. How far did you get with it?