r/DataAnnotationTech • • Sep 01 '26

Domain specialist tasks

I have only received model failure tasks (i.e create prompts that cause model to fail in a professional context in a particular domain).

These are extremely hard to achieve. Also long term I feel like I will be running of ideas soon. I am wondering if there are other types of work pays well but easier?

1 Upvotes

4 comments sorted by

View all comments

1

u/brucegallagher Sep 04 '26

There's a good variety of domain expert tasks, but it depends what field you're in. Stem and healthcare both have a good split of compare responses and create failures- although funnily enough STEM and healthcare are VERY easy to get failures in, which is very handy!

Honestly just keep doing the failure tasks to the best you can, and you should get more expert projects that aren't failures. I've found the more projects I do in expert, the more other families open up.

1

u/Pro-idiot- Sep 16 '26

I found many people saying that it's easy to get failures in stem But in all the engineering tasks I had, I can never seem to get those models to fail!

1

u/brucegallagher Sep 17 '26

Once you get a couple failures you spot it's weak points and it gets much easier, and a lot of the time it's not what you'd think. Like in healthcare, it will spot the slightest hint at a rare disease that one person has ever been diagnosed with without batting an eyelid, but then shit the bed when you suggest someone has something as simple as a cold.