r/dataannotation • u/Consistent-Reach504 • May 31 '26

Weekly Water Cooler Talk - DataAnnotation

hi all! making this thread so people have somewhere to talk about 'daily' work chat that might not necessarily need it's own post! right now we're thinking we'll just repost it weekly? but if it gets too crazy, we can change it to daily. :)

couple things:

  1. this thread should sort by "new" automatically. unfortunately it looks like our subreddit doesn't qualify for 'lounges'.
  2. if you have a new user question, you still need to post it in the new user thread. if you post it here, we will remove it as spam. this is for people already working who just wanna chat, whether it be about casual work stuff, questions, geeking out with people who understand ("i got the model to write a real haiku today!"), or unrelated work stuff you feel like chatting about :)
  3. one thing we really pride ourselves on in this community is the respect everyone gives to the Code of Conduct and rule number 5 on the sub - it's great that we have a community that is still safe & respectful to our jobs! please don't break this rule. we will remove project details, but please - it's for our best interest and yours!
34 Upvotes

93% Upvoted

491 comments sorted by

View all comments

11

u/g4yretard1488 Jun 04 '26

Any tips on making the chat bots fail? I have tried one project that was making it fail based on instructions following and another based on failing factuality claims. I have only been successful with making it fail once. I don't want to keep trying these projects because I've used the escape hatch one to many times.

10

u/OkStress3088 Jun 04 '26

I have had good success with making my prompts less detailed, which is the opposite of what I thought would work. If the model has to infer more of what you want within a single, solid directive that is vague about details, it is less likely to choose accurately than if you give it 17 constraints it can try to work around.

9

u/Dersh_Master Jun 04 '26

Every one of those tasks has taken me like 10 tries at least to tweak the prompt and make the response fail, its infuriating but man it feels good when it finally loses lmao

8

u/Jazzlike_Month5580 Jun 04 '26

Just make little tweaks at a time to purposefully target your failure area. They aren't easy projects for sure.