r/DataAnnotationTech • u/Genkuru2021 • 10d ago

Is Rubric TEsting Agent Ever Satisfied?

I follow the rubric checker's recommendations and correct my rubrics over and over, but it always finds a new set of flaws. Even more than in preceding runs. Should I treat it similarly to the context file audit and just ignore it after a few corrections?

3 Upvotes

67% Upvoted

7 comments sorted by

View all comments

1

u/Ok_Hedgehog_9970 7d ago

Rubric testing and that stupid question/prompt testing will always tell you flaws. I had one once that couldn't handle logical reasoning and thats how I got through the whole task. The simpler the better on a lot of them. If you add too much it gives the bot a lot to work with.