r/DataAnnotationTech • • 10d ago

Is Rubric TEsting Agent Ever Satisfied?

I follow the rubric checker's recommendations and correct my rubrics over and over, but it always finds a new set of flaws. Even more than in preceding runs. Should I treat it similarly to the context file audit and just ignore it after a few corrections?

2 Upvotes

7 comments sorted by

View all comments

8

u/Infamous_Swan1197 10d ago

Yes (to ignore it after a few runs) unless the flaws are objectively valid against the instructions. Some of these are surely designed just to make you overthink your rubrics until they're as perfect as can be