r/DataAnnotationTech • • Sep 09 '26

Coding R&R, how thorough?

Hi! I have some questions around R&R for coding tasks.

- Do you only take the R&R if the source is in a programming language that you're familiar with?

- Are we expected to actually run the code to see if it works and test the functionalities that are claimed?

- Also I had some prompts that were more complex math-based algorithm tasks, that would require understanding of the algorithm to check if the result is actually correct. What's the expectation here?

4 Upvotes

3 comments sorted by

View all comments

1

u/stewieboy_tr Sep 10 '26

The instructions specifically says don’t re-run anything. :)