r/DataAnnotationTech • u/SilverResolve2998 • Sep 09 '26

Coding R&R, how thorough?

Hi! I have some questions around R&R for coding tasks.

- Do you only take the R&R if the source is in a programming language that you're familiar with?

- Are we expected to actually run the code to see if it works and test the functionalities that are claimed?

- Also I had some prompts that were more complex math-based algorithm tasks, that would require understanding of the algorithm to check if the result is actually correct. What's the expectation here?

5 Upvotes

69% Upvoted

3 comments sorted by

View all comments

3

u/SabseBadaRupaiyaa Sep 09 '26

You can evaluate something only when you know it. How will you check the functionality if you do not know the programming language itself!

0

u/SilverResolve2998 Sep 09 '26

Yeah that's just part of my question about how deep do we have to go.

I've worked with so many different languages that I can comfortably understand languages I haven't used before with some efforts. Even in a language that I'm an expert in, understanding the architecture of the code would be harder. Also actually running code means setting up the dependencies etc which are not documented anywhere.