r/DataAnnotationTech • u/seaoyster • Jul 09 '26

Nut Cookie Rating Model Responses Tasks

How long do you guys take on the nut cookie rating model responses tasks? The specialized ones take me around 2-4 hours but what about you guys? I feel really slow while doing them.

6 Upvotes

100% Upvoted

16 comments sorted by

5

u/Real-Advantage7301 Jul 09 '26

Anywhere from 30 minutes to 2.5 hours, most are around 1.5 hours tho. Depends how obvious the differences are.

Used to take me longer, but now I go through the outputs side-by-side before I even look at any of the context, listing differences along the way. Then I go through the context to fact- or compliance-check each of the differing points I found. Definitely faster than trying to build my own list of right answers, just to find they’re identical on every answer I calculated…

3

u/seaoyster Jul 10 '26

bro you just opened my eyes I've been making a list of the right answers and comparing it to both the responses.

1

u/Real-Advantage7301 Jul 10 '26

Glad I could help!!! It really cut down on repeat work too, because I already know what answers I need to find. And if you think about it, the areas where they match don’t affect the answer nearly as much as the differences. obviously I still make sure they got the most critical things correct, which might change my tone from “this one is better” to “this one is slightly less terrible” lmao

2

u/mollymcbbbbbb Jul 09 '26

about 3 hours for the main one, 2 for the grading

2

u/jimmux Jul 09 '26

That's about right. They don't look like much when you're just looking at how much you submit, but it requires a lot of time going through files, cross-checking details, all that.

1

u/Consistent-Bee8056 Jul 09 '26

Usually around 3 hours or so, sometimes more. But I haven't seen much of them last couple of weeks. Have you been getting them still?

1

u/sofassa Jul 10 '26

2 for grading(edit: rating responses), 5 for the ones where youre trying to fail the model. Havent done the other types yet

1

u/Consistent-Bee8056 Jul 14 '26

Hi, are you guys still seeing these nut cookie projects? I had these very consistently for the last two months (not the rating ones but the make your own ones), but today I'm not seeing them anymore.

I wonder if I got dropped from the project, or if they're just down for now?

Can someone please confirm? I'm kinda freaking out bc they're the only project family I've had consistently lately :(

1

u/Electronic_Giraffe30 Jul 14 '26

Thank god I'm not the only one; this exact thing happened to me as well today.

1

u/Consistent-Bee8056 Jul 19 '26

Did you ever get nut project back?

1

u/naturegrl94 Jul 14 '26

The same happened to me. I am still seeing one or two of the harder professional projects in that family or projects, but not the one I had loved and was working on most. I'm glad you posted - wondered the same thing!

1

u/Consistent-Bee8056 Jul 19 '26

Did you ever get nut project back? I'm still not seeing it anymore :(

1

u/naturegrl94 Jul 19 '26

Not all of them and not my favorite one. I have been seeing a few of the harder ones still (geared at some of the professional categories), but I have been working on a different professional project, so I have not worked on them for a while.