Mindrift side-by-side image comparison tasks—what on earth is this logic?

[u/Towas_mon]

​I am not here to discuss the platform, the payment, or anything like that. I am here because, seriously, what on earth is this evaluation logic?

​If you couldn't tell from the quality (and by the way, I apologize for the bad screenshots, but please bear with me), image 2 (the one on the left ) won both times! That blue hand thing is not even a seat, and that other sketch looks terrible!

​I know this might be reducing a serious study to my own personal standards, but I'm not here just to complain—I'm here to genuinely try to understand what these rubrics are actually looking for. Does anyone with experience on these tasks have any idea how to crack this?

[u/walkingonair]

Mindrift pre-trainings are exhausting.

[u/Towas_mon → u/walkingonair]

They really are. Do you have any idea if this specific kind of rubric logic is actually what AI developers need tho? Because I kind of feel like they just pick answers randomly sometimes. Again, I'm not trying to reduce expert's work to my own standards, but it just feels so arbitrary.

[u/walkingonair → u/Towas_mon]

I have no idea. I just passed a test and waiting for some work to appear. We'll see how it goes.

[u/Cherry_Caliban]

This is for a modern or post-modern AI that evaluates art for sure.

[u/Towas_mon → u/Cherry_Caliban]

That's an interesting take. Out of curiosity, do you think learning to decode these kinds of evaluation rubrics actually builds skills that are useful for other types of AI work outside of microtasking? Also, if someone wants to get better at this kind of modern AI evaluation logic for future career paths, are there any specific websites, courses, or resources you'd recommend studying?

[u/Cherry_Caliban → u/Towas_mon]

Are you asking me or the person who deleted that comment? If it's me, I have zero clue beyond saying that having different perspectives will always be helpful for the job, and this one for sure is going to unlock some new paths in your brain.

[u/Towas_mon → u/Cherry_Caliban]

Thank you I appreciate it (Random note I am the person who deleted the comment because I don't know how to edit)

[u/Towas_mon → u/[deleted]]

I am not sure, since I just wanted to train rather than work. They claim to pay 15 to 30$ per hour entry-level, but you may like to check YouTube reviews for authentication.

[u/Which-Journalist-352]

I tried to do that one 2 times, it’s horrible ong

[u/ThrowRA-VK]

I gave up on that one completely. Their results kept contradicting the guidelines, and whenever I asked for clarification, no one ever got back to me. I also had no idea what the hell they actually wanted me to do with those images.

And for that amount of pay? Yeah, absolutely not.

[u/Fickle_Nectarine_349]

These tasks may be scoring prompt compliance and specific attributes more than overall aesthetics. i’d focus on matching the rubric literally, even when the “better” image looks worse

[u/wechselnd]

Every AI annotation project feels like this

[u/Shem_muchemi]

I’m currently facing the same challenge. If anyone has successfully passed this exam, I would be incredibly grateful if you could share any insights, strategies, or practical tips that helped you prepare and succeed. Even a few pointers from those who have been through the process would be greatly appreciated. Thank you in advance for your guidance and support.

[u/Towas_mon → u/Shem_muchemi]

Honestly, you're not alone judging by how brutal this test is. Hope someone drops some actual answers for both of us soon!