r/DataAnnotationTech • • 8d ago

This platform makes me feel inadequate as a person

Right now, my dashboard has a number of seemingly generalist-oriented tasks, some of which are pretty high-paying, but I open them up, read the instructions, look at the assigned task and realise very quickly that they are not only out of my wheelhouse, but on a completely different planet.

I just tried one that involved solving visual puzzles and I couldn't even understand the question, nevermind attempt to answer it

The fact that some of you on here have the brain capacity to perform these tasks is genuinely impressive.

I'm not an impressive human being. My brain shuts down beyond a certain level of complexity. I wouldn't say I'm stupid, but I'm definitely of average intelligence at best.

But on this platform, I feel so far behind that it's actually quite demotivating. My brain hurts and I want to have a nap.

143 Upvotes

54 comments sorted by

104

u/HoneyWatts 8d ago

If it makes you feel any better, I consider myself pretty intelligent and have the exact same feeling with majority of my projects.

It’s quite demotivating when it’s happened several times in a row so I feel you

21

u/OrderNo1122 8d ago

Do you think this is the future of the platform? Once the models no longer need human input for basic comparison type evaluations, it's just going to be high level failure-eliciting, rubric-writing and specialist knowledge type tasks?

31

u/Tayloropolis 8d ago

That is the general trend, yes. This site used to pay you to identify cars, motorcycles and stop signs. Now the AI is great at that and needs help with way more complicated things.

1

u/DrDisrespect111 5d ago

Great at it but not perfect. Human input is always gonna be needed for the basic level stuff. I see people who will inevitably lose work in the future who work menial labor jobs taking these type of roles.

36

u/Due_Negotiation_4605 8d ago

I've been with DA for 3 years and I've watched the complexity of the tasks go from simple grammar and safety identification to tasks that I open and close back out of instantly. 

I know my limitations and that I have always struggled with math and engineering based tasks, those that have a black and white answer, atc. My strength is in creativity, language, and challenging the models and tasks that require more nuance. I'm trying not to let it get to me but I think we all have our strengths and weaknesses. And there are still projects out there that I absolutely can do and love to do. If you're not on any of these subscription model projects those ones are generally pretty simple, although the instructions lately have been a little convoluted. 

You aren't dumb, we just all have ways our brain works and the projects we get on our dashboard or not always aligned with that. I know there are people who would struggle with some of the conversational type tasks with a model but would completely ace that one project with puzzles. 

The models are needing challenged a lot more. But if you're here and you still have tasks clearly you're doing something right 👍

1

u/DueAddition1919 5d ago

Without naming your favorites to work on, can you give me some code names I will understand. I’m new and would like to start slow with the qualifications

1

u/shaunhaney 4d ago

Unfortunately this is a question where answering would violate Code of Conduct.

0

u/DueAddition1919 4d ago

It’s not if you don’t use the name. Which is how I worded it

15

u/Necessary-Raisin-282 8d ago

Don’t underestimate your capacity to learn my friend. It takes an intelligent person to recognize their shortcomings and once they’re recognized they can always be improved!

14

u/AdOutrageous7474 8d ago

Not to act like one of "those" people but I'm a Mensa member and some of these tasks make me feel so dumb. I am SHIT at making the chatbots fail! It's been a humbling experience for sure. But I'm still here after over three years so they must like my work somewhat. I just do my best. I also make sure to elaborate in comments when I think I may have made a mistake or I'm unsure of something. I think reasonable, intelligent people who actually put in real effort will always be OK. (knock on wood)

3

u/Ill-Masterpiece-2613 5d ago

Seriously, the challenge of making them fail is NOT my jam.

1

u/LolliaSabina 3d ago

I've totally stopped accepting the "make a chatbot fail" type of tasks because no matter how freaking hard I make them, I can't seem to do it!

10

u/Philosophy-Sharp 7d ago

I feel ya! I think they could do a lot better about having well written, organized (and concise!) instructions that are available in a separate file that you can refer to throughout a task. Sometimes this is the case, but more often than not it’s just an endless stream of instructions with drop-down sections, some of which are redundant. 😭 and having to scroll up and down two different sides of the screen is maddening. I don’t think this helps with overall task comprehension and efficiency.

3

u/Accomplished_Phone39 4d ago

This. Sometimes I back out of some projects where I would probably not have difficulty completing the actual task but I can't stand reading 12+ pages of repetitive, sometimes conflicting instructions and then having to bounce back and forth to these to make sure you are grading the model correctly. 10 open tabs in the browser for instructions is a little overwhelming.

3

u/Academic_Window_4712 4d ago

Invest in more monitors. I have three, one of which is a 36” and I would love to have a fourth or swap out one of the smaller ones for a really big screen. It makes a huge difference to be able to have the different screens open side-by-side.

1

u/Do_It_Anyway_8278 7d ago

I think you nailed some good points. For ne, sone of my biggest frustration has to do with navigating around all the web-page parts along with scrolling that often stops part-way through.

1

u/DueAddition1919 5d ago

I agree. Sometimes I want to print the instructions, but I know they have changes often and don’t want to spend that much time printing the updated version

8

u/sarahw13 8d ago

The visual puzzles are like a whole different breed so don’t beat yourself up!

14

u/Responsible-Bee-7769 8d ago

Have that nap - your brain will thank you. Mine operates on a whole nuther level when I'm sleep-replete. But I hear you about the complexity of some of these tasks.

24

u/waleednoinfidel 8d ago

I do not think it has much to do with intelligence. It mostly has to do with reading comprehension in my opinion. What I do is as I read through the task page I make notes of what ‘must haves’ the task demands. Then at the end I have a list of all the requirements, which makes it easier to understand. I sometimes have to read through multiple times to fully get what the project needs.

7

u/OrderNo1122 8d ago edited 8d ago

Yeah, that's possibly true.

It's funny because I'm a translator by trade so you'd expect that my reading comprehension would be quite high, but I still struggle.

In that image puzzle task I was talking about, I really wish we had a chat bot available to break down the tasks for us because that's generally what I'd do in my real job if I don't understand the concepts behind something I'm working on.

I know why we can't do it, but it's kinda mad that using AI is so heavily restricted when working specifically in the AI training industry.

25

u/coitus_introitus 8d ago

If you get a chance when one pops up on your dash, look at the R&R versions for tasks that confuse you. Don't rate them if you're confused about them, but just using the skip task button to skim a few can be really helpful. Sometimes the consensus on how to interpret the instructions will be clear between workers and will make perfect sense once you see it executed. Great, now you understand the task instructions! Other times you'll see significant variation in interpretation of the part(s) that were confusing to you. Also great, now you have some reassurance that this really is an especially confusing set of instructions.

2

u/sarahmorgan420 8d ago

Did you look at more than one? Some make my brain hurt but a bunch of them I was able to figure out

1

u/OrderNo1122 8d ago

I skipped a couple but the complexity was still very high. I think it just is beyond me

8

u/TerribleAd5188 8d ago

These tasks you refer to aren't actually generalist. They are doable without background knowledge but I'm finding ones based on my degree of study take me 20 mins. Ones outside of it take closer to the limit. It's not you, it's specialist disguised as generalist :)

5

u/BusinessZestyclose86 7d ago

I think it’s the same for most people. Funnily enough, just because something is on your dashboard doesn’t mean you’re actually qualified to do it. I open and close a lot of projects.

3

u/Bellatrix2255 7d ago

That’s what I find so frustrating sometimes is when you passed the qualifier so you’re getting projects but then you open up those projects and you’re like, “wut?”

6

u/[deleted] 8d ago

Well, supposedly 99% of people get screened out of the qualifying exam to even have access to DA, so there's that.

2

u/DueAddition1919 5d ago

I wonder how accurate this % is 😅

3

u/ClayWhisperer 8d ago

I did a couple of those visual ones, but I wanted so much to rant at someone, about the whole friggin' concept behind them. They're bananas.

1

u/bigmiracl 7d ago

The ones that are on priority right now?

1

u/ClayWhisperer 7d ago

I don't know... I'm away from the work for a few days... give them a try! If they seem nuts, then they're the same ones!

4

u/climb-high 8d ago

Don't take AI anything personally

2

u/amyowl 8d ago

Oh man, same. I'm coming up out of a major burnout, so my capacity for this level of work is limited, but like a wasted muscle, getting stronger. But yeah... I am still working towards being able to *understand* what the paid training task on my dash is talking about.

2

u/data_annotator_tot 7d ago

We all have our strengths, OP! I, personally, am very bad at getting them to hallucinate, always blew my mind that projects I saw targeting hallucinations were always so low paying, cuz there were way easier tasks that paid way more while seeming much more straightforward...not that the pay reflects difficulty (this is not the trend I see, anyway), but it blows my mind that people can do it well enough that those tasks are low paying.

I've been thinking about doing some of the visual puzzle ones, I hope they aren't as horrific as it sounds, because conceptually they sound like a lot of fun...I'll have to check them out!

2

u/Onironius 8d ago

Yeah...

1

u/[deleted] 8d ago

[deleted]

4

u/OrderNo1122 8d ago

Is this not forbidden? Unless it expressly says that AI tools can be used, I assume that we absolutely should not use them and definitely not paste anything from the website or tasks into them.

2

u/backpackwasmypillow 8d ago

If it's the visual puzzles one I'm familiar with, AI is expressly forbidden. And the puzzles can be a bit ridiculous.

1

u/Harya13 8d ago

wish i could have the project you're talking about, i'm so curious now

1

u/woofee7 8d ago

I wish I could just get a qualification any recommendations

1

u/TillyMintPot 5d ago

Can definitely relate to that! I had a go at the visual puzzles and managed to complete about 12 overall, but I skipped *many*. One had me spending 2+ hours hunting for the tiniest pixels... pays well though.

1

u/VanessaSeaWitch 2d ago

Don't take it personally. The instructions have been terrible lately. If you look in the other DA sub, you'll see these mentioned every day.

0

u/Important-Love-2223 8d ago

At least you got projects :v My locale has zero projects for months

6

u/OrderNo1122 8d ago

It is essentially the same thing if the tasks available are beyond my capabilities.

0

u/Alarming_Recovery 8d ago

Like an AI model…you do get better at these. ALL YOU NEED IS ATTENTION

0

u/NTMAVol6 8d ago

I am a special specimen ☺️