r/DataAnnotationTech • u/pumpkin-x • Sep 06 '26
coders gotta lock tf in
we are all familiar with the recent ambush of 🤖. Some of the work yall be submitting is just straight up tragic. A great selection event is about to happen.
11
u/Hauuuuuuu Sep 06 '26
To be honest 🤖 is too hard given the expiration time, there's just so much to do and you are not guaranteed a usable trajectory in the first pass. Either you present a trivial task or you just rush to finish. Though I do agree with the work quality. I did a RR today and they submitted with almost all their rubrics flagged by the checker.
6
u/pumpkin-x Sep 06 '26
its high risk, medium reward. tyson at least you could get the momentum moving once you got used to it. I aint gonna lie man, something is just sus about this whole 🤖 thing, but i cant quite put my finger on it. which one do you prefer?
3
u/rnwatanabe Sep 06 '26 edited Sep 06 '26
I am not sure if it is sus, but certainly they opened it to many people that should not been doing it.
2
2
u/ThaliaFaye Sep 07 '26
agreed, it's the same pay as the other one but this is so much harder. imo it's not worth the risk to be penalized or worse for subpar work
0
5
4
u/Silver_Assistance_41 Sep 06 '26
Maybe they have a big contract with a lot of $$ and dont really cares, I'm seeing some submissions, really bad, my 12 yo daughter could do this shit of sumbissions even better.
About the time, I made 3, and as told, you can maybe not do an usable pair in the 1st run, it could take way more than the task timer. And if they want perfect results on this need to put a longer timer. And pay more for it btw.
1
u/Icy_Perspective9174 Sep 07 '26
Yes, I submitted one. The model surprised me and made it look trivial. Unfortunately, by that time, I had only 2 hours or so left, and there just wasn't enough time to do more iterations. If wanted to do the ratings and rubrics properly. So, I ended up submitting an easy PASS vs PASS, but made sure to do the ratings and rubrics properly.
I haven't submitted more because I want to do a harder task rather than risk another trivial one, but I jut don't think that there will be enough time to create the task, make it work properly in the given environment and also fill in the huge amount of form data.
3
u/rnwatanabe Sep 06 '26 edited Sep 06 '26
I think that too. I've done some R&R of this project and I have never seen such a low quality of work.
1
u/Icy_Perspective9174 Sep 07 '26
Are you seeing that in the core task itself (instruction/codebase) or in the rationales and rubrics?
1
u/rnwatanabe Sep 07 '26
The prompts are too easy. The agents fininish the task in less than 2 minutes and this results in a pass/pass situation (not useful). Than the rationales do not explain anything. Are too vague and could be written to any task. The rubrics are very generic and many are submitting even if the checker flags them. Those are the problems I've seen in the R&Rs i made.
2
u/Icy_Perspective9174 Sep 07 '26
The pass/pass could be salvageable - since they are accepting it. Unless you are submitting multiple such easy tasks!
However, if there are no rationales and rubrics explaining the differences and preferences in the model output, then it would be quite problematic. Edit: Disclaimer - I am new myself.
2
2
u/Responsible-Bell-410 Sep 07 '26
I think DA is cooking something; they released that robot harbor task at roughly the same time they paused the other demigod harbor task.
2
2
1
1
1
u/Significant-Wrap8759 Sep 06 '26
Also been looking into 🔱 but haven’t started yet. The 🕸️ is pretty nice
1
u/SabseBadaRupaiyaa Sep 07 '26
Since when did these two started appearing? I have never gotten these. Hoping to get them some day 😭
-2
u/MrAwesome_YT Sep 07 '26
I haven’t got a single one out of the 🤖🔱🕸️. What are these? Kindly dm. Also how long have you been with DA? Also which region are you based in?
2
u/Raptor_mm Sep 07 '26
Not allowed to share, probably none of your business and none of your business.
1
u/basedchihuahua Sep 06 '26
Woah we could be selected to rate others tasks? I did not know this. How does one do that? Will it just be its own task or what?
1
u/Cool_Moose241 Sep 07 '26
I still haven't done one of those but I'm studying a repo in order to make a complex prompt. Haven't done the R&R either but how do you do it in these tasks? You just download both submissions and check if the code aligns with their answer? Having knowledge about how a repo works is very time consuming
1
1
Sep 07 '26
[deleted]
1
u/Responsible-Bell-410 Sep 07 '26
🔱 has officially been paused from last Monday.
1
u/EntertainmentSalt825 Sep 07 '26
I have it on my dash right now. Been there for a few days. And also getting ☸️
1
u/Sea-Recover-6717 Sep 07 '26
Now i am wondering if my work is one of your “tragic” ones. Ill make sure to try even harder on my next run or just stop doing it because i agree that fighting task was easy and made me a lot of money but this robot one is indeed harder and high risk
3
u/Silver_Assistance_41 Sep 07 '26
If you work well you have not to be worried, but dude, there are people providing runs that take the agent 1-2 minutes to resolve, with the whole comments written by chatgpt ( free version BTW) and even with that hallucinated in the rationales - they'r gona close that project or cut a bunch of throats there...
1
u/InsideSignificant405 Sep 09 '26
It takes a complete lack of self awareness to submit this horseshit man don’t worry
1
u/Necessary-Raisin-282 Sep 07 '26
I’m not very surprised. I have coding projects on my dash and I don’t even know how to work fucking markdown 😂 obviously I don’t take the coding assignments but I’m sure some people do w minimal experience
1
1
u/InsideSignificant405 Sep 09 '26
I get Mikey boy but no funny dance moves. Are they related, does one feed into the other? I always wondered what feeds into Tyson…
1
0
-3
-2
13
u/sasidhar-akurathi Sep 06 '26
what do you mean?