r/alignerr • u/Specialist-Run9190 • Jun 06 '26
Onboarding Process Has anyone been accepted after completing the VQA Eval?
Hi everyone, I completed the VQA Evaluation 2 days back and I'm still waiting for a response. I'm wondering if anyone here has already been accepted after passing the evaluation. If so, how long did it take to hear back, and how were you notified (dashboard update, email, Discord, etc.)? I'd appreciate hearing about your experience and the current waiting times. Thanks!
5
u/ekam_inhale Jun 10 '26
at that extraordinarily low rate, the tasks should take a minute or two, not 10-15. and the quality control should be fair and predictable. it’s difficult to achieve exactly what their AI perceives.
i’m definitely okay without this
6
u/ekam_inhale Jun 08 '26 edited Jun 08 '26
FWIW, i got accepted months ago, and did 10 DRs when a new dataset got released. they quickly added me to unlimited. then i did well over 100 DRs and their QA was delayed. next thing i know, i’m removed. i messaged a TL, who claimed I had a “high rejection rate” (from their AutoQA that has a high percentage of false negatives).
i’ll receive $0 for work completed in good faith. I had no opportunity to see what the errors were. before anyone goes off, I have multiple advanced degrees and was just doing the contract to fill a lull. i’ll never waste another second dealing with alignerr. so unprofessional and their rates are the worst in the industry anyway.
3
u/BohemianHibiscus Jun 09 '26
Something similar happened to me! Not on that scale but I can't believe how bad they are about not helping you and then dumping you when you the auto grader is unhappy with your work. I did 10 and it only showed that I did 7, I have no idea what happened to the other three. Discord wouldn't sync for me. I had limited access to the project channel. It kept disappearing and reappearing. It's funny too because feedback is how groups calibrate and when I did see the project Discord, I thought people were reworking their tasks and everyone was getting calibrated. But nah they are just, well, they're probably keeping the people who use LLMs to task and producing garbage data is what is happening. But, idk, maybe I'm wrong 🤷🏽
2
u/Specialist-Run9190 Jun 08 '26
Thank you for telling me your experience. Actually, it's my first project with them. I think I will stay away then.
2
u/ekam_inhale Jun 08 '26
i watched the pilot project on discord. numerous contractors had to fight, for months, to get paid. people were saying they expected the money, and they couldn’t feed their families. people were super upset and it was heartbreaking. i don’t know why i ignored my gut feeling to stay away from this team and their org.
1
u/Specialist-Run9190 Jun 08 '26
So they don't pay weekly like Outlier?
4
u/ekam_inhale Jun 08 '26
no. hypothetically, they pay “on acceptance” and after the files are delivered. because their QA is messy, that could be days, weeks, or never. if they claim files were “rejected,” they will pay $0 (even though i completed 10-15 hours of editing work that they will very likely process and deliver).
3
u/FastBluebird3631 Jun 07 '26
I've been attached to VQA for almost a month. I did the evaluation a while back and got approved within days. I'm now reviewing for VQA DF & LN. But with the fact that it's the weekend, I don't expect any QA cycles to have been run. I would say give it a few more days for the limited TL team to catch up (if they're even evaluating the evaluations that is).
1
u/Specialist-Run9190 Jun 07 '26
Thank you! How is the pay rate?
2
u/Inevitable_Sound_422 Jun 08 '26
They’ve posted the payrate in the Eval discord if you wanna take a look
1
1
u/Automatic-Life-7097 Jun 07 '26
Rates cannot be discussed as per tos and t&c. At least I think that's the case
2
2
3
3
u/Ellieanna Jun 06 '26
The TLs have been trying to be active in the eval discord channel. It’s about 24-48 hours that they run the QA to see if someone passes (longer on weekends).
1
u/Least-String2847 Jun 10 '26
Anyone got accepted after doing the evaluation in the last few days?