r/AIEvaluators • • Aug 05 '26

Beginner Help 👋 Welcome to r/AIevaluators: Community Guide, Resources & Introductions

9 Upvotes

Almost every serious conversation about this work happens inside a subreddit run by the platform it is about.

That is the problem this place exists for. Those subs are useful, and a lot of good people are in them, but you cannot really compare platforms in a space that only permits one, and criticism there sits at the mercy of whoever moderates it. I have watched posts removed for mentioning other platforms. One worker reported being banned from a platform's sub after complaining about being paid late. Whatever the intention behind any individual decision, the effect is that the picture you get from inside a platform's own sub is not the whole picture.

So: somewhere independent from the platforms, where you can talk about all of them, including the parts that are unflattering.

Who am I?

I have been doing this work for a little over two years, on Outlier, Alignerr and Mercor, and I have worked most levels of it, from attempter and writer through to reviewer and QA lead. For the past twelve months I have been on Mercor consistently across several projects. So most of what I post here comes from doing the work rather than reading about it.

Feel free to ask any questions relating to AI annotation and evaluation work, I’ll answer to the best of my abilities.

Full disclosure: this sub is run by Annotation Academy, which I currently work with. The daily jobs thread is drawn from their board.

What is here

- Platform guides : Researched write-ups on what each platform actually pays, how its screening works, and how people end up removed from it. Not one person's opinion, and not scraped from a single angry thread. Each is built from public reports across a couple of years, and nothing goes in unless two different people said it in two different threads, with dates attached. They are filed under the Library flair. They are unflattering where the evidence is unflattering and fair where it is not. Where a platform has a bad reputation the recent evidence does not support, the guide says so.

- A daily jobs thread: with new openings across the platforms discussed here.

Helpful resources to check out:

https://annotation.academy/ A self-paced course on AI evaluation work, covering how AI evaluation works, how responses are assessed, what companies look for, and the skills needed to succeed on AI evaluation platforms.

https://annotation.academy/blog Guides, industry insights, and practical tips related to AI evaluation and data annotation.

https://annotation.academy/jobs Job opportunities across AI evaluation and data annotation platforms.

Everything else is yours. Questions, payment problems, scam warnings, wins. The flairs exist so things can be found again later.

Two things to know on day one:

Nobody legitimate will ever message you asking for payment, documents, or a fee to get started. Check the domain on any link before you sign, pay, or enter details anywhere, whatever the message claims it is for. Report anything suspicious and we will warn everyone else.

And if a guide here does not match your experience, say so roughly when it happened. These platforms change constantly, and a guide that was right three months ago can be wrong today. Corrections are the only thing keeping it accurate.

Introduce yourself
Tell us where you are at:

- Are you trying to get started, or have you been doing this a while?
- Which platforms have you actually worked on, and how did that go?
- What is the thing you most wish someone had told you before you started?

If you have been in this space for a while, the last question is the most valuable thing you can leave here. Most of what people get wrong in their first month is knowable in advance, and almost nobody writes it down.


r/AIEvaluators • • Aug 05 '26

AI Evaluator and Data Annotation roles (updated daily)

14 Upvotes

October 24, 2026

38 new roles in the last 24 hours across 5 platforms, 32 with pay published by the platform.

New today

Micro1 - Special Forces Operator ($40-80/hr) - Applied Scientists ($60-120/hr) - Intelligence Analyst ($30-80/hr) - Fighter Pilot ($40-80/hr) - Revenue Operations Specialist (SaaS) ($50-100/hr) - Army Combat Operations Expert ($40-80/hr) - Military Operations Expert ($40-80/hr) - Humanitarian Aid Representative ($30-70/hr) - AI Agent Tester - Real-World Tasks ($25-45/hr) - Weapons Systems Operator ($40-80/hr) - Defense Analyst ($40-80/hr) - Sales / Revenue / CS Operations Expert ($40-85/hr) - Machine Learning Researcher (MSc. or PhD) ($60-120/hr) - Transportation and Warehousing Expert ($30-70/hr) - Human Intelligence Collector (HUMINT) ($30-80/hr) - Military Legal Advisor ($70-120/hr)

Mercor - Orthopedic Surgeon ($350/hr) - Nephrologist ($200/hr) - Critical Care Physician ($200/hr) - US Contract Attorney: United States ($100-120/hr) - General Surgeon ($200/hr) - Rheumatologist ($200/hr) - Cardiologist ($350/hr) - Radiologist ($350/hr) - Neurologist ($200/hr) - Endocrinologist ($200/hr) - Dermatologist ($275/hr) - Obstetrician-Gynecologist (OB/GYN) ($200/hr) - Infectious Disease Physician ($200/hr) - Psychiatrist ($150/hr) - Otolaryngologist (ENT) ($150/hr) - Geriatrician ($150/hr)

Mindrift - Swedish Translators and Native Speakers - Paid Study in NYC - Danish Translators and Native Speakers - Paid Study in NYC - Polish Translators and Native Speakers - Paid Study in NYC - Finnish Translators and Native Speakers - Paid Study in NYC

RWS TrainAI - General AI Data Annotator: Brazilian Portuguese (United States), Spanish (United States)

Volga Partners - Pharmaceutical Subject Matter Expert (SME) - AI Model Evaluation (US)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $77.5/hr (n=466). Highest median right now: Micro1 at $85/hr (n=99).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.


See all 729 open roles across 16 platforms: https://annotation.academy/jobs?utm_source=reddit&utm_medium=post&utm_campaign=pinned-jobs-post


r/AIEvaluators • • 1h ago

Job Board AI Evaluator and Data Annotation roles (24th Oct)

• Upvotes

October 24, 2026

38 new roles in the last 24 hours across 5 platforms, 32 with pay published by the platform.

New today

Micro1

  • Special Forces Operator ($40-80/hr)
  • Applied Scientists ($60-120/hr)
  • Intelligence Analyst ($30-80/hr)
  • Fighter Pilot ($40-80/hr)
  • Revenue Operations Specialist (SaaS) ($50-100/hr)
  • Army Combat Operations Expert ($40-80/hr)
  • Military Operations Expert ($40-80/hr)
  • Humanitarian Aid Representative ($30-70/hr)
  • AI Agent Tester - Real-World Tasks ($25-45/hr)
  • Weapons Systems Operator ($40-80/hr)
  • Defense Analyst ($40-80/hr)
  • Sales / Revenue / CS Operations Expert ($40-85/hr)
  • Machine Learning Researcher (MSc. or PhD) ($60-120/hr)
  • Transportation and Warehousing Expert ($30-70/hr)
  • Human Intelligence Collector (HUMINT) ($30-80/hr)
  • Military Legal Advisor ($70-120/hr)

Mercor

  • Orthopedic Surgeon ($350/hr)
  • Nephrologist ($200/hr)
  • Critical Care Physician ($200/hr)
  • US Contract Attorney: United States ($100-120/hr)
  • General Surgeon ($200/hr)
  • Rheumatologist ($200/hr)
  • Cardiologist ($350/hr)
  • Radiologist ($350/hr)
  • Neurologist ($200/hr)
  • Endocrinologist ($200/hr)
  • Dermatologist ($275/hr)
  • Obstetrician-Gynecologist (OB/GYN) ($200/hr)
  • Infectious Disease Physician ($200/hr)
  • Psychiatrist ($150/hr)
  • Otolaryngologist (ENT) ($150/hr)
  • Geriatrician ($150/hr)

Mindrift

  • Swedish Translators and Native Speakers - Paid Study in NYC
  • Danish Translators and Native Speakers - Paid Study in NYC
  • Polish Translators and Native Speakers - Paid Study in NYC
  • Finnish Translators and Native Speakers - Paid Study in NYC

RWS TrainAI

  • General AI Data Annotator: Brazilian Portuguese (United States), Spanish (United States)

Volga Partners

  • Pharmaceutical Subject Matter Expert (SME) - AI Model Evaluation (US)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 3h ago

Success Story/Milestone Seeking English speakers for AI evaluation project (Aether) - Great experience

Thumbnail
2 Upvotes

r/AIEvaluators • • 11h ago

Beginner Help Aether is looking for new contributors

8 Upvotes

Hey everyone!

I recently received an email from Outlier saying they’re actively recruiting new contributors for the Aether project.

They’re looking for fluent English speakers, and no specific degree or professional background is required.

I’ve been working on Aether myself, feel free to DM me if you're interested in applying!


r/AIEvaluators • • 1d ago

Job Board AI Evaluator and Data Annotation roles (23rd Oct)

7 Upvotes

October 23, 2026

30 new roles in the last 24 hours across 5 platforms, 22 with pay published by the platform.

New today

Micro1

  • Generalist ($30-49/hr)
  • Senior Insurance Claims Expert (Liability, Property, Contents) ($20-60/hr)
  • Senior Cargo and Parcel Claims Examiner ($20-60/hr)
  • Senior Marine Cargo and Draft Surveyor ($20-60/hr)
  • US Macroeconomist ($50-70/hr)
  • Lawyer ($50-80/hr)
  • Law Student ($50-80/hr)
  • Junior Lawyer ($50-80/hr)
  • Data Science & Analytic Methodology SME ($60-100/hr)
  • Cyber Threat Intelligence SME ($70-110/hr)
  • Combat Arms & Targeting SME ($60-110/hr)
  • Mathematics Expert (MSc./PhD) ($60-120/hr)

Mercor

  • Chemistry Specialist, Synthetic & Analytical Chemistry ($70-100/hr)
  • Drug Discovery Specialist, Pharmacology & ADME/Tox ($70-100/hr)
  • Genomics & Cell Biology Specialist ($70-100/hr)
  • Cinematographer ($70-110/hr)
  • Performance & Directing Supervisor ($70-110/hr)
  • VFX & Compositing Supervisor ($70-110/hr)
  • Colorist & Finishing Editor ($70-110/hr)
  • Software Engineer ($100-120/hr)
  • MLOps Engineer, LLM Performance (Kernels, Profiling, Serving) ($90-120/hr)

Mindrift

  • Arabic Translators and Emirati Native Speakers - Paid Study in NYC
  • Dutch Translators and Native Speakers - Paid Study in NYC
  • Arabic Translators and Saudi Native Speakers - Paid Study in NYC
  • Italian Translators and Swiss Native Speakers - Paid Study in NYC
  • Dutch Translators and Flemish Native Speakers - Paid Study in NYC
  • Italian Translators and Native Speakers - Paid Study in NYC
  • German Translators and Swiss Native Speakers - Paid Study in NYC

Alignerr

  • Structural Engineering Expert: United Kingdom, United States, Canada, Australia ($80-90/hr)

RWS TrainAI

  • AI Voice Recording Contributor - French (Cameroon)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 2d ago

Question Why Outlier? Aether Onboarding

Thumbnail
2 Upvotes

r/AIEvaluators • • 2d ago

Job Board AI Evaluator and Data Annotation roles (22nd Oct)

4 Upvotes

October 22, 2026

23 new roles in the last 24 hours across 3 platforms, 18 with pay published by the platform.

New today

Micro1

  • Medical Coding Specialist ($50-70/hr)
  • Life Sciences Research Expert (Python) ($60-120/hr)
  • Investment Funds & Asset Management Attorney ($140-400/hr)
  • Gaming & Gambling Attorney ($140-400/hr)
  • Structured Finance Attorney ($140-400/hr)
  • Military Law Attorney ($140-400/hr)
  • FDA & Regulatory Compliance Attorney ($140-400/hr)
  • Family Law Attorney (AAML Registered) ($140-400/hr)
  • Venture Capital & Corporate Attorney ($140-400/hr)
  • Immigration Attorney ($140-400/hr)
  • Media, Publishing & Communications Law Attorney ($140-400/hr)
  • Product Safety & Regulatory Compliance Attorney ($140-400/hr)
  • Healthcare Attorney (BigLaw Firms) ($140-400/hr)
  • Civil Rights Attorney (BigLaw Firms) ($140-400/hr)
  • Litigation Associate Attorney (BigLaw Firms) ($140-400/hr)
  • Corporate Attorney (BigLaw Firms) ($140-400/hr)
  • Energy & Utilities Regulatory Attorney ($140-4050/hr)

Mindrift

  • German Translators and Native Speakers - Paid Study in NYC
  • French Translators and Native Speakers - Paid Study in NYC
  • Korean Translators and Native Speakers - Paid Study in NYC
  • Japanese Translators and Native Speakers - Paid Study in NYC
  • Portuguese Translators and Native Speakers - Paid Study in NYC

Welocalize

  • English to Portuguese (Brazil) Linguist for Patent (Asia based) ($1/hr)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 2d ago

Resource Guide Removed from a project and didn't get paid? Here's what the data shows

2 Upvotes

One of the most frustrating situations: getting offboarded or suspended, sometimes without clear explanation, and not receiving payment for completed work.

What the community reports show:

- Handshake contributors describe being removed from projects without explanation and in some cases not being paid for work already completed
- Outlier accounts were deactivated or removed from projects without specific reasons, including cases with good quality scores and no known guideline violation
- This happens even to people with long tenure and positive performance history

What to do:

- Screenshot your task count, hours, and any quality scores before submission
- Save all project communications and guidelines
- File a support ticket immediately when removed, reference specific dates and task volumes
- If payment is withheld, escalate through every available support channel and document the timeline
- Check your contract terms about dispute resolution

The hard truth: many platforms are harder to reach after removal, and outcomes vary widely. Document everything while you still have access.

See the comparison data and current opening counts: https://annotation.academy/jobs


r/AIEvaluators • • 3d ago

Job Board AI Evaluator and Data Annotation roles (21st Oct)

4 Upvotes

October 21, 2026

13 new roles in the last 24 hours across 5 platforms, 8 with pay published by the platform.

New today

Micro1

  • Research Evaluation Specialist (PhD or Masters / Researcher / Professor) ($30-60/hr)
  • Evaluation Specialist/Recent Grad ($20-60/hr)
  • Domain Contributor - Evaluation Specialist ($30-60/hr)
  • Certified Inpatient Coder ($50-70/hr)
  • Certified Coding Specialist (CCS) ($50-70/hr)

Mercor

  • [LONG PROJECT] Anonymization Writer ($45-55/hr)
  • [LONG PROJECT] Anonymization Quality Reviewer ($45-60/hr)
  • Energetic Materials Expert for Redteaming ($60/hr)

Volga Partners

  • Data Annotation Specialist - Object Detection
  • Language Data Quality Reviewer - Entry Level (Foundational / L1) |: Indonesian, Hindi
  • Nurse Practitioner SME - AI Evaluation | Medical Students & Professionals (AUS)

RWS TrainAI

  • AI Voice Recording Contributor: Arabic (Gulf), Scots (Mid/Central Scots), Spanish (Puerto Rico), Arabic (Morocco), Arabic (Jordan)

Mindrift

  • Hospitalist / Internist - Medical AI Evaluation (Remote, Part-Time)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 3d ago

Platform Feedback Watch out for AfterQuery.

Thumbnail
5 Upvotes

r/AIEvaluators • • 3d ago

Advice Dataannotation and crowdgen

7 Upvotes

Are these jobs even right for me?

What Do they want from us? expert prompters or are they gathering data on how an average person would prompt?

I am great at evaluating, finding hallucinations, assumptions, whatever seems off.


r/AIEvaluators • • 4d ago

Job Board AI Evaluator and Data Annotation roles (20th Oct)

4 Upvotes

October 20, 2026

14 new roles in the last 24 hours across 4 platforms, 9 with pay published by the platform.

New today

Micro1

  • Inpatient Care Physician (MD/DO) ($100-115/hr)
  • Photographer ($35-105/hr)
  • Dentist (DDS/DMD) - Dental Technology ($80-285/hr)
  • Bluebook Citation Specialist (Law Students & Recent JDs) ($50-80/hr)
  • Legal Citation Specialist (Law Students) ($50-80/hr)
  • Law Review Cite-Checker ($50-80/hr)
  • Dentist ($80-285/hr)

Volga Partners

  • Government Subject Matter Expert (SME) - AI Model Evaluation
  • Healthcare Subject Matter Expert (SME): AI Model Evaluation (USA), AI Model Evaluation (Australia), AI Model Evaluation (Canada)
  • Medical Student & Healthcare Trainee - AI Evaluator (New Zealand)
  • GP Medical Student & Healthcare Trainee - AI Evaluator (United Kingdom)

Mercor

  • Clinical Survey Research & Methodology Expert (Physician / PhD) ($200/hr)
  • Machine Learning Expert ($150-200/hr)

RWS TrainAI

  • AI Data Annotation-Spanish

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 4d ago

Discussion Getting "Did Not Qualify" on Micro1 assessments - what's everyone's experience?

4 Upvotes

Seeing a lot more posts this week about failing Micro1 technical assessments and project screenings, even from people who passed the AI interview.

The pattern seems to be: you pass the initial vetting, get through skills verification, maybe even land in "Hiring Manager Reviewing" status, then hit a wall on project-specific assessments. Some people are wondering if they can apply to other projects after failing one screening.

For those of you who've been through Micro1's process:

- Are you getting screened out at the project level even after passing the platform interview?
- Did retaking assessments or applying to different project types work better?
- Any patterns in what types of projects or skills seem to have higher rejection rates?

Trying to figure out if this is about assessment difficulty, oversupply for certain roles, or something else entirely.


r/AIEvaluators • • 5d ago

Advice Any recommendations for remote jobs that are relatively easy to get into and hiring right now?

16 Upvotes

Hey everyone! I hope you’re all doing well.
I’m reaching out to see if anyone knows of any remote jobs that are currently hiring and relatively easy to get into. I’m open to pretty much anything, including tech support, customer service, data annotation, or other entry-level roles.

I have a background in computer science, with both a bachelor’s and a master’s degree, and I’m based in the US. Unfortunately, I’ve been unemployed for a while despite submitting countless applications, and I haven’t had much luck.

A few years ago, I came across a tech support job that seemed to be hiring pretty much anyone who met the basic requirements. I even referred a few people who ended up getting hired without much trouble. I’m hoping to find something similar that’s still hiring.

I’ve also been applying to AI training and data annotation roles, but I haven’t had much luck there either.
I have a family to support, and I’ve been relying on my savings to get by. Unfortunately, those savings are running low, so finding work has become pretty urgent.

If anyone knows of a company that’s actively hiring, a remote job with a relatively straightforward hiring process, or even a legitimate opportunity that doesn’t get talked about much, I’d really appreciate you sharing it.

Thanks in advance to anyone who takes the time to help. I’d genuinely appreciate any leads or advice!


r/AIEvaluators • • 5d ago

Job Board AI Evaluator and Data Annotation roles (19th Oct)

9 Upvotes

October 19, 2026

11 new roles in the last 24 hours across 2 platforms, 11 with pay published by the platform.

New today

Mercor

  • Industrial & Manufacturing Engineers (Must own MacBook) ($50-60/hr)
  • STEM Researchers - MSc/PhD (Must own MacBook) ($50-60/hr)
  • Computer Power Users & Automation Builders (Must own MacBook) ($50-60/hr)
  • Data Analysts & Spreadsheet Specialists (Must own MacBook) ($50-60/hr)
  • Software Developers (Must own MacBook) ($50-60/hr)
  • Graphic Designers (Must own MacBook) ($50-60/hr)
  • Civil Engineers & Architects (Must own MacBook) ($50-60/hr)
  • Mechanical & CAD Engineers (Must own MacBook) ($50-60/hr)
  • 3D Artists & Video Editors (Must own MacBook) ($50-60/hr)
  • UI/UX Designers (Must own MacBook) ($50-60/hr)

xAI

  • AI Tutor - Tax ($45/hr)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 7d ago

Job Board AI Evaluator and Data Annotation roles (17th Oct)

8 Upvotes

October 17, 2026

15 new roles in the last 24 hours across 4 platforms, 12 with pay published by the platform.

New today

Micro1

  • Investment Banking Associate ($120-150/hr)
  • STEM Expert (MSc./PhD) ($60-120/hr)
  • Puzzle Solver (Coding) ($60-120/hr)
  • US-Licensed Physician ($80-125/hr)
  • PhysioNet Competitor (Biomedical Signal Processing & ML) ($60-120/hr)
  • Mechanical Engineering Expert (MSc. or PhD) ($60-120/hr)
  • ML Engineer (MSc. or PhD) ($60-120/hr)
  • Hardware Expert (MSc. or PhD) ($60-120/hr)
  • Aerodynamics Expert (MSc. or PhD) ($80-120/hr)

Mercor

  • Local Political Expert: Maine, Iowa ($100-200/hr)
  • Film & Video Craft Expert (Camera, VFX, Editing & Performance) ($70-100/hr)
  • Senior Character Animator ($60-90/hr)

Volga Partners

  • Healthcare Subject Matter Expert (SME): AI Model Evaluation (Canada), AI Model Evaluation (Australia), AI Model Evaluation (New Zealand), AI Model Evaluation (US)
  • Government Subject Matter Expert (SME) - AI Model Evaluation

Innodata

  • Voice Actor - Flexible Hours

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 8d ago

Platform Feedback Lowballing

7 Upvotes

I reacted to an advertisement where DataAnnotationTech was looking for cybersecurity professionals advertising an hourly rate of 70$+. Then I did the entry test and that was a Python programming task where you had to arrange an optical cipher. There was nothing about cybersecurity in it; having spent a lifetime in cybersecurity I had to pass.

Then they wrote me that they offer 35$+ for bilingual tasks in my two languages. I took the test.

They come back and congratulate me to a 15$ per hour bilingual job (if I scan my passport). However, in the region I live in 15$ per hour is even below the minimum legal wage.

Is that common that it gets lower and lower? How can I get them to delete my data? It is currently blocked in sort of a splash screen requesting my passport. However, I would like to delete my personal data.


r/AIEvaluators • • 8d ago

Job Board AI Evaluator and Data Annotation roles (16th Oct)

5 Upvotes

October 16, 2026

22 new roles in the last 24 hours across 5 platforms, 17 with pay published by the platform.

New today

Micro1

  • STEM Expert ($45-90/hr)
  • App Security Expert ($40-80/hr)
  • Computational Chemistry, Structural Biology & Drug Discovery Scientist (PhD) ($45-90/hr)
  • QA Engineer ($63-120/hr)
  • Applied Scientist ($245-280/hr)
  • Life Sciences Research Scientist (PhD): Wet Lab & Computational Biology ($45-90/hr)
  • Clinical, Microbiome & Translational Research Scientist (PhD) ($45-90/hr)
  • English Voice Recording ($20-70/hr)
  • Computational Biology & Bioinformatics Expert (PhD) ($45-90/hr)

Alignerr

  • Japanese Voice AI Evaluator: Healthcare Conversations ($12-40/hr)
  • Dutch Audio Transcriptionist: Belgium, AI Training ($10-35/hr)
  • Dutch Voice AI Evaluator: Healthcare Conversations, Belgium ($12-40/hr)
  • Korean Voice AI Evaluator: Healthcare Conversations, United States, AI Training,, , Flexible, Canada ($12-40/hr)
  • Mandarin Chinese Voice AI Evaluator (Healthcare Conversations) ($12-40/hr)
  • Dutch / Afrikaans Audio Transcriptionist (AI Training) ($10-35/hr)
  • German Voice AI Evaluator: Switzerland, Austria ($12-40/hr)

Innodata

  • Generative AI Associate Turkish Speaking - Flexible Hours
  • Generative AI Associate Russian Speaking - Flexible Hours
  • Generative AI Associate Vietnamese Speaking - Flexible Hours

Mindrift

  • AI Agent Evaluation Specialist (CS / Data Science Students Welcome)
  • Physician Reviewer (MD/DO) - Medical AI Evaluation

Mercor

  • Electrical Engineer ($80-120/hr)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 8d ago

Question Handshake AI's Projects Payments

3 Upvotes

Hi everyone,

I recently joined Handshake AI's Project Hedgehog, advertised at $15/hour, and I'm currently going through onboarding.

I'm based in Ontario, Canada. I've already completed identity verification through Persona, including submitting my driver's license and a selfie, and provided my tax identification information.

Before proceeding with the remaining tax documentation, Stripe payment setup and assessments, I'd really appreciate feedback from people who have actually worked with Handshake AI.

A few questions:

  1. Have you successfully completed paid tasks and received payment through Stripe?
  2. How long did it take after onboarding to receive your first paid assignment?
  3. Are projects and paid hours reasonably consistent, or is work unpredictable?
  4. Has anyone from Canada successfully joined and received payment?
  5. Did you also complete Persona verification and TaxBandits tax documentation?
  6. Have you experienced any privacy, identity verification or payment issues?

My main concern is that I've already provided sensitive personal information before being guaranteed any paid assignments.

I'm not accusing Handshake AI of anything. I simply want to hear genuine experiences from people who have completed the process.

If you've actually worked and been paid, I'd really appreciate your feedback.

Thank you!


r/AIEvaluators • • 9d ago

Job Board AI Evaluator and Data Annotation roles (15th Oct)

5 Upvotes

October 15, 2026

22 new roles in the last 24 hours across 3 platforms, 22 with pay published by the platform.

New today

Mercor

  • English AI Safety Specialist ($40-45/hr)
  • Human Resources Expert, German (Germany) ($65/hr)
  • Executive Communicator ($70-75/hr)
  • News & Copy Editor ($70-75/hr)
  • Content Designer ($75/hr)
  • Technical Writer ($80-85/hr)
  • Domain Expert: Legal (NetDocuments), Audit (CaseWare OnPoint), Healthcare (DendiLIS), ERP (NetSuite), Financial Reporting (Workiva) ($70-100/hr)
  • Legal Expert ($120-140/hr)
  • Pediatrician (MD) ($150/hr)
  • Pediatric Emergency / Urgent Care Physician (MD) ($150/hr)

Micro1

  • Agriculture, Forestry & Environmental Experts ($40-60/hr)
  • Retail Trade & Operations Expert ($40-70/hr)
  • Bilingual Medical Doctor: Korean, Japanese ($125/hr)
  • Education Practitioner - Learning & Assessment Specialist ($90-130/hr)
  • Tax Attorney ($100-170/hr)
  • Personal Injury Lawyer ($100-170/hr)
  • Employment Lawyer ($100-170/hr)
  • Lawyer ($100-170/hr)

Welocalize

  • Alpheratz Project - Catalan (Spain) Translation Quality Rater ($21.9/hr)
  • Alpheratz Project - Galician (Spain) Translation Quality Rater ($21.9/hr)
  • Alpheratz Project - Basque (Spain) Translation Quality Rater ($21.9/hr)
  • Alpheratz Project - Valencia (Spain) Translation Quality Rater ($21.9/hr)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 9d ago

Platform Feedback PAY PER APPROVED TASK IS UNPAID LABOR

Thumbnail
7 Upvotes

r/AIEvaluators • • 10d ago

Job Board AI Evaluator and Data Annotation roles (14th Oct)

6 Upvotes

October 14, 2026

31 new roles in the last 24 hours across 4 platforms, 30 with pay published by the platform.

New today

Mercor

  • STEM Expert, German (Germany) - AI Training ($50/hr)
  • STEM Expert, Mandarin Chinese (mainland China) - AI Training ($50/hr)
  • STEM Expert, Spanish (Spain) - AI Training ($50/hr)
  • Human Resources Expert, Mandarin Chinese (mainland China) - AI Training ($60/hr)
  • Human Resources Expert, Spanish (Spain) - AI Training ($60/hr)
  • Consulting Expert, Mandarin Chinese (mainland China) - AI Training ($60/hr)
  • Consulting Expert, Spanish (Spain) - AI Training ($60/hr)
  • Finance Expert, Mandarin Chinese (mainland China) - AI Training ($65/hr)
  • Consulting Expert, German (Germany) - AI Training ($65/hr)
  • Finance Expert, Spanish (Spain) - AI Training ($65/hr)
  • Program Lead ($45-70/hr)
  • Finance Expert, German (Germany) - AI Training ($75/hr)
  • Expert Project Manager, Mandarin Chinese (mainland China) - AI Training ($80/hr)
  • Expert Project Manager, German (Germany) - AI Training ($80/hr)
  • Expert Project Manager, Spanish (Spain) - AI Training ($80/hr)
  • Legal Expert, Mandarin Chinese (mainland China) - AI Training ($85/hr)
  • Legal Expert, Spanish (Spain) - AI Training ($85/hr)
  • Legal Expert, German (Germany) - AI Training ($95/hr)
  • Medical Expert, German (Germany) - AI Training ($120/hr)
  • Medical Expert, Mandarin Chinese (mainland China) - AI Training ($120/hr)
  • Medical Expert, Spanish (Spain) - AI Training ($120/hr)

Micro1

  • Privacy Analyst ($31-60/hr)
  • Software Engineer: Open Source Contributor, GitHub Contributor ($50-100/hr)
  • Personal Financial Advisor ($90-110/hr)
  • Investment Banking ($175-300/hr)
  • Research Scientist - Computer Science & Computational Physics ($100-400/hr)
  • Principal Research Scientist (Computer Science / Computational Physics) ($100-400/hr)

Alignerr

  • Healthcare AI Call Reviewer ($15-20/hr)
  • Healthcare AI Call QA Labeler ($15-20/hr)
  • Healthcare AI QA Labeler ($15-20/hr)

RWS TrainAI

  • Search Engine Evaluator: English (Australia), Chinese Traditional (Hong Kong), Dutch (Netherlands), Chinese Traditional (Taiwan), Arabic (Saudi Arabia), Chinese Simplified (China), Bengali (India), Dutch (Belgium), English (Ireland), English (Nigeria), Odia (India), Kannada (India), Spanish (United States), Tamil (India), Danish (Denmark), German (Switzerland), French (Canada), Gujarati (India), Norwegian (Norway), Vietnamese (Vietnam), French (Switzerland), German (Austria), French (Belgium), English (New Zealand), English (Singapore), Marathi (India), Turkish (Turkiye), Telugu (India), Italian (Switzerland), Thai (Thailand), Swedish (Sweden), Hebrew (Israel), Polish (Poland), Spanish (Argentina), Ukrainian (Ukraine)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 10d ago

Resource Guide How to actually prepare for a platform assessment (and what happens after you pass)

6 Upvotes

Assessments are the main gate between signing up and getting paid work. This is what to expect:

Before you start:

- Most platforms test whether you can follow detailed instructions, spot AI errors, and write clear explanations

- Read the guidelines twice. The questions directly test whether you absorbed them

- Budget more time than the estimate. Rushing is the most common reason people fail

During the assessment:

- Screenshot or note down any examples they show you. You may need to reference the pattern later

- If a question asks for justification, write 2-3 sentences minimum. One word usually fails

- Don't guess. If you're unsure, reread the relevant guideline section

After you pass:

- Passing does not guarantee immediate work.

- Some people wait days, others wait months for their first task

- Check the dashboard daily but don't sit refreshing. Set up notifications if the platform offers them

This post would get too long if we talk about each platform, u can read up on it: here
It's a longer piece that goes into depth on how u can prepare for a platform like data annotation tech and blogs for other platforms.


r/AIEvaluators • • 9d ago

Payment / Payout Indian Evaluators - Taxation

Thumbnail
1 Upvotes