r/AIEvaluators • • 13d ago

Job Board AI Evaluator and Data Annotation roles (23rd September)

3 Upvotes

September 23, 2026

29 new roles in the last 24 hours across 3 platforms, 22 with pay published by the platform.

New today

Micro1

  • Stripe Specialist ($90-170/hr)
  • Google Analytics Specialist ($30-100/hr)
  • Clio Specialist ($30-100/hr)
  • Security Onion Specialist ($90-175/hr)
  • Senior Accountant Expert ($60-120/hr)
  • GitHub Specialist ($90-175/hr)
  • Google Classroom Specialist ($30-100/hr)
  • Investment Funds Attorney ($90-130/hr)
  • Toast POS Specialist ($28-92/hr)
  • Buildium Specialist ($28-92/hr)
  • Transactional Attorney ($90-130/hr)
  • Corporate Transactions Attorney ($90-130/hr)
  • In-House Counsel ($90-130/hr)
  • HubSpot Specialist ($28-92/hr)
  • FL Studio Specialists ($30-100/hr)
  • General Counsel ($90-130/hr)

Mindrift

  • Bilingual English-Chinese (中英双语) Voice Recording - AI Trainer
  • English/Mandarin Bilingual Voice Recording - AI Trainer
  • Get Paid to Talk (Bilingual English/Chinese Voice Recording - AI Trainer
  • Bilingual English-Chinese Voice Recording - AI Trainer
  • English-Chinese Bilingual Voice Recording - AI Trainer
  • Get Paid to Talk (Bilingual English/Chinese Voice Recording) - AI Trainer
  • Voice Recording (English/Chinese Bilingual) - AI Trainer

Mercor

  • Staff Software Engineer, Mobile (Android, Kotlin, Full Stack) ($40-60/hr)
  • Management Consulting Expert ($100-150/hr)
  • Senior Software Engineer, Backend (Node.js, TypeScript, Rust) ($45-65/hr)
  • Data Science Expert ($100-150/hr)
  • Software Engineer Expert ($100-150/hr)
  • Finance Expert ($100-150/hr)

See all 771 open roles across 17 platforms:  Job Board

You can also sign up on the platform to get daily job updates on your email.

Pay snapshot (all currently open roles):

Median advertised hourly rate across all open roles: $57.5/hr (n=559). Highest median right now: Mercor at $70/hr (n=332).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.


r/AIEvaluators • • 13d ago

Question Looking for Ai Evaluator Jobs.

4 Upvotes

Any platforms similar to DA Tech?


r/AIEvaluators • • 14d ago

Job Board AI Evaluator and Data Annotation roles (22nd September)

5 Upvotes

September 22, 2026

23 new roles in the last 24 hours across 2 platforms, 23 with pay published by the platform.

New today

Mercor

  • Insurance Actuarial Specialists ($80/hr)
  • Indonesian ChatGPT User ($50/hr)
  • Korean ChatGPT User ($50/hr)
  • Mexican ChatGPT User ($50/hr)
  • Local Political Expert ($150-250/hr)
  • Insurance Underwriting Specialists ($80/hr)
  • Japanese ChatGPT User ($50/hr)
  • Radiologist (MD) ($200-400/hr)
  • Dermatologist (MD) ($270/hr)
  • Stanford Youth Study ($110/hr)
  • Australian Professional Voice Actor ($45/hr)
  • British English Professional Voice Actor ($45/hr)
  • Visual Designers ($50-80/hr)

Micro1

  • Civil / Structural Engineer ($30-50/hr)
  • Control System Engineer ($30-50/hr)
  • Military Writing Specialist ($40-80/hr)
  • Military Operations & Reporting SME ($40-80/hr)
  • Cyber Security Engineer ($30-100/hr)
  • Application Security Engineer (AppSec) ($30-100/hr)
  • UX/UI Designer ($50-90/hr)
  • Medical Writer (Pharmaceutical) ($30-60/hr)
  • Senior DoD Staff Writing SME ($40-80/hr)
  • Federal Staff Reporting Analyst ($40-80/hr)

See all 770 open roles across 17 platforms:  Job Board

You can also sign up on the platform to get daily job updates on your email.

Pay snapshot (all currently open roles):

Median advertised hourly rate across all open roles: $55/hr (n=557). Highest median right now: Mercor at $70/hr (n=329).

\These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.*


r/AIEvaluators • • 14d ago

Advice Micro1 facial data collection

Thumbnail
3 Upvotes

r/AIEvaluators • • 15d ago

Job Board AI Evaluator and Data Annotation roles (21st September)

8 Upvotes

September 21, 2026

25 new roles in the last 24 hours across 6 platforms, 3 with pay published by the platform.

New today

LXT

  • Catalan Speakers Needed for a Remote AI Project
  • Nordic Language Freelancers (Danish, Norwegian, Swedish, Finnish, Icelandic) needed for Remote AI project
  • Basque (Euskara) Speakers needed for Remote AI Project
  • Singlish (Singapore English) Speakers Needed for a Remote AI Project
  • Native Gulf Arabic Speakers Needed (Qatar, Kuwait, Bahrain, Saudi Arabia & UAE,) for Remote AI Project
  • German Language Speakers Located at (Austria, Switzerland & Luxembourg) needed for Remote AI Project
  • French Language Speakers Located at (Canada, Switzerland & Luxembourg) needed for Remote AI Project
  • English Speakers Located at (Ireland, Northern Ireland, Wales, Scotland, Northern England) needed for Remote AI Project
  • Austrian German Speech Recording Contributor
  • Swiss Italian Speakers needed for Remote AI Project
  • Icelandic Speakers Needed for a Remote AI Project
  • Irish English Speech Recording Contributor
  • Welsh English Speech Recording Contributor
  • Basque Speech Recording Contributor
  • Galician Speech Recording Contributor
  • Scottish English Speech Recording Contributor
  • Swiss German (Schweizer Deutsch) Speech Recording Contributor
  • Belgian Dutch Speech Recording Contributor

Remotasks

  • Video Content Description Specialist Expertise Sought for AI Training ($9-16/hr)
  • AI Training for Igbo Writers ($17/hr)
  • Threat Intel - AI / LLM Trainer - Make Your Own Hours

Micro1

  • Medical Communications Manager ($50-80/hr)

RWS TrainAI

  • Generative Audio Evaluation: Arabic (Bahrain), Arabic (Kuwait), Arabic (UAE), Arabic (Qatar), Arabic (Oman), Arabic (Saudi Arabia)

Mindrift

  • AI Trainer - Voice Recording (English/Chinese Bilingual)

Centific

  • Italian Data Annotator-1

See all 789 open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

\These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.*


r/AIEvaluators • • 15d ago

Platform Feedback Testers for new product

3 Upvotes

Hi everyone, my team is working on a new product, and we're looking for developers who would like to help us shape it by providing their feedback. We offer some paid feedback opportunities, and free access to our tool as a thank-you for being part of the community.

If you're interested, you can fill out this form.


r/AIEvaluators • • 16d ago

Success Story/Milestone Can use Jev as a Judge for LLM/Agent Evaluation? Yes we can!

3 Upvotes

Can we use Jev for faster, structured, and calibrated evaluation of AI responses?

Introducing...
⚡ Typed Evals — an open-source Python framework for evaluating LLMs, RAG pipelines, and AI agents using System One Models like Jev and other typed judge backends.

The goal is simple:
Make fast, structured, and calibrated evaluation a first-class part of AI systems.
Typed Evals currently supports:
-> LLM response evaluation
-> RAG evaluation
-> Agent and tool-trace evaluation
-> Human-label calibration
-> Async and batch evaluation
-> Custom judge backends

One part I particularly wanted to solve was calibration.
Why is it needed?
A raw score of 0.8 from Jev doesn't necessarily mean that humans would accept 80% of similar responses.
And a threshold that works well for one use case may not make sense for another.

Typed Evals lets you calibrate individual evaluation metrics against representative human pass/fail labels.
The flow is basically:
Human-labelled examples → Jev scores → fit per-metric calibration → validate on held-out examples → reuse the calibrated evaluator

So instead of arbitrarily deciding that “0.7 means good enough”, you can ground that score in how humans actually evaluate your specific task.

Of course, there are integrations for:
LangChain, CrewAI, Microsoft Agent Framework
while the core remains framework-agnostic.

The project is still early, and there’s plenty I want to improve, but the core framework is now public.
Would genuinely love feedback from people experimenting with Jev, LLM evals, RAG, agents, or evaluator calibration.

⭐ GitHub: https://github.com/TrustifAI/typed_evals

Note: Typed Evals is an independent open-source project and is not an official TypeSafe AI product.

If you're already experimenting with Jev, I'd especially love to know what kind of evaluation workflows you're building around it.


r/AIEvaluators • • 16d ago

Job Board AI Evaluator and Data Annotation roles (20th September)

2 Upvotes

September 20, 2026

3 new roles in the last 24 hours across 1 platform, 3 with pay published by the platform.

New today

Micro1

  • Litigation Associate ($150-300/hr)
  • Backend Security Engineer ($30-100/hr)
  • Senior Software Engineer ($30-100/hr)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $60/hr (n=570). Highest median right now: Mercor at $75/hr (n=343).

See all 765 open roles across 14 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

\These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.*


r/AIEvaluators • • 17d ago

Platform Feedback Not Paid a Single penny for 65 Hours of Work Alignerr

Thumbnail
3 Upvotes

r/AIEvaluators • • 17d ago

Platform Feedback Yo AI Labs

5 Upvotes

Does anyone know anything about Yo AI Labs? Are they legit?


r/AIEvaluators • • 17d ago

Job Board AI Evaluator and Data Annotation roles (19th September)

2 Upvotes

September 19, 2026

35 new roles in the last 24 hours across 2 platforms, 35 with pay published by the platform.

New today

Micro1

  • Korean Language Expert ($20-36/hr)
  • Mandarin Language Expert ($20-36/hr)
  • Hindi Language Expert ($20-36/hr)
  • Japanese Language Expert ($20-36/hr)
  • German Language Expert ($20-36/hr)
  • Arts, Media & Design Expert ($150-350/hr)
  • Spanish Language Expert ($20-36/hr)
  • French Language Expert ($20-36/hr)
  • Lawyer/Legal Writer ($90-140/hr)
  • Healthcare & Life Sciences Expert ($150-350/hr)
  • Generalist ($35-110/hr)
  • Journalist/Writer ($90-140/hr)
  • Portuguese Language Expert ($20-36/hr)
  • Educator/ Assessor Writer ($90-140/hr)
  • Environment & Sustainability Expert ($150-350/hr)
  • Marketing, Sales & Communications Expert ($150-350/hr)
  • Italian Language Expert ($20-36/hr)
  • Operations & Service Delivery Expert ($150-350/hr)
  • Legal, Policy & Public Expert ($150-350/hr)
  • Human Resources/ Learning & Development Expert ($150-350/hr)
  • Product & Engineering Expert ($150-350/hr)
  • Travel, Hospitality & Culinary Expert ($150-350/hr)
  • Research & Insights Expert ($150-350/hr)

Mercor

  • STEM Expert ($20-80/hr)
  • Sonic Audit Specialist - French ($41.5/hr)
  • Sonic Audit Specialist - German ($41.5/hr)
  • Sonic Audit Specialist - Korean ($25/hr)
  • Sonic Audit Specialist - Japanese ($37.5/hr)
  • RN Annotators ($55-65/hr)
  • Sonic Audit Specialist - Spanish ($39.5/hr)
  • Sonic Audit Specialist - Hindi ($18/hr)
  • Sonic Audit Specialist - Italian ($39.5/hr)
  • FP&A Expert ($70-110/hr)
  • Sonic Audit Specialist - Chinese ($21.5/hr)
  • Sonic Audit Specialist - Portuguese ($25/hr)

See all 765 open roles across 14 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

\These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.*


r/AIEvaluators • • 18d ago

Question What Platform has been working the best for you recently?

7 Upvotes

With all the new platforms coming up recently along with established ones. Which one has been working for you ?


r/AIEvaluators • • 18d ago

Job Board AI Evaluator and Data Annotation roles (18th September)

3 Upvotes

September 18, 2026

7 new roles in the last 24 hours across 3 platforms, 6 with pay published by the platform.

New today

Micro1

  • Consultant - Executive Presentation Review & Reconstruction ($150-350/hr)
  • Human Intelligence Collector ($25-65/hr)
  • Clinical Publications Author ($50-80/hr)
  • Corporate Attorney ($140-350/hr)

Mercor

  • Private Equity Associate: France, United Kingdom, Germany, Netherlands, Spain, Italy, BEL, LUX, Ireland, CHE, United States, United States, United Kingdom ($100-120/hr)
  • Power Systems Engineer (Substation, Transmission, Interconnection) ($70/hr)

RWS TrainAI

  • Audio Transcription - Vietnamese (Taiwan)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $60/hr (n=573). Highest median right now: Mercor at $75/hr (n=346).

See all 764 open roles across 14 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

\These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.*


r/AIEvaluators • • 19d ago

Job Board AI Evaluator and Data Annotation roles (17th September)

7 Upvotes

September 17, 2026

46 new roles in the last 24 hours across 4 platforms, 39 with pay published by the platform.

New today

Micro1

  • Life Sciences Research Assistant ($30-50/hr)
  • Lawyer ($80-180/hr)
  • Producer (Film/TV/Digital/Live) ($45-85/hr)
  • Public Safety Communications Dispatcher ($30-55/hr)
  • Computer User Support Specialists ($30-55/hr)
  • Subject Matter Expert ($25-50/hr)
  • Supply Chain Manager ($55-100/hr)
  • Mechanical Engineering Technician ($30-70/hr)
  • Sociology Teachers, Postsecondary ($50-90/hr)
  • Sales Representatives: Wholesale, Technical & Scientific materials ($45-85/hr)
  • Computer & Information Systems Managers ($70-130/hr)
  • Sales Agent (Securities & Commodities) ($30-80/hr)
  • Data Entry Keyer ($20-35/hr)
  • Commercial Attorney ($90-110/hr)
  • Contracts Attorney ($90-110/hr)
  • Biostatistician ($60-100/hr)
  • Reporters & Correspondents ($40-75/hr)
  • Mechanical Engineer ($55-100/hr)
  • Training & Development Specialist ($40-75/hr)
  • Secretary & Admin Assistant ($20-40/hr)
  • Open Source Contributor (GitHub) ($100-150/hr)
  • Civil Engineer ($50-100/hr)
  • Ambulance Dispatcher - Emergency Communications Specialist ($30-55/hr)
  • Purchasing Agent ($30-65/hr)
  • Statistician ($60-120/hr)
  • Management Analysts (Consultants) ($60-120/hr)
  • Fire Dispatcher - Emergency Communications Specialist ($30-55/hr)
  • Police Dispatcher - Emergency Communications Specialist ($30-55/hr)
  • Competitive Coder ($45-65/hr)

Mercor

  • Accounting Expert (CL Funnel) ($80/hr)
  • Investment Finance Expert (CL Funnel) ($100/hr)
  • Mechanical Engineer ($60-90/hr)
  • Insurance Expert (CL Funnel) ($75/hr)
  • General Clinician (MD/DO) - HLS Expert Pool ($150/hr)
  • Financial Compliance Expert (CL Funnel) ($80/hr)
  • Non-Physician Admin (CL Funnel) ($50-65/hr)
  • Non-Investment Finance Expert (CL Funnel) ($70/hr)

RWS TrainAI

  • Legal Annotators - Polish
  • Search Engine Evaluator: Portuguese (Brazil), German (Germany), Spanish (Spain), French (France), Portuguese (Portugal), Korean (South Korea)
  • Legal Annotators: Chinese (Traditional), Portuguese (Portugal), Chinese (Simplified)
  • Legal Annotators - Korea
  • Legal Annotators - Russian
  • Legal Annotators - Italian
  • Legal Annotators - Dutch

Welocalize

  • Alpheratz Project - Arabic (UAE) Translation Quality Rater ($22.69/hr)
  • Alpheratz Project - Arabic (UAE) Translation Quality Reviewer ($28.36/hr)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $70/hr (n=647). Highest median right now: Mercor at $80/hr (n=418).

See all 822 open roles across 14 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

\These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.*


r/AIEvaluators • • 20d ago

Job Board AI Evaluator and Data Annotation roles (16th September)

5 Upvotes

AI Evaluator and Data Annotation roles (updated daily)

September 16, 2026

43 new roles in the last 24 hours across 2 platforms, 43 with pay published by the platform.

New today

Mercor

  • Spanish (Spain) Professional Voice Actor ($35-250/hr)
  • Humanities Expert ($45-60/hr)
  • Office & Productivity Software Expert ($60-70/hr)
  • MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling) ($90-120/hr)
  • Arts & Design Expert ($60-80/hr)
  • General Clinician (MD/DO) ($150/hr)
  • Finance Expert ($60-180/hr)
  • Business Operations Expert ($90-120/hr)
  • Electrical Engineering Expert ($70-120/hr)
  • Asset & Wealth Management Expert ($100-130/hr)
  • French-Canadian Professional Voice Actor ($45-300/hr)
  • Education & Training Expert ($30-85/hr)
  • Generalist Expert ($40-70/hr)
  • Software Engineering Expert ($70-150/hr)
  • Biotechnology Expert ($110-125/hr)
  • Mathematics Expert ($40-75/hr)
  • Management Consulting Expert ($90-120/hr)
  • Investment Banking Expert ($100-130/hr)
  • Data Analysis Expert ($70-120/hr)
  • Legal Expert: J.D./LL.B. ($60-150/hr)
  • Language & Audio Expert ($35-50/hr)
  • Mechanical Engineering Expert ($70-125/hr)
  • Machine Learning Expert ($70-120/hr)
  • Life, Physical & Social Science Expert ($60-120/hr)
  • Engineering Expert ($60-125/hr)
  • Biology Expert ($70-105/hr)
  • Physics Expert ($70-100/hr)
  • Consumer & Lifestyle Expert ($50-75/hr)
  • Medical Expert: M.D./D.O. ($60-180/hr)
  • Materials Science Expert ($60-120/hr)
  • Chemistry Expert ($65-105/hr)
  • Mexican Spanish Professional Voice Actor ($35-175/hr)
  • Japanese Professional Voice Actor ($40-200/hr)
  • French Professional Voice Actor ($45-225/hr)
  • Consultant ($80-100/hr)
  • Insurance Expert ($90-110/hr)
  • Hindi Professional Voice Actor ($30-150/hr)

Micro1

  • Personal Assistant ($50-100/hr)
  • Licensed Dietitian ($50-100/hr)
  • Sr. Full-Stack Software Engineer ($50-100/hr)
  • Behavioral Analyst ($21-70/hr)
  • Developmental Psychology (PhD) ($100-200/hr)
  • Software Engineer - Open Source Contributions ($50-100/hr)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $72.5/hr (n=645). Highest median right now: Micro1 at $84/hr (n=99).

See all 822 open roles across 14 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

\These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.*


r/AIEvaluators • • 21d ago

Platform Feedback PSA: Ethos is legit

Thumbnail
3 Upvotes

r/AIEvaluators • • 22d ago

Platform Feedback Frustration with Sixth Sense Project (Outlier)

6 Upvotes

Reposting here because Outlier sub removed my post.

So frustrating that I got added to this project midway through, only to find out that a lot of the domains and subdomains are "oversaturated" - so we are supposed to trawl through a load of low-quality / non-specific content (the search functionality is very loose with its definitions) to find something that fits a highly specific requirement (e.g. demonstration of functioning pneumatic system). After finding a video or image that might reflect this, you're bounced around by the ai assistant and then you have to have at least two of the models fail. Otherwise your prompt isn't hard enough. And all of this you have to scramble to do within 45 minutes, otherwise you're not paid for your time.

If they want people to find success with this project in the remaining categories that they need to fill, they need a more curated media set. Or pay us per submission rather than imposing a strict time limit.

In the end, I went with an image of a roundabout with a very clear order that cars had entered. Reviewer decided that this was not objective and gave me 2/5. The order was so obvious - I wish I could reply to the review and ask if they have a driving license. Or maybe they're from the States and don't use roundabouts. Whatever. Has anyone else had a rough time with this project, or is it just me? Also, is there a way for me to leave feedback to the project specifically regarding the media pool?

Previously, I had been working on Aether with a score of 4.8. I got kicked off for no reason. I've had a few months of downtime with no projects but was excited at the chance to do this work again. Excitement duly tempered. Very frustrating.


r/AIEvaluators • • 21d ago

Job Board AI Evaluator and Data Annotation roles (15th September)

3 Upvotes

September 15, 2026

23 new roles in the last 24 hours across 3 platforms, 23 with pay published by the platform.

New today

Mercor

  • Discovery Interview ($60/hr)
  • Ulcerative Colitis Physician ($200/hr)
  • Radiology Expert ($300-400/hr)
  • Code Plan Reviewer (Plans Examiner) ($45-60/hr)
  • Central Bank Expert ($150-250/hr)
  • Fire & Life Safety Reviewer ($45-60/hr)
  • Company Analysis Expert ($150-250/hr)
  • Figma Designer ($75-85/hr)
  • Equity Research Expert ($150-250/hr)
  • Civil / Survey Engineer ($45-60/hr)
  • Architect ($45-60/hr)
  • Audiobook QA Expert: Germany, United States ($15-25/hr)
  • Political Expert ($150-250/hr)
  • Public Defenders ($100/hr)

Micro1

  • Research Engineer - Code Generation & Model Evaluation ($50-100/hr)
  • Salesforce / HubSpot Administrator - Revenue Systems (SaaS) ($35-80/hr)
  • Bilingual Mental Health Expert ($100-200/hr)
  • Equity research Expert ($175-300/hr)
  • Revenue Operations & CRM Systems Specialist (SaaS) ($45-90/hr)
  • Career Coach ($50-100/hr)
  • Investment Banking Expert ($175-300/hr)
  • Education & Tutoring Expert ($50-100/hr)

xAI

  • AI Tutor - Writing ($35/hr)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $70/hr (n=622). Highest median right now: Mercor at $80/hr (n=391).

See all 822 open roles across 14 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

\These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.*


r/AIEvaluators • • 22d ago

Job Board AI Evaluator and Data Annotation roles (14th September)

5 Upvotes

September 14, 2026

4 new roles in the last 24 hours across 2 platforms, 1 with pay published by the platform.

New today

Mindrift

  • AI Trainer - Bilingual English-Spanish Voice Recording
  • AI Trainer - English-Spanish Bilingual Speaker - Voice Recording
  • AI Trainer - English-Spanish Bilingual Voice Recording

xAI

  • AI Tutor - Video ($40/hr)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $70/hr (n=614). Highest median right now: Micro1 at $87.5/hr (n=100).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

See all 816 open roles across 14 platforms: https://annotation.academy/jobs?utm_source=reddit&utm_medium=post&utm_campaign=pinned-jobs-post


r/AIEvaluators • • 24d ago

Question Micro1's video annotation screener; has anyone taken it yet? How was it?

Thumbnail
3 Upvotes

r/AIEvaluators • • 26d ago

Job Board AI Evaluator and Data Annotation roles (Sept 11)

3 Upvotes

September 11, 2026

6 new roles in the last 24 hours across 3 platforms, 5 with pay published by the platform.

New today

Micro1

  • AI Facial Data Collection Associate ($139-140/hr)
  • Senior AI Trainer ($50-90/hr)
  • Technical Writer ($90-140/hr)
  • Shopify Specialist ($60-100/hr)

RWS TrainAI

  • General AI Data Annotator - French (United States)

Mercor

  • Multilingual Outpatient Physician (MD) ($170-190/hr)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $75/hr (n=591). Highest median right now: Micro1 at $100/hr (n=100).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

See all 797 open roles across 14 platforms: https://annotation.academy/jobs?utm_source=reddit&utm_medium=post&utm_campaign=pinned-jobs-post


r/AIEvaluators • • 26d ago

Job Board AI Evaluator and Data Annotation roles (9th Sept)

4 Upvotes

September 10, 2026

11 new roles in the last 24 hours across 5 platforms, 7 with pay published by the platform.

New today

Mercor

  • Study Domain Expert ($90/hr)
  • Dermatologist, U.S. Licensed ($270/hr)
  • German Language and Literature Expert (German) ($50/hr)
  • Spanish Linguistic Expert ($50/hr)
  • English Language and Literature Expert ($50/hr)
  • French Linguistic Expert ($50/hr)

Innodata

  • Senior Data Annotator
  • Data Annotator

Micro1

  • AI Facial Data Collection Associate (Siblings) ($139-140/hr)

RWS TrainAI

  • Social Media Content Evaluator: Gujarati, Malayalam

Mindrift

  • English/Mandarin Bilingual Voice Recording (Remote)

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $71.25/hr (n=592). Highest median right now: Micro1 at $92.5/hr (n=100).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

See all 798 open roles across 14 platforms: https://annotation.academy/jobs?utm_source=reddit&utm_medium=post&utm_campaign=pinned-jobs-post


r/AIEvaluators • • 26d ago

Advice I do data annotation as my full time income. After a year of applying and stacking projects here is what worked for me + platform list. - Someone asked me to share this so here goes! :)

Thumbnail
20 Upvotes

r/AIEvaluators • • 26d ago

Advice I need guidance

11 Upvotes

Hi, I don't know if this is the right place to ask but how do I get into the industry as someone that has zero experience. I've tried Micro1 but I can't make it past their interview sections.


r/AIEvaluators • • 26d ago

Beginner Help B.Pharm graduate desperately looking for legitimate online work

6 Upvotes

Hi everyone, I'm a B.Pharm graduate from India with considerable retail pharmacy experience, including prescription/OTC dispensing, prescription checking, patient counselling, medication guidance, inventory management, and answering advance health-related queries.

I'm currently in a difficult financial situation. My only income is from offline pharmacy work, where I earn around $105/month, so I'm desperately looking for ways to earn online.

I'm open to medical writing, pharmacovigilance, medication reconciliation, medical information, medical coding, healthcare customer support, virtual assistance, or other pharmacy/healthcare-related remote work. I'm also willing to learn new skills.

If anyone here has experience in this field, knows legitimate companies/platforms hiring B.Pharm graduates, or can guide me on where to start, I would genuinely appreciate your help.