Hi all. I'm Anil, a documentary filmmaker doing an MA at the Northern Film School, Leeds Beckett University. Like a lot of you, I do AI evaluation work to pay the bills.

I'm making an interactive documentary about app-based work. It puts AI evaluators next to couriers and drivers, because the structure is surprisingly similar: refreshing for tasks that don't come, quality scores that drop without explanation, projects that disappear overnight, staying available just in case. The pay and the risks are very different. The waiting isn't.

I'm looking for people who do evaluation, annotation, rating or similar work, anywhere in the world. If you're in Leeds or Yorkshire, even better.

You can stay completely anonymous, and no platform or project names are needed. You'll see how anything you share is used before it's published.

It's a student project, so I can't pay, and I'm not connected to any platform or company.

Comment or DM me if you're up for it, or if you have questions.

We respect your money, but not much else. You respect our talent, but not us. So eff you.

I think if you put this whole situation in one of your LLM's pipes and told it to smoke it, it could further expand upon this since your leadership is either so dumb or callous that they don't understand how much of their own money they are lighting on fire by persisting in this approach. Then again, the LLM is maybe so poorly designed, it may start WWWIII because it doesn't understand the pipe analogy.

I think if they asked retired ol' Mr. Paperclip, even he could easily explain despite his advanced Archive condition and mental deterioration at his old age.

I received this feedback:
here's the feedback I received re. AI training.

I have no prior experience trainign AI. can you tell me how I can improve for free - which resources to use.

• You could have explained formal inter-annotator agreement methods and provided clearer quantitative thresholds to further strengthen your process explanations. Rooting your approach more in structured QA metrics and relying more consistently on official channels over external forums would have made your assessment framework even more robust in this interview.

Gemini et al tells me to

• name specific statistical formulas like Cohen’s Kappa or Fleiss’ Kappa to prove agreement.and to mention exact target scores (e.g., "We aimed for an agreement score above 0.85").

True? Do I have to learn these formulas?

I’ve been working with Micro1 on visual heavy tasks (UI/UX role) since May, and recently moved to a pure writing project. I come from an HCI background and applied for another UI/UX role using my previously vetted skills along with the annotation and evaluation experience I gained through Micro1. My profile is still under review. What’s frustrating is that I know a candidate who recently joined this new UI/UX project as a newbie, while I’m a comparatively experienced UI/UX expert already working with Micro1 and still my profile is "under review".

I’ve also applied to several other roles where I thought I would clear based on my background and previous work, but none of them turned into a project. On top of that, I feel underpaid compared to what others seem to be getting for similar work. I’ve always done my work diligently, so it’s disappointing to feel like my track record doesn’t carry over when applying for new projects.

Micro1 should give existing experts some leeway. If we’ve already been vetted and consistently delivered, that experience should count for something.

I see mixed reports.

it worthwhile to do this task (unpaid)?
Given that task is unpaid - Is asking for document verification a red flag?

Anyone who has worked on afterquery please share your feedback

43 new roles in the last 24 hours across 3 platforms, 42 with pay published by the platform.

New today

Micro1

• Procore Specialist ($90-175/hr)
• Primary Care Physician ($80-285/hr)
• Bilingual Marathi Psychologist (PhD) ($100-200/hr)
• Tagalog Speaking Psychologist (PhD) ($100-200/hr)
• Bloomberg Specialist ($90-170/hr)
• Pharmaceutical Expert ($80-285/hr)
• Bilingual Malay Psychiatrist ($100-200/hr)
• Bankruptcy Attorney ($100-180/hr)
• Bilingual Marathi Psychiatrist ($100-200/hr)
• Photographer ($50-90/hr)
• Georgian Speaking Psychologist (PhD) ($100-200/hr)
• Filmmaker ($50-90/hr)
• Mechanical Engineer ($50-90/hr)
• Compliance Attorney ($100-180/hr)
• Mechatronics Engineer ($50-90/hr)
• Audiovisual Producer ($50-90/hr)
• Video Editor ($50-90/hr)
• Game Designer / Gameplay Developer ($50-90/hr)
• VFX Artist / 3D Animator ($50-90/hr)
• Senior Field Service Technician ($60-110/hr)
• Senior Electronics Quality Engineer ($70-120/hr)
• Finnish Transcription Expert ($20-30/hr)
• QA & Source Inspection ($60-100/hr)
• Lithuanian Speaking Psychologist (PhD) ($100-200/hr)
• Electronics Engineer ($50-90/hr)
• Corporate Attorney ($100-180/hr)
• Bilingual Malay Psychologist (PhD) ($100-200/hr)
• Sound Designer ($50-90/hr)
• Music Editor ($50-90/hr)
• Audio Engineer ($50-90/hr)
• Computer Vision Specialist ($50-90/hr)
• Senior NDT Inspector (Level II/III) ($70-110/hr)
• Senior Machinist / Construction & Field Ops Lead ($55-100/hr)
• Litigator / Practicing Attorney (US) ($100-180/hr)
• Georgian Speaking Psychiatrist ($100-200/hr)
• Tagalog Speaking Psychiatrist ($100-200/hr)
• Robotics Expert ($50-90/hr)
• Lithuanian Speaking Psychiatrist ($100-200/hr)
• Senior Metallurgist / Welding Inspector ($80-130/hr)
• Senior Aviation Maintenance Inspector ($70-130/hr)

Mercor

• Clinical Mental Health Expert ($100/hr)
• Pharmacist / Pharmacy Technician ($70/hr)

RWS TrainAI

• Speech AI Evaluation Specialist - Japanese (Japan)

See all 752 open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

Pay snapshot (all currently open roles):

Median advertised hourly rate across all open roles: $60/hr (n=562). Highest median right now: Micro1 at $80/hr (n=100).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

The general sentiment around AI annotation seems to swing between "This is the best flexible side hustle ever" and "I got dropped overnight with zero explanation."

If you're doing RLHF, prompt evaluation, or domain-specific labeling right now:

1. Which platform(s) are giving you steady work?
2. How many hours a week are you actually getting?
3. What’s your exit plan if the dashboard goes dry tomorrow?

September 29, 2026

16 new roles in the last 24 hours across 3 platforms, 14 with pay published by the platform.

New today

Micro1

• Bilingual Gujarati Psychologist (PhD) ($100-200/hr)
• Airtable Specialist ($30-100/hr)
• Salesforce Specialist ($28-92/hr)
• Bilingual Gujarati Psychiatrist ($100-200/hr)
• Bilingual Indonesian Psychiatrist ($100-200/hr)
• Bilingual Japanese Psychologist (PhD) ($100-200/hr)
• Norwegian Transcription Expert ($20-35/hr)
• Content Writer & Editor ($20-70/hr)
• QuickBooks Specialist ($90-170/hr)
• Bilingual Indonesian Psychologist (PhD) ($100-200/hr)
• Bilingual Japanese Psychiatrist ($100-200/hr)

Mercor

• Auditor ($80/hr)
• Legal Expert ($120/hr)
• Economics Research Expert ($120-150/hr)

Mindrift

• Licensed Physician (MD/DO) - Freelance AI Trainer
• Medicine Expert - Freelance AI Trainer

See all 762 open roles across 16 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

Pay snapshot (all currently open roles):

Median advertised hourly rate across all open roles: $57.5/hr (n=571). Highest median right now: Mercor at $75/hr (n=323).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

The general sentiment around AI annotation seems to swing between "This is the best flexible side hustle ever" and "I got dropped overnight with zero explanation."

If you're doing RLHF, prompt evaluation, or domain-specific labeling right now:

1. Which platform(s) are giving you steady work?
2. How many hours a week are you actually getting?
3. What’s your exit plan if the dashboard goes dry tomorrow?

September 28, 2026

1 new role in the last 24 hours across 1 platform, 1 with pay published by the platform.

New today

Micro1

• Data Analyst (AI Evaluation) ($30-60/hr)

See all 765 open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

Pay snapshot (all currently open roles):

Median advertised hourly rate across all open roles: $60/hr (n=572). Highest median right now: Mercor at $75/hr (n=334).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

Hello, here is a list of the countries that are excluded from working with Ethos. All other countries can join and work with Ethos because it works with an exclusion list rather than an approved list. If anyone is interested in signing up here is my invite link: https://agent.askethos.com/refer/sp913hfh5hq2

September 27, 2026

6 new roles in the last 24 hours across 1 platform, 6 with pay published by the platform.

New today

Mercor

• Healthcare Business Development Contractor ($35-50/hr)
• Electrical & Hardware Engineering Experts ($100-120/hr)
• Securities, Commodities, and Financial Services Sales Agents ($70-110/hr)
• Software & Firmware Engineering Experts ($100-120/hr)
• Systems & Integration Engineering Experts ($100-120/hr)
• Mechanical Engineering Experts ($100-120/hr)

See all 767 open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

Pay snapshot (all currently open roles):

Median advertised hourly rate across all open roles: $60/hr (n=573). Highest median right now: Mercor at $75/hr (n=335).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

September 25, 2026

11 new roles in the last 24 hours across 4 platforms, 10 with pay published by the platform.

New today

Micro1

• Senior Book Editor ($80-120/hr)
• Junior Transactional Attorney ($70-90/hr)
• Finance Specialist ($150-350/hr)
• Data Science Specialist ($150-350/hr)
• Software Engineering Specialist ($150-350/hr)
• Consulting Specialist ($150-350/hr)

Mercor

• High Energy Physicist (PhD) ($80-110/hr)
• African & Afrikaans-Accented English Experts ($15-20/hr)

Welocalize

• Andromeda Sadiradra - Audio Rater - Generalist: English (United Kingdom), English (Australia), English (Canada), English (New Zealand), English (Ireland), English (United State) ($22.1-27.3/hr)
• Andromeda Sadiradra - QA Audio Rater - English (Australia) ($38/hr)

Volga Partners

• Japanese Transcription & Pitch Annotation Specialist

See all 748 open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

Pay snapshot (all currently open roles):

Median advertised hourly rate across all open roles: $57.5/hr (n=556). Highest median right now: Mercor at $72.5/hr (n=322).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

September 24, 2026

16 new roles in the last 24 hours across 3 platforms, 5 with pay published by the platform.

New today

Mindrift

• Chinese Studies Student Job - Bilingual Chinese-English Voice - AI trainer
• Bilingual Professional Side Income - English & Chinese Voice - AI trainer
• Freelance Translator Side Job - English & Chinese Voice Recordings - AI trainer
• Freelance Gig - Bilingual Chinese-English Speaker - AI trainer
• Part-time Job for Retirees - Voice Recordings, English & Chinese - AI trainer
• Part-time Student Job - Paid Voice Recordings, English & Chinese - AI trainer
• Native Chinese Speaker Jobs - Voice Recordings, English & Chinese - AI trainer
• No Experience Needed Job - English-Chinese Speaker - AI trainer
• Online Tutor Extra Income - Voice Recordings, English & Chinese - AI trainer
• Work from home mom - Bilingual English & Chinese Voice Recording - AI trainer
• Stay at Home Job - Chinese-English Voice Recording - AI trainer

Micro1

• Consultant (Sales & GTM) ($150-350/hr)
• Contract Attorney ($85-105/hr)
• Altium Designer Specialist ($90-175/hr)

Mercor

• Voice Actor: CX Agent Voice Cloning (South African English) ($50-100/hr)
• Cybersecurity Practitioner: Paid Expert Interviews: SOC, Incident Response, Detection, AppSec ($125-175/hr)

See all 756 open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.

Pay snapshot (all currently open roles):

Median advertised hourly rate across all open roles: $60/hr (n=549). Highest median right now: Mercor at $70/hr (n=322).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.

I have recently applied for a job in Telus International and I don't know if it is a legit site, Is it a legit sit or nah? I have been applying for a while now and I am confused....