AI testing jobs are three different jobs sharing one title. On 16 October 2026 our board’s 1,732 live listings held 79 testing titled roles: 56 contract evaluator and red team tasks on AI training platforms, 18 salaried evaluation and safety roles, and only 5 software QA jobs. Anthropic, OpenAI and Scale listed 13 more between them.
Listen to this article, about 14 minutes. A synthetic voice reads the article and announces each section title as it begins; tables are read row by row and the questions at the end are left out.
Recorded 16 October 2026 from the article as published that day. Press a chapter to jump there; the highlighted line is what is playing. A play button sits beside every section heading, and once you scroll past this player a bar at the bottom of the screen keeps the controls in reach. Tap or click any sentence to hear the reading start from there.
On this page: every AI testing titled listing on the getAIwork board counted and split into three families on 16 October 2026, the evaluation and red team postings at Anthropic, OpenAI and Scale with pay as listed, platform rates by named source, and what four 2026 Reddit threads report.
Think you already know this? Five questions, one minute.
Every answer is on this page. Answer from what you know now; the page fills in the rest.
-
1. Which family was the largest among the 79 AI testing titled listings on the getAIwork board on 16 October 2026?
The split was 56 platform tasks, 18 salaried evaluation roles and 5 software QA jobs. Source: the getAIwork board, crawled 16 October 2026. Read the section
-
2. What annual salary did Anthropic’s Red Team Engineer, Safeguards posting list on 16 October 2026?
The posting lists $320,000 to $405,000 a year, a range for an experienced engineer, not an offer. Source: Anthropic’s posting. Read the section
-
3. How many years of experience does Mercor’s AI Safety Red Teamer listing ask for?
It asks for a bachelor’s degree and 5 or more years in AI safety, cybersecurity or a related field, and lists $70 to $84 an hour. Source: Mercor’s listing, read 16 October 2026. Read the section
-
4. What does Outlier’s own page say onboarding includes?
Outlier lists four steps ending in verifying your skills, with skill screenings and a valid ID and phone from your country. Source: Outlier’s home page, read 16 October 2026. Read the section
-
5. How did a DataAnnotation worker on Reddit describe red teaming tasks in June 2026?
That is one worker’s report, not a platform fact, and another worker said they had never been offered one. Source: the r/DataAnnotationTech thread. Read the section
What are AI testing jobs, really?
Search for the phrase and you get course adverts, a few QA engineer postings and a lot of breathless talk about “breaking AI for a living”. The title hides three jobs that share almost nothing except the word test, so we counted them instead of guessing.
On 16 October 2026 we crawled every card on our free, public work board, whose stats.json showed 1,732 live listings, and pulled each title containing test, tester, QA, quality assurance, evaluation, evaluator, rater, red team or AI safety. That gave 133 titles. We then read them by hand and threw out 54: 43 were plain data annotation jobs, and 11 used safety in the fire, radiation or trust and safety product sense. That left 79 genuine AI testing roles, which fall into three families.
| AI testing titles on the getAIwork board, 16 October 2026 | Count | Remote | What the work is |
|---|---|---|---|
| Platform evaluator and red team tasks | 56 | 36 | Contract tasks on AI training platforms: rating answers, testing AI agents, adversarial prompts, audio QA |
| Salaried evaluation, benchmarking and AI safety roles | 18 | 1 | Employed engineers, scientists and managers who build or run model evaluations |
| Software QA and test engineering for AI products | 5 | 2 | Classic QA: test plans, automation, bug reports, on a product that happens to use AI |
| Excluded: annotation or non AI safety titles | 54 | Labelling data, or fire, radiation and trust and safety product work |
The proportions surprised us. Most people who type ai testing jobs picture software QA, yet that is the smallest family by a distance. The bulk of the work called testing in 2026 is a contractor checking what a model says, not an engineer checking what an app does. The two closest relatives on this site are AI rater jobs and RLHF jobs, which cover the rating side in more depth.
Which AI testing jobs do Anthropic, OpenAI and Scale list?
Very few, and almost none at entry level. On 16 October 2026 we read the three labs’ own job boards. Anthropic’s Greenhouse board carried 654 postings, and five had evaluation or red team in the title. OpenAI’s board carried 802, also with five. Scale AI’s carried 179, with three. That is 13 testing titled jobs out of 1,635.
Every one we opened prints a pay range, as US pay transparency rules in states such as California and New York push employers to do. Anthropic’s Red Team Engineer, Safeguards posting lists an annual salary of $320,000 to $405,000, and its Research Engineer, Post Training Model Evaluations lists $500,000 to $850,000, both as listed on 16 October 2026. Those are ranges for experienced engineers and researchers, not a rate anyone is paid for testing chatbots from home.
| Posting, read 16 October 2026 | Lab | Pay as listed | Kind of work |
|---|---|---|---|
| Red Team Engineer, Safeguards | Anthropic | $320,000 to $405,000 a year | Attacking models and systems to find abuse routes |
| Cyber Evaluations Engineer | Anthropic | $300,000 to $405,000 a year | Building cyber capability evaluations |
| Safeguards Enforcement Analyst, Safety Evaluations | Anthropic | $230,000 to $270,000 a year | Running and reviewing safety evaluations |
| Red Team, Cyber | OpenAI | $198K to $320K a year, posted 18 August 2026 | Offensive security testing of models |
| Researcher, Agent Safety, Training and Evaluations | OpenAI | $380K to $500K a year, posted 3 September 2026 | Research on agent safety evaluations |
| Research Scientist, Frontier Risk Evaluations | Scale AI | $216,000 to $270,000 base | Designing risk evaluations |
| Technical Program Manager, Red Team | Scale AI | $151,200 to $189,000 base | Running red team programmes |
Two details are worth a second look. OpenAI’s Research Engineer, Frontier Evals and Environments posting has been open since 13 April 2025, so a listing on a lab board is not proof of a fresh seat. And at OpenAI the word test mostly means hardware: eight further titles, such as Systems Test Engineer, End to End Validation, are about devices, racks and data centre equipment, not models. If you want the wider picture of one lab, our Anthropic jobs breakdown goes team by team.
If you are not sure which of the three families suits you, the getAIwork match quiz asks a few questions about your background and points you at the kind of listing that fits.
What do platform evaluator and red team tasks pay, as listed?
Far less than the lab salaries, and the rate depends on the field you bring. Pay below is as listed by the named source on the date shown; rates change and nothing here is guaranteed.
| Listing | Platform | Pay as listed | Source and date |
|---|---|---|---|
| AI Safety Red Teamer | Mercor | $70 to $84 an hour | Mercor posting, 16 October 2026 |
| QA Engineer, 2D and Creative Applications | micro1 | $90 to $175 an hour | board listing, 16 October 2026 |
| Everyday AI Agent Tester | micro1 | $25 to $45 an hour | board listing, 16 October 2026 |
| AI Safety Experts, English and Telugu | Neon | $20 to $22 an hour | board listing, 16 October 2026 |
| Audiobook QA Expert, English (US) | Mercor | $20 to $25 an hour | board listing, 16 October 2026 |
| Generalist roles | DataAnnotation | up to $50 an hour | DataAnnotation home page, 16 October 2026 |
Read the fine print on the Mercor red teamer posting before you get excited. It asks for a bachelor’s degree and 5 or more years in AI safety, trust and safety, cybersecurity, investigative journalism, life sciences or a related field, and its location list includes the USA and much of Europe but not India. The job is real; it is simply not a beginner’s job.
Sources also disagree. An older DataAnnotation listing on our board, listing 1115, quotes $15 to $20 an hour, while the company’s own home page on 16 October 2026 says generalist roles pay up to $50 an hour. Both are as listed. Up to is doing a lot of work in that sentence, which is why we quote the range and the date and stop there. Outlier’s home page publishes no rate at all, only that pay is based on hours contributed each week. Our DataAnnotation review and Mercor review carry the longer story on each.
For readers in India, the board shows one honest pattern: the Indian language AI safety listings from Neon, in Urdu, Kannada, Telugu, Punjabi, Assamese, Gujarati, Odia and Bengali, list $20 to $22 an hour, while the Nordic and Dutch versions of the same role list $48 to $62. Same title, different market rate, as listed.
Can you get an AI testing job with no experience?
Sometimes, but not through the title most people search. Of the 79 roles we counted, the ones that ask for the least are the platform tasks such as micro1’s agent tester and evaluator listings, and the general rating work on DataAnnotation and Outlier. Even those screen you first. Outlier’s own page lists four steps, from creating a profile to verifying your skills, and says onboarding includes skill screenings and needs a valid ID and a phone from your country of residence. DataAnnotation’s page names three: apply, qualify, then work.
The salaried families are a different world. The lab postings we opened are pitched at experienced engineers, researchers and analysts, and the 18 salaried evaluation roles on the board are titled for engineers, scientists and managers. The 5 software QA jobs included one entry point worth noting: a QA and Testing Intern, AI Assisted Testing role at Zudu AI in India. If you are starting from zero, our guide to AI training jobs with no experience lists what is actually open, and the Outlier assessment guide covers the screening step itself.
What do people doing AI red teaming and evaluation report?
We read four Reddit threads from 2026 through a read only fetch: one on DataAnnotation, one on Handshake AI, one on Outlier and one in a cybersecurity forum. These are what people report, not evidence of what a platform pays or does.
In a June 2026 r/DataAnnotationTech thread, one worker described red teaming tasks as trying to make a model fail with fair but adversarial prompts, and called it one of the hardest and most exhausting tasks. Another worker in the same thread said they had never been offered one. Others advised listing the work on a CV as self employed AI evaluation, without naming projects, because of confidentiality rules.
In a September 2026 r/joinhandshakeai thread, a user said a recruiter had approached them about an on site biosafety red teaming project paid hourly. Two others said they had filled in the same interest form, and one later reported receiving an assessment. The original poster mentioned mixed reports about payment on other projects, which we could not verify.
In an October 2026 r/outlier_ai thread, a contributor said their account was deactivated hours after a 100 task milestone email, and four others replied that the same had happened to them. Outlier’s official account replied that it found evidence of the user sitting idle in tasks, which it said breaks its terms. That is an allegation and a response, and neither side’s account is verified.
And in a September 2026 r/cybersecurity thread about learning to red team AI, practitioners pointed to the OWASP GenAI Red Teaming Guide and said the real findings in AI agents come from instructions hidden in what the agent reads, not from the chat box. The pattern across all four: platform red teaming is hard, screened and patchy, while the professional version looks like security work with an AI target.
Do you need an AI testing course or certificate first?
No posting we opened asked for one. None of the lab postings we read, and not the Mercor red teamer listing, named an AI testing certificate as a requirement. They asked for degrees, years in a field, security experience, or a passed screening test on the platform.
Which makes the course adverts that promise a career as a certified AI tester in six weeks look a little like selling umbrellas for a room with a ceiling. The free OWASP guide covers the method the professionals point to. If a course is still tempting, check whether a single posting you want actually names it before you pay for it.
Which AI testing route fits your background?
Your background decides it more than any course. A software tester or developer reaches the QA family and the better paid platform QA listings. Someone with years in security, safety, medicine, law or research reaches red team and expert evaluation work. A careful generalist reaches rating and agent testing tasks after a screening test. The chooser below restates the tables above; it scores nothing and predicts no pay.
Every one of the 79 roles we counted is on the getAIwork board, which is free and public with no signup, and the match quiz will narrow them down if you are starting without experience.
Which AI testing route does your background reach?
Pick the line closest to your background. Each answer restates the article’s tables; it scores nothing and says nothing about pay.
This chooser sorts routes by the requirements printed on the listings we read. It is not a prediction of acceptance or of income.
Frequently asked questions
Is AI red teaming a real job?
Yes. Anthropic, OpenAI and Scale AI each listed red team roles on 16 October 2026, and Mercor listed an AI Safety Red Teamer contract asking for 5 or more years of relevant experience.
Do AI testing jobs need coding?
The software QA and lab evaluation roles we read did. Many platform rating and agent testing tasks did not, but they screen applicants with their own tests first.
Are AI tester jobs remote?
Many platform tasks are. Of the 56 platform evaluator and red team listings on our board on 16 October 2026, 36 were listed as remote; only 1 of 18 salaried evaluation roles was.
What is the difference between an AI tester and an AI rater?
A rater usually scores or ranks model answers against guidelines. Testing titles stretch wider, from software QA on AI products to adversarial red team prompts and agent testing.
Can people in India apply for AI testing work?
Some listings are open to India, such as Neon’s Indian language AI safety tasks. Others are not: Mercor’s red teamer posting on 16 October 2026 did not list India.
Is the getAIwork board free?
Yes. The board at getaiwork.com/board/ is free and public, with no signup. It carried 1,732 live listings on 16 October 2026.
Finished the page? The same five questions from the top, to see what stuck.
Watch the 37 second summary
The video covers the takeaways of this guide in under a minute. More summaries are on getAIwork on YouTube.
Platform statuses and listed pay change without notice. Pay figures are quoted only as listed by the poster on the date shown and are never a promise of earnings. This page was verified on the date shown and is rechecked on the weekly refresh.
