AI Session Annotator (English)
Mercor
$24 – $30/hour · as listed
Mercor is seeking English-speaking annotators to evaluate AI assistant sessions in this remote, beginner-level role. You'll review recorded interactions between users and a voice-and-camera AI system, carefully comparing the assistant's responses against actual video content. Using a structured rubric, you'll score each session and provide written feedback—your assessments directly inform which issues the development team prioritizes for improvement. This AI training work requires attention to detail and clear communication, but no prior experience is necessary.
The position is fully remote and suits anyone with strong English skills and the ability to make consistent, reasoned judgments. You'll work hourly at $24–$30 per hour, with flexibility to take sessions as they become available. This type of AI data work is ideal if you're interested in how language models and AI assistants are evaluated and refined, and want to contribute to their accuracy and reliability.
From the listing: Mercor marketplace · hourly. About the Role Mercor is hiring English-speaking reviewers to evaluate recorded sessions with a voice-and-camera AI assistant. You will watch each session, compare what the assistant said against what was actually visible in the video, and score it against a detailed rubric. Your written comments are the deliverable. What you flag as a failure is what gets fixed first. This is judgment w
Applications are completed on the listing’s own site. Pay is shown as posted by the source (“as listed”) or the aggregator’s estimate where marked — offers and availability change, and individual results vary.
Want help getting selected — and finding the best-paid work for your country? See how membership works →