Applied Engineer, Evaluations Role
Mercor
$100 – $120/hour · as listed
Mercor is hiring intermediate-level software engineers for a remote Applied Engineer role focused on AI evaluations. You'll work part-time on the Mercor platform, converting pull requests into structured engineering tasks and using proprietary evaluation frameworks to assess frontier coding agents like Claude Code and Codex. This AI data work involves testing and benchmarking large language models to generate performance insights used by the research team. The role suits engineers comfortable with automation concepts and hands-on coding assessment work. Remote position listed at $100–$120 per hour.
From the listing: Mercor marketplace · part-time. Mercor is seeking software engineers to build and refine evaluations. You’ll turn completed pull requests into engineering tasks and use our in-house evaluation framework to multiple frontier coding agents, including Claude Code, Codex and more. We work alongside an in-house research team and have produced industry leading benchmarks to compare the performance of frontier large language models.
Applications are completed on the listing’s own site. Pay is shown as posted by the source (“as listed”) or the aggregator’s estimate where marked — offers and availability change, and individual results vary.
Want help getting selected — and finding the best-paid work for your country? See how membership works →