ML Challenge Task Auditor
Mercor
$70 – $90/hour · as listed
ML Challenge Task Auditor – Mercor
Review and evaluate machine learning tasks designed to train and benchmark advanced AI models. As an ML Challenge Task Auditor, you'll assess the quality and correctness of experiment design, model selection, and evaluation methodology. Your role involves providing structured, rubric-based feedback on the technical rigor and soundness of applied ML work. This is ideal for intermediate-level practitioners with hands-on experience in machine learning and experimental design who want to contribute to AI model development through detailed technical review.
This is a remote, hourly position based in the United States, offered at $70–$90 per hour for approximately 40 hours per week. You'll need at least 3 years of hands-on experience in applied or experimental machine learning, including familiarity with experiment design, model selection, and related practices. The role suits those who enjoy deep technical work, have strong analytical skills, and can communicate findings clearly through written assessments.
From the listing: Mercor marketplace · hourly · 40h/week. Evaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology — and provide clear, rubric-based written feedback. Basic Qualifications • 3+ years hands-on applied/experimental ML (experiment design, model selection, hyperpara
Applications are completed on the listing’s own site. Pay is shown as posted by the source (“as listed”) or the aggregator’s estimate where marked — offers and availability change, and individual results vary.
Want help getting selected — and finding the best-paid work for your country? See how membership works →