Mirrai Careers
Resume BuilderCareer Test
InsightsPricing
Get Started Free
Jobs/Software Engineer, AI Data & Evaluation

Software Engineer, AI Data & Evaluation

mercor

San Francisco Full-time$130k–$500k / year Posted 3w ago
Above market. This role pays above the $238k median for similar USD roles (300 comparable postings in our corpus).
Apply on company site
ABOUT MERCOR Mercor's mission is to organize human intelligence to power the AI economy. We partner with leading AI labs and enterprises to provide the human intelligence essential to AI development. Our vast talent network trains frontier AI models in the same way teachers teach students: by sharing knowledge, experience, and context that can't be captured in code alone. Today, more than 30,000 experts in our network collectively earn over $3 million a day. Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices. ABOUT THE ROLE As a Senior Software Engineer (AI Data & Evaluation) at Mercor, you will be at the core of building the data infrastructure and evaluation systems that power the next generation of frontier AI models. Our team's mission is to develop high-quality data types that push frontier models forward and drive the AI industry ahead. Software Engineers on this team are builders and innovators first. You will design and develop the evaluation methods and flywheels that drive continuous model improvement, engineer synthetic data pipelines and environments that generate high-signal training data at scale, and build the operational automation that keeps it all running with precision and efficiency. This role demands a product- and impact-oriented mindset, a bias toward shipping, and the ability to thrive at the intersection of data engineering, systems design, and applied AI research. YOU WILL * Innovate and develop evaluation methodologies and flywheels that continuously improve data quality and model performance at scale. * Design and build synthetic data generation systems and simulation environments that produce high-signal, high-diversity training data for frontier AI models. * Architect and ship operational automation systems that maximize throughput, efficiency, and quality across the end-to-end data pipeline. * Collaborate cross-functionally with Operations, Research, and Product to translate evolving model needs into robust, scalable engineering solutions. * Own end-to-end delivery of critical systems — from prototyping novel ideas to scaling production infrastructure. WHAT WE'RE LOOKING FOR * Strong software engineering skills with a proven track record shipping production systems end-to-end. * Deep interest in and experience with AI/ML data pipelines, evaluation frameworks, or training data systems. * Systems thinking: ability to design for scalability, quality, and operational reliability simultaneously. * Comfort operating with ownership and pragmatism in fast-moving, ambiguous environments. * Effective communication and collaboration with engineering, research, and operations teams. * Experience with synthetic data generation, reinforcement learning environments, or large-scale data quality systems is highly valued. WHY MERCOR * Impact: Your work directly shapes the quality of data powering the world's leading AI labs' frontier models. * Learning: Get early, first-hand exposure to cutting-edge model capabilities months before they reach the market. * Growth: Work at the intersection of data engineering and AI research with fast paths to ownership and leadership. BENEFITS * Bi-annual performance bonus structure * Generous equity grant vested over 4 years * Up to $15k Relocation bonus * $10K proximity bonus (if you live within 0.5 miles of our office) * $1.5K monthly stipend for meals * Free Equinox membership * $200 monthly laundry reimbursement * $200 monthly personal wellness reimbursement * Health, Dental, Vision insurance

See how well you match this job

Upload your resume and we’ll score your fit for this role and 6 similar roles — then tailor your CV to it with AI. Free, no credit card.

Check your match

Similar jobs

  • Software Engineer, Applied AI

    mercor

    San Francisco$130k–$500k
  • Senior Fullstack Engineer, Studio Experience

    mercor

    San Francisco$130k–$500k
  • AI Engineer, Evaluation

    distyl

    Remote
  • Software Engineer, Research - Human Data

    OpenAI

    San Francisco$230k–$385k
  • Software Engineer, Human Data Interface

    Anthropic

    San Francisco, CA | New York City, NY
  • Software Engineer, Agent Data Platform

    Sierra

    San Francisco, CA$230k–$390k
Apply on company site

Want more roles like this? Browse fresh jobs or tailor your resume with AI.

Mirrai Careers

AI-powered career platform: build resumes, match jobs, and plan your career.

Product

  • All Tools
  • Resume Builder
  • Career Test
  • Pricing

Legal

  • Privacy Policy
  • Terms of Service
  • Fair Use Policy

Company

MIRRAI CHAT LTD (Company No. 16403306)

71-75 Shelton Street, Covent Garden

London, WC2H 9JQ, UNITED KINGDOM

[email protected]

© 2026 Mirrai Careers. All rights reserved.