Research Engineer, Benchmarks

Company hidden

San Francisco Full-time$100k–$230k / year Posted 30+ days ago

Below market. This role pays below the $265k median for similar USD roles (60 comparable postings in our corpus).

RESPONSIBILITIES * Own the design, implementation, and quality of the company’s internal agent benchmarks * Work with subject-matter experts to define tasks and create domain-specific benchmarks that evaluate agents on realistic workflows * Build infrastructure to reliably run models and agents against benchmark tasks * Develop metrics and analyses to understand benchmark difficulty, reliability, and failure modes * Validate whether benchmark performance correlates with real-world evals, customer needs, and lab expectations * Write clear documentation and benchmark reports that make…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

See how well you match this job

Upload your resume and we’ll score your fit for this role and 5 similar roles — then tailor your CV to it with AI. Free, no credit card.

Check your match

Similar jobs

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.