Performance Engineer, Inference Systems

Company hidden

San Francisco, CA | New York City, NY | Seattle, WA Posted 30+ days ago

The Inference System Dynamics team is responsible for understanding that whole system and holding it to a high bar across four dimensions: throughput, latency, reliability, and correctness. We measure how the fleet performs against its theoretical performance frontier, run cross-layer investigations to explain the gaps, and own the correctness checks that make sure Claude's outputs are right, not just fast, across hardware platforms and serving configurations. We don't own the individual components. We instrument and model them, find the highest-leverage opportunities across them, and partner…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

See how well you match this job

Upload your resume and we’ll score your fit for this role — then tailor your CV to it with AI. Free, no credit card.

Check your match

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.