Staff+ Software Engineer, ML Sampling Path

Company hidden

San Francisco, CA Posted 30+ days ago

WHAT YOU'LL DO: * Design, build, and operate the backend systems that process every token on the generation path for Claude requests, including the streaming contract with the API and inference engines. * Own latency and reliability end to end: define and maintain SLOs and error budgets for added latency, time-to-first-token, and availability, and lead incident response and postmortem follow-through. * Ship changes to the hot path rapidly but safely — canaried and gradual rollouts, error budget and latency gating, fast rollbacks — and drive per-token performance: chase tail latency and…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

See how well you match this job

Upload your resume and we’ll score your fit for this role — then tailor your CV to it with AI. Free, no credit card.

Check your match

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.