Staff Software Engineer, AI Reliability

Company hidden

San Francisco, CA | New York City, NY | Seattle, WA Posted 30+ days ago

Reliability here is an emergent phenomenon that transcends any single team's boundaries, so someone has to zoom out and look at the whole picture. That's us -- and it means few teams at the company offer this kind of dynamic, cross-cutting exposure to the systems that matter most. RESPONSIBILITIES: * Develop appropriate Service Level Objectives for large language model serving systems, balancing availability and latency with development velocity * Design and implement monitoring and observability systems across the token path * Assist in the design and implementation of high-availability…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

See how well you match this job

Upload your resume and we’ll score your fit for this role — then tailor your CV to it with AI. Free, no credit card.

Check your match

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.