Staff Software Engineer, Inference

Company hidden

London, UK Posted 30+ days ago
Inference systems are highly performance sensitive distributed systems. Inference serves hundreds of thousands of customers every day, and the size & span of the inference fleet requires sophisticated routing, scaling, and networking systems. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms. KEY RESPONSIBILITIES * Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide * Develop resilient, flexible systems that adapt in real time to real-world…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.