Staff + Senior Software Engineer, Inference Infrastructure

Company hidden

San Francisco, CA | New York City, NY | Seattle, WA Posted 30+ days ago

The team has a dual mandate: maximizing compute efficiency to reliably serve our explosive customer growth, while enabling breakthrough research by giving our scientists the high-performance inference infrastructure they need to develop next-generation models. We tackle complex, distributed systems challenges across multiple accelerator families and emerging AI hardware running in multiple cloud platforms. Inference systems are highly performance sensitive distributed systems. Inference serves hundreds of thousands of customers every day, and the size & span of the inference fleet requires…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

See how well you match this job

Upload your resume and we’ll score your fit for this role — then tailor your CV to it with AI. Free, no credit card.

Check your match

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.