Technical Program Manager, Inference

Company hidden

San Francisco, CA | New York City, NY | Seattle, WA Posted 3d ago
We're looking for a Technical Program Manager to drive the programs that scale it. The work spans four closely coupled areas: * Scaling and infrastructure. Routing, autoscaling, and capacity management for the serving fleet, and bringing new capacity online. * Velocity. The toolchains, development environments, and CI/CD that let inference engineers build, test, and ship across every accelerator platform. * Inference engine. The software between the accelerator kernels and the routing layer that serves every request. * Performance. Improving throughput, latency, cost, and reliability…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.