Software Engineer, Model Runtime

Company hidden

San Francisco Remote Full-time$266k–$445k / year Posted 30+ days ago

Above market. This role pays above the $217k median for similar USD roles (812 comparable postings in our corpus).

You will work across model architecture, distributed systems, compilers, kernels, and silicon to design a production-grade runtime comparable in ambition to systems such as vLLM and SGLang, but customized and optimized for the company’s AI accelerator. Your work will shape how new model capabilities map onto the platform and how quickly custom silicon can deliver meaningful performance in production. In this role, you will: * Design and implement the LLM inference runtime for frontier models running on custom silicon. * Build scheduling, continuous batching, memory management, KV-cache…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

See how well you match this job

Upload your resume and we’ll score your fit for this role — then tailor your CV to it with AI. Free, no credit card.

Check your match

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.