Mirrai Careers

Distributed LLM Inference Engineer

Company hidden

San Francisco Remote Full-time$170k–$245k / year Posted 30+ days ago
Below market. This role pays below the $233k median for similar USD roles (22 comparable postings in our corpus).
With the company, we’re building the best place to run Ray, so that any developer or data scientist can scale an ML application from their laptop to the cluster without needing to be a distributed systems expert. Proud to be backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised to date. As part of this role, you will * Iterate very quickly with product teams to ship the end to end solutions for Batch and Online inference at high scale which will be used by open-source Ray users and customers of the company * Work across the stack integrating Ray Data and LLM engine…

See the company and apply

Unlock to see who’s hiring, read the full description and apply on the company site.

Checking access…

Explore related jobs

Want more roles like this? Browse fresh jobs or tailor your resume with AI.