Mirrai Careers
Resume BuilderCareer Test
InsightsPricing
Get Started Free
Jobs/Systems Engineer (C++)

Systems Engineer (C++)

lm-studio

New York City Full-time$175k–$275k / year Posted 30+ days ago
Market rate. This role pays around the $191k median for similar USD roles (510 comparable postings in our corpus).
Apply on company site
THE ROLE We are hiring a C++ Systems Software Engineer in New York City. You design, build, and optimize the core native runtime that powers LM Studio and the C++ libraries powering the app and our APIs. You will work across our runtime, LLM engines, llama.cpp/MLX integrations, build infrastructure, and the future of our on-device AI software. Your work centers on system and library integration: wiring our C++ runtime to GPU backends, vendor SDKs, and operating-system services to support user-facing applications. You will implement and harden system-level code (threading, memory, files, IPC, scheduling) and integrate platform acceleration paths (Metal, CUDA, Vulkan) across macOS, Windows, and Linux. You will profile, debug, and tune the execution paths that make local AI fast and dependable, and our software well architected and maintainable.   RESPONSIBILITIES * Contribute to the C++ runtime that powers LM Studio * Extend our LLM engine integrations and build platform-aware performance features for desktop operating systems. * Implement resilient IPC, resource management, and scheduling logic to support concurrent model execution. * Improve our build, packaging, and release infrastructure for native components. * Collaborate with the rest of the team to deliver cohesive and recognizable user experiences. QUALIFICATIONS * 4+ years building production C++ systems software across macOS or Linux. * Thinks in systems and knows how to reason about performance, reliability, and user experience end-to-end. * Proven maturity designing internal and external APIs that are ergonomic, maintainable, and stable over time. * C++11 (or newer) expertise with RAII as a default mindset and modern language/library proficiency. * Deep knowledge of concurrency, memory management, file systems, and network protocols. * Experience optimizing performance with profilers, tracing, and hardware counters.   BENEFITS * Competitive salary and generous equity grants * Great medical, vision, dental healthcare plans * Catered team lunch / expensed dinners in the office * Flexible PTO * Flexible WFH * Sun drenched office in SoHo in Manhattan, NY * Access to cool powerful hardware of all kinds OUR INTERVIEW PROCESS We are looking for engineering excellence and strong values / cultural fit. If your application appears to be a good match we'll reach out to schedule an initial call. If all goes well, we will proceed to 2-3 technical interviews. The final step in the process is an onsite interview in our New York office, where you will work through several more technical sessions focused around system design and architecture, meet the team and see how we work.

See how well you match this job

Upload your resume and we’ll score your fit for this role and 6 similar roles — then tailor your CV to it with AI. Free, no credit card.

Check your match

Similar jobs

  • Frontend Software Engineer, LM Studio app

    lm-studio

    New York City$185k–$275k
  • Senior Software Engineer, Distributed Systems

    livekit

    Remote$200k–$300k
  • Senior Software Engineer, Database (SmithDB)

    LangChain

    San Francisco, CA
  • System Software Engineer, Consumer Devices

    OpenAI

    San Francisco$293k–$325k
  • Member of Technical Staff, Model Efficiency

    Cohere

    Remote
  • Distributed LLM Inference Engineer

    anyscale

    Remote$170k–$245k
Apply on company site

Want more roles like this? Browse fresh jobs or tailor your resume with AI.

Mirrai Careers

AI-powered career platform: build resumes, match jobs, and plan your career.

Product

  • All Tools
  • Resume Builder
  • Career Test
  • Pricing

Legal

  • Privacy Policy
  • Terms of Service
  • Fair Use Policy

Company

MIRRAI CHAT LTD (Company No. 16403306)

71-75 Shelton Street, Covent Garden

London, WC2H 9JQ, UNITED KINGDOM

[email protected]

© 2026 Mirrai Careers. All rights reserved.