Mirrai Careers
Resume BuilderCareer Test
InsightsPricing
Get Started Free
Jobs/Inference Performance & Deployment - Member of Technical Staff

Inference Performance & Deployment - Member of Technical Staff

callosum

London Full-time£101k–£192k / year Posted 4w ago
Apply on company site
About Us The last era of AI scaled on a single bet: bigger models, more identical chips, more data. As problems grow more complex and the requirements of intelligence more diverse, that bet is breaking down. Real-world problems are heterogeneous: no single model or chip can solve them alone. The next era of AI requires heterogeneity at the infrastructure level - diverse models on diverse chips, each with distinct strengths, co-evolving into systems of capability that move the Pareto frontier of what is possible. That's what we are building. Callosum is the Intelligent Systems Company. We started from questioning what actually creates intelligence. We believe there is no single answer, but rather a system-level solution. We co-evolve models, workflows, and silicon together to show that intelligence does not come from a single component, but it emerges from the diversity of co-optimised mechanisms working together and aware of each other. Heterogeneity will define the next era of compute, and is a principle that holds in biological, neuronal, and economic systems alike. In early 2026 we launched with results showing orders of magnitude improvements in performance, and this is only the beginning. Agentic AI is the future of how intelligence is deployed: multi-step, long-horizon, and operating in changing environments. These systems are inherently heterogeneous, and can only be as powerful as the infrastructure that runs them. We are engineers and scientists based in London, working together across the full depth of the stack. We are curious, intellectually honest, and building what doesn't exist yet. If you thrive on uncharted territory and are energised by the scale of the challenge, we'd love to hear from you.   About the Role Callosum believes that orders of magnitude improvements in AI systems will come through application-aware orchestration across heterogeneous hardware. We are building that vision: infrastructure that treats the full landscape of compute as a unified, co-evolving system, evolved beyond GPUs. This role owns the bridge between Callosum's internal engineering and the real world. You design the tooling and methodologies that ground our technology in real-world performance and behaviour, sitting at the integration point of every engineering function. You will be the first to run our heterogeneous infrastructure in production-equivalent conditions, systematically characterising performance, identifying bottlenecks, and driving decisions on production-readiness. Your work ensures that every layer of the stack is guided by empirical evidence rather than assumption. What You’ll Build * Run experiments self-hosting models on cloud instances or on-prem across providers and hardware configurations, systematically characterising performance envelopes * Develop and maintain deployment patterns that are reproducible, measurable, and optimised for latency, throughput, and cost * Work at the orchestration and routing software that sits above the inference engine - to improve caching, request scheduling, batching, and resource allocation * Act as the integration point for the other roles: consume new accelerator support, engine features, and infrastructure upgrades – to provide high-quality feedback on bottlenecks, essential capabilities, and guide the stack optimisations * Build and maintain benchmarking harnesses, regression suites, and performance dashboards that give the team a shared view of system health and progress What Sets You Apart * Experience deploying and benchmarking large model inference in production or production-equivalent environments * Familiarity with multi-node GPU deployments and associated networking/communication stacks * Strong end-to-end performance characterisation skills: able to isolate whether a bottleneck is in the network, the runtime, the memory subsystem, or the model itself * Familiarity with serving frameworks like Dynamo, Triton Inference Server, or similar orchestration layers * Clear communication skills - able to translate performance data into actionable, prioritised feedback for the teams building the underlying systems * A demonstrable disciplined and systematic approach to deployment: reproducibility, measurement methodology, controlled comparisons, etc What We Offer * Competitive Salary, determined by skills and experience * Equity & Ownership * Private healthcare * We offer Visa sponsorship and relocation benefits to hire the best in the world * We work in person at our London office. You'll have the tools, space and setup to do your best work, and if you have specific needs, just tell us We're committed to building an inclusive workplace where everyone feels welcome, and believe in equal opportunities for all.

See how well you match this job

Upload your resume and we’ll score your fit for this role and 6 similar roles — then tailor your CV to it with AI. Free, no credit card.

Check your match

Similar jobs

  • Inference System & Performance Engineer - Member of Technical Staff

    callosum

    London£101k–£192k
  • Inference Engine Development - Member of Technical Staff

    callosum

    London£101k–£192k
  • Member of Technical Staff, Training Performance Engineer

    Cohere

    Remote
  • Member of Technical Staff, Post-Training

    Cohere

    Remote
  • Principal Machine Learning Infrastructure Engineer

    PhysicsX

    London, United Kingdom
  • Lead Software Engineer (Inference Platform), London

    Isomorphic Labs

    London
Apply on company site

Want more roles like this? Browse fresh jobs or tailor your resume with AI.

Mirrai Careers

AI-powered career platform: build resumes, match jobs, and plan your career.

Product

  • All Tools
  • Resume Builder
  • Career Test
  • Pricing

Legal

  • Privacy Policy
  • Terms of Service
  • Fair Use Policy

Company

MIRRAI CHAT LTD (Company No. 16403306)

71-75 Shelton Street, Covent Garden

London, WC2H 9JQ, UNITED KINGDOM

[email protected]

© 2026 Mirrai Careers. All rights reserved.