Engineering Manager, Serving/API

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an Engineering Manager, Serving/API based in United States.

This is a technical leadership role overseeing the software layer that connects customer API requests to production AI inference. You will lead and grow an engineering team responsible for API serving, tokenization, structured generation, reasoning, speculative decoding, and emerging model capabilities.

The role combines deep systems thinking with people leadership, product accountability, and cross-functional execution. You will shape the technical roadmap while ensuring API compatibility, correctness, latency, reliability, and scalable model integration. You will collaborate closely with compiler, accelerator, production platform, hardware, and customer-facing teams in a rapidly evolving environment.

As the model catalog and customer base expand, you will help establish durable ownership structures and engineering practices that can scale with the organization. This is an opportunity to directly influence both the technology and team responsible for delivering high-performance AI inference services to customers.