Engineering Manager, Inference Routing and Performance

The Inference Routing team at Anthropic owns the cluster-level routing and coordination plane for the inference fleet — the system that sits between the API surface and the inference engines, making fleet-wide efficiency decisions in real time. As EM you'll drive system-level performance, deliver reliably, and build and grow a team of distributed-systems engineers. Salary not listed in source.

You May Be a Good Fit If You • Have 5+ years of engineering management experience leading critical-path production infrastructure at scale • Have a deep systems background — load balancing, scheduling, cache-coherent distributed state, high-performance networking • Have shipped performance improvements in large-scale systems and can explain, with numbers, what the impact was • Have run production infrastructure with real operational stakes: on-call, incident response, capacity events • Are results-oriented with a bias toward impact • Build strong relationships across team boundaries • Are curious about machine learning systems