Software Development Manager

Software Development Manager – ML Compiler, AWS Neuron, Annapurna Labs Our product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best‑in‑class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best‑in‑class ML training performance with the most teraflops of compute power for ML in the cloud. The Neuron Software Development Kit (SDK) is a cutting‑edge software stack that includes an ML compiler, runtime and natively integrates into popular ML frameworks such as PyTorch, TensorFlow and MxNet. The Neuron SDK optimizes performance of complex neural net models executed on AWS Inferentia and Trainium. The Neuron SDK is used at scale with customers and partners such as PyTorch, Epic Games, Snap, AirBnB, Autodesk, Amazon Alexa, Amazon Rekognition and many other customers across various segments. The Amazon Annapurna Labs team builds innovation in silicon and software for AWS customers. We combine cloud scale with the world’s most talented engineers. Our team covers multiple disciplines including silicon engineering, hardware design and verification, software and operations. We operate in large spaces while keeping squads small and agile. We invent and experiment and work across a range of products and services, creating a unique learning culture. You: As a Manager III on the AWS Neuron team, you will lead a team of compiler engineers through developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium. You will be technically capable, credible and curious, and a trusted AWS Neuron Manager. You will innovate on behalf of our customers, partner with AWS ML services teams, and bring new products, optimizations and features to market. You will have deep knowledge of resource management, scheduling, code generation, optimization, and new instruction architectures including CPU, NPU, GPU and novel compute. Location: Toronto – candidates must be currently located or willing to relocate to Toronto. Key Responsibilities Design, develop, and scale a compiler targeting AWS Inferentia and Trainium, including resource management, scheduling, and code generation. Partner with AWS ML services teams to pre‑silicon design, new product, optimization, and feature roadmap. Lead a team of compiler engineers, manage engineering team management, and mentor engineers. Drive product innovations that deliver high performance, low cost, and ease of use. Basic Qualifications 3+ years of engineering team management experience. 6+ years of working directly within engineering teams experience. 4+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems. Experience partnering with product or program management teams. Excellent software design fundamentals, knowledge of software engineering principles, and deep understanding of compilers (resource management, instruction scheduling, code generation, and compute graph optimization). Preferred Qualifications M.S. or Ph.D. in Computer Science or related technical field. Experience with toolchains (LLVM, GCC) and code generation techniques for new hardware. Knowledge of compiler internals from front end to run‑time environment with emphasis on AI acceleration. Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, please visit for more information. #J-18808-Ljbffr