New 
Software Engineer II
 Microsoft | |
 United States, Washington, Redmond | |
 Aug 20, 2025 | |
|
OverviewWe are the AI Frameworks team at Microsoft, part of the CoreAI organization, and we are at the forefront of driving innovation in large-scale AI. Our mission is to enable state-of-the-art large language model (LLM) training and inference through deep optimization across the full software and hardware stack. We work across PyTorch, ONNX, and other open AI frameworks, pushing the boundaries of performance, scalability, and efficiency on a wide range of hardware accelerators. This position is part of a highly specialized sub-team focused on building the end-to-end software stack for Microsoft's first-party (1P) AI accelerators. Our work is foundational to Microsoft's long-term AI infrastructure strategy, powering next-generation models and services across Azure and Microsoft products. We collaborate closely with hardware architects, compiler teams, and model experts to co-design software solutions that unlock the full potential of custom silicon. The work is deeply technical and impactful-advancing AI systems used at global scale. If you are passionate about AI systems, low-level performance optimization, and solving hard cross-discipline engineering problems, we invite you to join us and help shape the future of AI at Microsoft.
ResponsibilitiesContribute to the design and development of components in the AI software stack for Microsoft's 1P accelerators.Implement features and optimizations under the guidance of senior engineers.Collaborate with hardware, compiler, and framework teams to enable efficient execution of LLM workloads.Debug issues, analyze performance gaps, and propose targeted improvements.Participate in design discussions, code reviews, and maintain high-quality software practices.Learn and stay up to date on emerging AI frameworks and accelerator technologies. | |