Machine Learning Engineer II

Microsoft • Redmond, WA

15h

About The Position

Microsoft is pioneering the future of collaborative intelligence through AI-native agents that transform how people work together (e.g., through Microsoft Teams). As part of our applied research initiative, we are reimagining the foundations of teamwork—making collaboration more intuitive, productive, and adaptive across diverse modalities and contexts. We are seeking a Machine Learning Engineer II with deep expertise in large-scale model deployment, production-grade systems, and engineering excellence.
As a Machine Learning Engineer II, you will work alongside leading scientists to build and optimize infrastructure for frontier models—including large language models (LLM), small language models (SLM), and multimodal systems—leveraging both proprietary and open-source frameworks. Your responsibilities will span the full engineering lifecycle: from model training and serving to monitoring and continuous deployment, with a focus on reliability, performance, and scalability in real-world environments.
We value startup-style efficiency and practical problem-solving. We are seeking a curious, adaptable problem-solver who thrives on continuous learning, embraces changing priorities, and is motivated by creating meaningful impact. Candidates must be self-driven, able to write production-grade code and debug complex distributed systems, understand how to best leverage extensive graphics processing unit (GPU) resources, document engineering decisions, and demonstrate a track record in shipping ML systems at scale. The ability to quickly translate ideas into working code for rapid experimentation is a plus. You may include information about any individual who can serve as your referral in your application.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with building ML infra and deploying ML models for scaled production services (including in research settings) and coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice To Haves

• Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• 3+ years experience with Python and relevant ML libraries (e.g., PyTorch).
• 3+ years experience with building ML infrastructure and developing and deploying ML models.
• 3+ years experience in coding and design, specifically in the development of AI models for scaled production services.
• 3+ years experience in shipping applied research to production, highlighting a track record of combining coding skills with advanced expertise in AI model development.
• Publication record in the areas of Large Language Models, Machine Learning, or Natural Language Processing.

Responsibilities

• Research and develop an understanding of the state-of-the-art tools, technologies, and methods being used in the research community and product groups.
• Advance research agenda through one or more projects, yielding new algorithms, prototypes, theories, tools, methods, or collections of data.
• Drive the team's strategic vision and align it with the overall company objectives.
• Collaborate with stakeholders to define project goals, success criteria, and deliverables.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level