Job Description

AI is the strategic bet for Microsoft. The Azure AI Platform is right at the front end. Our project involves cutting edge technologies and problems. Joining the projects you will gain knowledge and experience about generative AI, large language model, transformers, GPU optimization, AI applications, etc. The AI business is also growing rapidly, and our products will directly face the impact of the large number of customers, which is continuously growing.Within the AI Platform, the Azure ML team enables data scientists and developers to build quickly and easily, train, deploy, manage, and consume machine learning models.The Models as a Service team is hiring Principal Software Engineer. The team designs, builds, and operates the largest scale engineering system in the industry for Large Language Models and GenAI Models. Key areas that we are working on

• Building and Scaling our Inferencing Cloud across our flagships AOAI Service and growing the Model as A Service model Families
• Expand the Gen AI Model Offerings to more model providers, to the best and latest offerings
• To provide a unified experience across AOAI and MAAS/MAAP for Azure AI customers

Responsibilities:

• Work closely with US teams to align priorities, lead the team to effectively collaborate with appropriate stakeholders
• Collaborate with key stakeholders to comprehend and identify user requirements, scope solutions, estimate work, and schedule deliverables
• Lead discussions on the architecture of products or solutions and apply engineering principles to establish robust and maintainable architecture and designs
• Manage and drive feature execution with high quality and great agility
• Lead by example by producing extensible and maintainable code, adhering to best engineering practices, raising the quality bar, and improving the team's response to customer incidents
• Lead the team to respond, resolve, and integrate customer feedback with agility and dedication
• Mentor and grow junior dev

Qualifications:Required:

• Bachelors degree in computer science or related technical discipline, AND

• 10+ years of technical engineering experience with coding in languages including, but not limited to C, C++, C#, Java, JavaScript, or Python or equivalent experience.

Preferred:

• Experience on python, pytorch, large language model, generative AI

• Experience with distributed systems design and implementation

• Experience in building large scale platforms and passion for the same

• Proficiency in Agile development practices and Continuous Integration/Continuous Deployment (CI/CD)

• Passion for machine learning, artificial intelligence, and data science

• Experience working on large-scale projects or applications

• Effective communication skills and ability to collaborate with diverse remote teams

• Quick learner with a passion for solving complex and exciting problems

• Familiarity with Azure is a plus

#IDCAIPlatformHiringThis position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the .Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Microsoft