Machine Learning Engineer II - Azure GenAI

Bengaluru, Karnataka, India
Jan 21, 2025
Jan 21, 2026
Onsite
Full-Time
2 Years
Job Description

Are you passionate about advancing the frontiers of large language model technologies? Join our team at Azure GenAI, where we are at the forefront of developing cutting-edge solutions that power the Azure AI Platform. Collaborating deeply with OpenAI and numerous Microsoft product teams—including GitHub and Office—we aim to deliver groundbreaking AI services for internal and external applications.

As part of our mission, we are seeking a Machine Learning Engineer II who is driven, innovative, and analytical. This role focuses on adapting and grounding large language models for product-centric scenarios. You will contribute to enhancing the custom copilot experience by leveraging advanced deep learning techniques, including supervised fine-tuning and post-training through Reinforcement Learning from Human Feedback (RLHF).

Microsoft’s vision is to empower every person and organization on the planet to achieve more. We are committed to fostering a growth mindset and creating an inclusive environment where every employee can excel. Join us to help shape the future of AI and make a lasting impact on the world.

Key Responsibilities

  1. Model Customization and Training

    • Develop methods for OpenAI model customization and large-scale training.

    • Execute data preparation, training, and evaluation of model customization tasks to ensure optimal performance.

  2. Engineering Systems and Scalability. Design and implement scalable engineering systems to support enterprise readiness and large-scale deployments.
  3. Cross-Functional Collaboration. Work closely with product groups across Microsoft to understand requirements and deliver tailored AI solutions.
  4. Innovation in Large Language Models. Explore and apply state-of-the-art techniques in supervised fine-tuning, RLHF, and other advanced adaptation methods.

Qualifications

Required Qualifications

  1. Education. Bachelor’s Degree in Computer Science, Electrical or Computer Engineering, or a related field.
  2. Experience. At least 2 years of professional experience in areas such as statistics, predictive analytics, or research.

Technical Skills

  • Strong understanding of machine learning concepts and large model training.
  • Proficiency in programming languages such as Python or similar.
  • Cloud and Infrastructure. Solid grasp of modern cloud-native infrastructure, distributed systems, and frameworks.

Preferred/Additional Qualifications

  • Extensive experience with large language models and related technologies.
  • Publications in top-tier conferences focusing on large language models and AI advancements.
  • Familiarity with tools like Triton and CUDA.
  • Expertise in handling and processing large datasets.
  • Strong ability to work collaboratively within a team and communicate complex concepts effectively.

Why Join Us?

  1. Innovative Projects. Be at the forefront of large language model technology development and work on groundbreaking solutions for real-world applications.
  2. Collaborative Environment. Engage with industry leaders and experts from OpenAI and Microsoft’s diverse product teams to drive impactful innovation.
  3. Professional Growth. Enhance your skills through challenging projects and opportunities to publish your work in prestigious forums.
  4. Inclusive Culture. Thrive in an environment that values diversity, fosters a growth mindset, and encourages every employee to bring their best self to work.

About Microsoft

Microsoft is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Qualified applicants will receive consideration for employment regardless of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws.

If you require a reasonable accommodation during the application or recruitment process due to a disability, please submit a request via the Accommodation Request Form.

Benefits and Perks

  • Health and wellness programs.
  • Learning and development opportunities.
  • Generous time-off policies.
  • Financial security programs.

Security and Compliance

This role requires meeting Microsoft, customer, and government security screening requirements, which may include a Microsoft Cloud background check upon hire/transfer and biennially thereafter.

Join us and make a difference in the ever-evolving world of artificial intelligence. Help us create solutions that empower individuals and organizations worldwide to achieve more.