The AI Frameworks team at Microsoft is seeking a Senior Software Engineer specializing in GPU performance to work on optimizing and analyzing the performance of machine learning models. This role involves developing software for Microsoft's advanced AI models and collaborating with hardware teams on the Maia-100 AI accelerator and supercomputers.

Key Responsibilities

1. Software Development. Develop and optimize software in C/C++, Python, and GPU languages like CUDA, ROCm, or Triton.
2. Performance Analysis. Analyze and enhance GPU performance for large-scale model training and inference.
3. Collaboration. Engage with partners and ML researchers to optimize performance for state-of-the-art LLMs and other models.
4. Optimization. Work on performance analysis and optimization, including using GPU profiling tools such as NVIDIA Visual Profiler and NVIDIA Nsight Compute.

Qualifications

• Education. Bachelor’s Degree in Computer Science or a related technical discipline.
• 4+ years of technical engineering experience with coding in C, C++, or Python.
• 3+ years of practical experience with GPU applications and performance optimization.
• Experience in writing GPU kernels and optimizing performance beyond existing library kernels.
• Bachelor’s Degree in Computer Science or a related field with 8+ years of technical experience.
• Master’s Degree in Computer Science or related field with 6+ years of technical experience.
• Proficiency in low-level performance analysis and optimization.
• Familiarity with deep learning frameworks such as PyTorch, TensorFlow, or ONNX runtime.
• Cross-team collaboration experience and the ability to work in a research and development environment.

Compensation

• Salary Range. CAD $108,100 - CAD $199,700 per year (base pay). Additional compensation details can be found here.

Additional Information

1. Culture & Values. Microsoft is committed to empowering every person and organization on the planet. They value respect, integrity, and accountability, fostering a culture of inclusion and collaboration.
2. Relocation. Relocation assistance is unavailable for this role.
3. Application Process. Microsoft accepts and processes applications on an ongoing basis. For more information or to apply, visit Microsoft’s careers page.

Equal Opportunity Employer
Microsoft is an equal opportunity employer and considers all qualified applicants without regard to various protected characteristics. For assistance with accommodations during the application process, read more about requesting accommodations here.