As a Staff Software Engineer focused on Machine Learning Performance, you will join the TPU Performance team, dedicated to optimizing AI/ML training workloads. Your expertise will drive performance analysis and optimizations across Google’s machine learning fleet, ensuring maximum efficiency in large-scale applications.

Key Responsibilities

• Analyze performance and optimize Large Language Models (LLMs), including Google Deepmind Gemini, Bard, and Search Magi.
• Maintain training and serving benchmarks for LLMs that are representative of Google production and industry standards, identifying performance opportunities.
• Collaborate with Google Product teams to address LLM performance challenges, facilitating efficient onboarding of new models on TPU hardware.
• Explore innovative model and data efficiency techniques to enhance training processes, aiming to reduce the data needed while achieving high accuracy.

Minimum Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience in software development, with a strong foundation in data structures and algorithms.
• 5 years of experience in testing and launching software products, along with 3 years in software design and architecture.
• 5 years of experience with machine learning algorithms and tools (e.g., TensorFlow), artificial intelligence, deep learning, or natural language processing.

Preferred Qualifications

• Experience in performance analysis and optimization, including system architecture and performance modeling.
• Proven ability to work within complex, matrixed organizations and lead cross-functional projects.
• Demonstrated technical leadership, setting direction for project teams and guiding development efforts.
• Experience in distributed development and large-scale data processing.
• Familiarity with compiler optimizations or related fields.

Why Join Google?

• Work with cutting-edge technologies in a collaborative environment that encourages innovation and creativity.
• Access continuous learning and development opportunities to advance your career.
• Be part of a diverse workforce committed to inclusivity and equality.

Google is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We welcome applicants from all backgrounds and ensure equal employment opportunities regardless of race, color, ancestry, religion, sex, sexual orientation, national origin, age, citizenship, marital status, disability, gender identity, or veteran status.

How to Apply. If you are a motivated engineer with a passion for machine learning performance, we encourage you to apply and help shape the future of technology at Google!