Google software engineers drive the development of next-generation technologies that revolutionize how billions of users connect, explore, and interact globally. This role focuses on optimizing Large Language Models (LLMs) performance, including Google Deepmind Gemini, Bard, Search Magi, and Cloud LLM APIs. 

Minimum Qualifications

• Bachelor's degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages, including proficiency in data structures and algorithms.
• 3 years of experience testing, maintaining, or launching software products, with at least 1 year of experience in software design and architecture.
• 3 years of experience with machine learning algorithms and tools, AI, deep learning, or natural language processing.

Preferred Qualifications

• Master's degree or PhD in Computer Science or a related technical field.
• 1 year of experience in a technical leadership role.
• Experience with performance analysis and optimization, including system architecture, performance modeling, or similar.
• Experience with distributed development and large-scale data processing.
• Experience with compiler optimizations or related fields.

Responsibilities

• Define and maintain benchmarks for LLM training and serving, aligning with Google’s production standards and industry benchmarks.
• Identify performance enhancement opportunities and drive TensorFlow/JAX TPU performance optimizations, influencing TF/JAX releases.
• Collaborate with Google Product teams to address LLM performance challenges, integrating new models onto Google’s latest TPU hardware for efficient large-scale training.
• Analyze performance metrics to pinpoint bottlenecks and implement effective solutions.
• Develop tools with tooling and fleet metrics teams to monitor performance and efficiency metrics across Google's operational workloads.
• Research and implement efficiency techniques for models and data, explore new machine learning architectures, optimizers, and training techniques to advance machine learning capabilities.

Why Join Us?

• Google Cloud empowers organizations worldwide with cutting-edge technology solutions, accelerating digital transformation across industries.
• Join a diverse team of engineers driving innovation in artificial intelligence, machine learning, and large-scale system design.
• Grow professionally in a dynamic environment that encourages versatility, leadership, and problem-solving across the full technology stack.

Equal Opportunity
Google is committed to equal employment opportunity and diversity, fostering an inclusive workplace regardless of race, color, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, Veteran status, or any other characteristic protected by applicable law.