Lead Cloud Data Engineer

Gurugram, Haryana, India
Nov 21, 2024
Nov 21, 2025
Hybrid
Full-Time
12 Years
Job Description

As a Lead Cloud Data Engineer within the Global Risk and Compliance Technology organization, you will drive platform modernization and leverage the latest technologies to meet evolving business needs and global regulatory requirements. This role offers a unique opportunity to lead cutting-edge initiatives while mentoring and guiding a team of engineers.

Key Responsibilities

  • Develop and test software, including ongoing code refactoring, ensuring top-notch quality and structure.
  • Write code, define API specifications, conduct code reviews, and test in Agile sprints or proof of concept development.
  • Employ visualization techniques to accelerate concept realization.
  • Collaborate with Agile teams for user story analysis, software design, testing, and automation tool development.
  • Contribute to specific platforms or adapt as part of a dynamic resource pool for high-priority projects.
  • Drive adoption of innovative technologies to modernize and enhance platforms.
  • Lead and mentor engineering teams, fostering a culture of excellence and collaboration.

Qualifications and Skills

  • 12+ years of experience in cloud data engineering and software engineering.
  • Proficiency in building end-to-end data platforms and services on Google Cloud Platform (GCP).
  • Expertise in GCP tools and technologies, including BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, SQL, Python, Airflow, Pub/Sub, and Spark.
  • Experience with microservices architectures such as Kubernetes, Docker, and Cloud Run.
  • Strong knowledge of batch and real-time streaming infrastructures.
  • Hands-on experience in metadata management, including data catalogs, data lineage, data quality, and observability for big data workflows.
  • Comprehensive understanding of data lakehouse architectures and GCP ecosystem.
  • Advanced skills in data modeling, data architecture, and governance principles.
  • Proficiency in DataOps principles, including test automation.
  • Expertise in observability tooling for data workflows.

Why Join American Express?

We support our colleagues holistically, prioritizing physical, financial, and mental well-being throughout every stage of life.

Benefits Include

  • Competitive base salary and bonus incentives.
  • Retirement and financial well-being support.
  • Comprehensive health benefits, including medical, dental, vision, life insurance, and disability (location-dependent).
  • Paid parental leave policies.
  • Free on-site wellness centers (location-dependent).
  • Confidential counseling through the Healthy Minds program.
  • Ongoing career development and training opportunities.

About American Express

At American Express, we champion equal opportunity, ensuring all employment decisions are free of bias related to race, color, religion, gender, sexual orientation, national origin, veteran status, disability, or age. Employment offers are contingent on successful completion of background checks in accordance with applicable laws and regulations.