We are seeking highly skilled and motivated data engineers to join our dynamic team supporting a leading banking client. This opportunity is ideal for professionals who excel in ETL development, quality engineering, and data pipeline management within an Informatica Intelligent Cloud Services (IICS) environment.
Roles and Expectations
Lead Data Engineer
- 7+ years of experience in data engineering, with at least 2 years in a leadership or mentoring role.
- Proven expertise in leading teams, managing deliverables, and ensuring quality standards.
Mid-Level Data Engineer
- 3-5 years of experience in data engineering.
- Hands-on expertise in ETL development, data quality assurance, and collaborating within cross-functional teams.
Technology Stack Required
- Programming Languages. Python
- Cloud Data Warehouse. Snowflake
- ETL Tools. Informatica Intelligent Cloud Services (IICS)
Key Responsibilities
ETL Development Responsibilities
- Perform comprehensive analysis and create detailed design and mapping documentation for ETL workflows.
- Reverse engineer existing ETL code for optimization and understanding.
- Design, build, and execute unit tests for ETL components.
- Conduct thorough QA testing for ETL processes to ensure accuracy and reliability.
- Provide UAT support, execute performance testing, and regression testing to identify and resolve issues.
- Handle pre-production deployments, smoke tests, and ensure seamless production rollouts.
- Provide warranty or hyper-care support and deliver knowledge transfer (KT) sessions.
ETL Data Quality and Control Responsibilities
- Analyze data across multiple layers, including LNDG, CL, and DL.
- Configure and execute data quality and control checks to maintain data integrity.
- Review generated reports and validate findings for anomalies.
- Enhance report formats for ease of use and timely resolution of identified issues.
- Deploy and validate data quality rules across all regions, ensuring production readiness.
Requirements and Design Responsibilities
- Develop and maintain a detailed delivery plan aligned with program timelines.
- Conduct in-depth analysis and create structured transformation logic and design documentation.
- Reverse engineer existing workflows where necessary.
- Develop an automation test strategy and detailed test plans.
- Maintain comprehensive documentation, including lineage, code inventory, and data model definitions.
- Obtain design review sign-offs for smooth project progression.
Build Responsibilities
- Develop high-level and low-level design documents with comprehensive load strategies, error handling mechanisms, and exception management.
- Build ETL code, database scripts (DDL/DML), ESP & Unix scripts, and other required pipeline components.
- Execute tests and capture evidence to meet defined acceptance criteria.
- Conduct regression testing, identify defects, and implement fixes promptly.
- Provide demo sessions for production support teams to ensure smooth handoffs.
- Peer review and manage code versions, ensuring compliance with industry standards and client-specific requirements.
- Implement CI/CD pipelines for efficient migrations and deployments.
Deliverables
- Detailed Design Documents (High-level and Low-level)
- ETL Code and Deployment Scripts
- Test Case Documentation with Evidence
- Code Review and Sign-off Documents
- Implementation Plans and Run Books
- Regression Test Reports and Status Updates
Benefits Package
- Medical, dental, and vision insurance (effective from the 31st day of employment).
- Health Savings Account (HSA), Flexible Spending Account (FSA), and Dependent Care FSA (DCFSA) options.
- Access to a 401k retirement plan with employer matching.
- Paid sick leave and other paid time off as per applicable laws.
Ideal Candidate Profile
- Strong expertise in Python programming for data processing and analysis.
- In-depth knowledge of Snowflake for cloud-based data warehousing solutions.
- Extensive hands-on experience with Informatica Intelligent Cloud Services (IICS).
- Excellent analytical, problem-solving, and communication skills.
- Proven ability to work independently and collaboratively in a fast-paced environment.
This role offers a unique opportunity to work on cutting-edge technologies in the financial domain while contributing to a highly impactful data-driven project. If you are passionate about data engineering and quality assurance, apply today to join our team and make a difference!