As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions that drive our organization's data generation, collection, and processing needs. Your role will involve creating robust data pipelines, ensuring the highest standards of data quality, and implementing ETL (Extract, Transform, Load) processes to facilitate seamless data migration and deployment across various systems. You will be instrumental in optimizing our data infrastructure, enabling efficient data-driven decision-making throughout the organization.

Key Responsibilities

1. Data Pipeline Development. Design and develop scalable data pipelines to efficiently extract, transform, and load (ETL) data from various sources into centralized systems.
2. Data Quality Assurance. Implement data validation and cleansing processes to ensure data integrity and consistency across all platforms.
3. Cross-Functional Collaboration. Work closely with cross-functional teams to gather and understand data requirements, designing data solutions that meet business needs.
4. Infrastructure Optimization. Optimize and fine-tune data infrastructure to enhance performance, scalability, and reliability of data systems.
5. Issue Resolution. Troubleshoot and resolve data-related issues, ensuring minimal disruption to business operations.
6. Industry Awareness. Stay informed about the latest trends and advancements in data engineering, continuously improving your skills and knowledge base.
7. Mentorship. Provide guidance and mentorship to junior data engineers, fostering a culture of learning and development within the team.

Required Professional & Technical Skills

1. Apache Hadoop. Proficiency in Apache Hadoop is a must, with at least 3 years of hands-on experience.
2. Data Processing Frameworks. Experience with data processing frameworks such as Apache Spark and Apache Flink.
3. Big Data Technologies. Strong understanding of distributed computing principles and big data technologies.
4. Databases. Hands-on experience with both SQL and NoSQL databases.
5. Data Modeling. Knowledge of data modeling and database design principles.

Qualifications

1. Education. 15 years of full-time education is required.
2. Experience. A minimum of 3 years of experience working with Apache Hadoop.

Why Join Us?

By joining our team as a Data Engineer, you'll have the opportunity to work on cutting-edge data solutions that impact the entire organization. You'll be part of a collaborative environment where innovation is encouraged, and your contributions are valued. If you're passionate about data engineering and ready to take on a challenging and rewarding role, we encourage you to apply.