We are seeking an experienced Senior Data Engineer with a strong background in Java and Spark to join our dynamic team. The ideal candidate will have expertise in designing and developing big data platforms, with hands-on experience in modern data processing technologies and agile development methodologies. This role offers an exciting opportunity to work with cutting-edge technologies and contribute to innovative projects in the data engineering space.

Key Responsibilities

1. Big Data Platform Development. Design, develop, and maintain large-scale data processing systems using Spark, Java, and Scala. Leverage modern data processing technology stacks including HBase, Hive, and other Hadoop ecosystem technologies.
2. Streaming Data Architectures. Build and optimize streaming data architectures to enable real-time and low-latency data processing.
3. Agile Practices. Apply agile development methods and principles to deliver high-quality solutions efficiently. Contribute to the agile development process and practices within the team.
4. Continuous Integration/Delivery. Implement and manage Continuous Integration/Delivery (CI/CD) pipelines to streamline development and deployment processes.
5. NoSQL Technologies. Work with various NoSQL technologies including column family, graph, document, and key-value data storage solutions. Experience with these technologies is a plus.
6. Software Craftsmanship. Demonstrate a passion for software craftsmanship, focusing on clean, maintainable code and best development practices.
7. Financial Industry Experience. Experience in the financial industry is advantageous, as it provides a valuable context for understanding complex data requirements and solutions.

Key Requirements

1. Technical Expertise. Proven experience in Java and Spark. Hands-on experience with Scala and big data platform design and development.
2. Data Processing Technologies. Deep understanding of modern data processing technologies, including Spark, HBase, Hive, and other components of the Hadoop ecosystem.
3. Streaming Data. Strong knowledge of streaming data architectures and technologies for real-time data processing.
4. Agile Development. Familiarity with agile development methods, including core values, guiding principles, and key practices.
5. CI/CD. Experience with Continuous Integration and Delivery practices and tools.
6. NoSQL Experience. Familiarity with NoSQL technologies, such as column family, graph, document, and key-value data storage.
7. Passion for Craftsmanship. A commitment to software craftsmanship and quality.
8. Industry Experience. Experience in the financial industry is a plus.

If you are passionate about working with big data technologies and thrive in a fast-paced, agile environment, we encourage you to apply and join our team of innovators and experts.