As part of the company’s continued investment in technological advancement, they are looking to bolster their data science and data engineering capabilities. The primary focus of this project is to align data science initiatives with the organization's overall business goals. These goals encompass a wide range of objectives, such as improving customer satisfaction, enhancing operational efficiency, and fostering growth in sales and revenue. The successful candidate will play a critical role in ensuring that these goals are supported by robust, scalable data engineering practices, including DWH development, data modelling, and data pipeline creation.
Responsibilities
- Data Warehousing (DWH) Development. Lead the development and management of the company's Data Warehouse, ensuring it is optimized, scalable, and capable of handling large volumes of data from various sources. You will be responsible for developing efficient ETL processes, managing data integration, and maintaining the integrity of data for further analysis.
- Data Modelling. Design and implement data models that align with the company's business requirements, ensuring that data is structured in a way that is both efficient and easy to access for analytics teams. This will involve translating complex business needs into data solutions that can be utilized for reporting and analysis.
- Requirements Clarification. Work closely with business stakeholders and customers to clarify their requirements and translate them into technical solutions. This will involve gathering, understanding, and translating business needs into actionable insights and defining clear specifications for data solutions.
- Customer Communications. Maintain effective communication with internal teams and customers, ensuring that project deliverables meet business objectives and customer expectations. You'll also be responsible for presenting data-driven insights and project updates to stakeholders, fostering collaborative relationships.
Skills and Qualifications
Must Have
- Data Modelling Expertise. Proven experience in designing and implementing data models, including both conceptual and logical models. A strong understanding of how to structure data to optimize performance and usability is essential.
- Azure Data Lake. Hands-on experience working with Azure Data Lake to manage large data sets in the cloud. Knowledge of best practices for managing data storage, security, and access in the Azure cloud environment is required.
- Azure Data Factory. Experience with Azure Data Factory to design and build data pipelines. You should be proficient in developing, managing, and optimizing ETL workflows to move and transform data across the ecosystem.
- Data Pipeline Development. Strong experience in developing end-to-end data pipelines, ensuring seamless data flow from source to destination systems. This includes building automated data processes, handling data integration, and ensuring data quality.
- Database Management. Expertise in working with relational databases such as Postgres, MySQL, and SQLite. You should be comfortable designing schemas, writing complex queries, and optimizing database performance.
Nice to Have
- Machine Learning. Experience or familiarity with machine learning concepts and techniques. This could include building predictive models, data classification, or working with machine learning frameworks.
- Python. Proficiency in Python for data engineering tasks, such as scripting, automation, and working with libraries like Pandas, NumPy, and scikit-learn for data manipulation and analysis.
Other Requirements
- Language Skills. Proficiency in English at a B2 Upper-Intermediate level is required for clear communication with both technical and non-technical stakeholders.
Why Join Us?
This is a fantastic opportunity for an experienced Senior Data Engineer to work on a high-impact project for one of the UK’s leading rail network companies. You’ll play an essential role in shaping the data infrastructure and analytics capabilities that will drive business success. The role offers significant growth potential, exposure to cutting-edge technologies, and the chance to contribute to a large-scale transformation in the UK’s rail industry.
If you are passionate about data engineering, enjoy solving complex problems, and want to make a real impact on business outcomes, we would love to hear from you. Apply now to be a part of this exciting venture and help shape the future of data-driven decision-making in one of the most important industries in the UK!