We are looking for an experienced Azure Data Engineer with strong expertise in data engineering, DevOps, and Microsoft Azure technologies. This role will involve designing, implementing, and managing advanced data solutions in Azure, with a focus on optimizing data processing for analytical projects. The ideal candidate has a passion for building scalable data architectures and a solid understanding of cloud security and Azure-based analytics solutions.
Key Responsibilities
- Data Engineering for Analytics. Apply advanced data engineering techniques to support analytical projects, leveraging Microsoft Azure technologies.
- Azure Platform Expertise. Utilize Azure Data Factory (ADF), Azure Synapse, Databricks, and Azure Analysis Services for data processing and analytics.
- Database Management. Work with Azure Tables, SQL Server, and Azure Cache to manage and optimize data storage solutions.
- Cloud Security and Compliance. Implement security best practices using Azure AD and Federated AD, ensuring robust protection with leading Single Sign-On (SSO) solutions.
- Data Architecture & Solution Design. Lead the design and delivery of data architecture, developing requirements analysis and data flow strategy for seamless integration of Azure data solutions.
- Proof of Concept Development. Participate in POCs and pilot solution preparations to validate technical approaches and solution effectiveness.
- Data Preparation for Advanced Analytics. Prepare data for Data Science and Machine Learning (ML) applications, conducting data profiling, cataloging, and mapping to facilitate technical data flows.
- DevOps for Azure Analytics. Integrate DevOps practices into data pipelines, automating workflows to improve efficiency in Azure data operations.
Required Skills and Qualifications
- Experience. 8+ years in Data Engineering, with a significant focus on analytical projects, preferably on Microsoft Azure.
- Technical Proficiency. Expertise in Azure Data Factory, Azure Synapse, Databricks, and Azure Analysis Services. Strong knowledge of SQL Server, PySpark, Spark SQL, and Python.
- Cloud Security. Solid understanding of cloud security principles and hands-on experience with Windows OS and Active Directory integration.
- Analytical Solution Delivery. Proven experience in delivering comprehensive Azure Data Analytics solutions, including architecture design and data flow management.
- DevOps Integration. Experience with DevOps processes and tools for Azure, enhancing the efficiency and reliability of data engineering workflows.
- Data Science Enablement. Familiarity with data preparation for Machine Learning and Data Science, including data profiling and business process mapping.
Additional Skills
- Strong organizational skills and the ability to manage multiple responsibilities.
- Excellent communication and collaboration skills to work with cross-functional teams.
- Analytical mindset with a proactive approach to problem-solving.
If you are a seasoned data engineer with Azure expertise and are excited about shaping data solutions that drive business intelligence and analytics, we’d love to hear from you!