Data Engineer
Data Engineer - West Yorkshire (Hybrid)
Harvey Nash has partnered with a market-leading client of ours based in West Yorkshire to recruit an experienced Data Engineer. This role sits within the data team and will play a key part in designing, building, and optimising Azure-based data platforms, enabling the business to make data-driven decisions at scale. You'll work closely with analysts, data scientists, and engineering teams to deliver secure, high-performance, and scalable data solutions.
Key Responsibilities
- Design, develop, and maintain enterprise-level Azure data warehouses, supporting business-critical reporting and analytics.
- Build and optimise ETL/ELT data pipelines using tools such as Azure Data Factory, Databricks, and Azure Synapse.
- Integrate data from multiple sources including internal systems, third-party platforms, and APIs, ensuring data quality and consistency.
- Monitor and optimise performance, scalability, and cost efficiency across Azure data solutions.
- Collaborate with data analysts, data scientists, and wider stakeholders to understand requirements and deliver reliable, high-quality data.
- Implement best practices around data security, governance, and compliance.
- Develop automation scripts and workflows to streamline data ingestion and transformation processes.
- Maintain clear technical documentation covering data architectures, pipelines, and processes.
About You
- Hands-on experience with Azure data services, including Azure Data Factory, Databricks, Azure Synapse, and Azure SQL.
- Good understanding of data warehouse design, including star schema and dimensional modelling.
- Experience working with Azure Data Lake / Blob Storage and cloud-native data architectures.
- Strong proficiency in SQL, with experience designing and optimising data models and queries.
- Proficient in Python, PowerShell, or similar scripting languages for automation.
- Familiarity with CI/CD practices for data pipelines.
- Strong problem-solving skills with the ability to troubleshoot performance and data issues.
- Any experience with Azure cost optimisation, FinOps, or data governance would be beneficial.
Data Engineer - West Yorkshire (Hybrid)