2 of 2 Permanent Data Engineer Jobs in Wakefield

Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources and real … time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience with Spark Streaming … Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions for enterprise clients Principal-Level More ❯

Senior Data Engineer 6 Month initial contract Hybrid role (up to 3 times a week in London) Start ASAP £500 - £540 per day Inside IR35 Azure/Python/SQL/ELT experience *Please note that this role requires security clearance due to the nature of the project Essential Skills & Experience 10+ years' experience in Data Engineering … years of hands-on Azure Databricks experience delivering production-grade solutions. Strong programming proficiency in Python and Spark (PySpark) or Scala, with the ability to build scalable and efficient data processing applications. Advanced understanding of data warehousing concepts, including dimensional modelling, ETL/ELT patterns, and modern data integration architectures. Extensive experience working with Azure data services, particularly Azure Data Factory, Azure Blob Storage, Azure SQL Database, and related components within the Azure ecosystem. Demonstrable experience designing, developing, and maintaining large-scale datasets and complex data pipelines in cloud environments. Proven capability in data architecture design, including the development and optimisation of end-to-end data pipelines for performance, reliability, and More ❯