Senior Data Engineer

Principal Data Engineer – Outside IR35 – Fully Remote (UK ONLY) – Databricks Expertise

A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We’re seeking a Principal Data Engineer with deep expertise in Databricks, particularly around streaming data sources and real-time telemetry.

Project Overview

This role is part of a strategic initiative to modernise data infrastructure across the rail network. You’ll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making.

Key Skills Required

• Extensive experience with Databricks, especially in streaming data pipelines
• Strong understanding of real-time telemetry data
• Solid background in Azure cloud services
• Proven ability to work with large-scale, fast-moving datasets in production environments
• Consultancy background with experience delivering complex data solutions for enterprise clients

Principal-Level Responsibilities

As a Principal Data Engineer, you will:

• Define and lead data architecture for real-time streaming solutions
• Shape and implement data strategy aligned with business objectives
• Influence and engage senior stakeholders, providing thought leadership on data-driven decision-making
• Mentor and guide engineering teams, ensuring best practices and technical excellence
• Drive innovation in data engineering frameworks and processes

Why Apply?

• Work on a high-visibility transport project with real-world impact
• Lead cutting-edge data engineering practices at scale
• Collaborate with a forward-thinking consultancy and a major transport group
• Opportunity to shape the future of rail data systems

Apply now online for more details.