Spark Streaming Jobs in the UK excluding London

1 to 25 of 52 Spark Streaming Jobs in the UK excluding London

Principal Data Engineer

Coventry, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Midlands, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Southampton, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Cardiff, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Sheffield, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Nottingham, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Glasgow, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Leeds, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Birmingham, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Bristol, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Manchester, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Aberdeen, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Swindon, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Woking, Surrey, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Shrewsbury, Shropshire, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Dartford, Kent, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Stevenage, Hertfordshire, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Northampton, Northamptonshire, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Norwich, Norfolk, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Maidstone, Kent, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Luton, Bedfordshire, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Cambridge, Cambridgeshire, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Reading, Berkshire, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Bournemouth, Dorset, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted:

Principal Data Engineer

Basildon, Essex, UK
Hybrid/Remote Options
ScaleOps Search Ltd
Principal Data Engineer, Outside IR35, Fully Remote (UK ONLY) – Databricks & Streaming Expertise A leading consultancy is partnering with a major transport operator on a high-impact rail infrastructure programme. We're seeking a Principal Data Engineer with deep expertise in Databricks, Spark Streaming, and Azure data services, particularly around streaming data sources … and real-time telemetry. Project Overview This role is part of a strategic initiative to modernise data infrastructure across the rail network. You'll architect and optimise streaming data solutions that deliver operational insights and enable real-time decision-making. Key Skills Required Extensive experience with Databricks, especially in streaming data pipelines Strong hands-on experience … with Spark Streaming Solid background in Azure data services, including: Azure Synapse Azure Data Factory (ADF) Databricks Proven ability to work with streaming data sources and real-time telemetry Ideally some experience with Scala Ability to work with large-scale, fast-moving datasets in production environments Consultancy background with experience delivering complex data solutions More ❯
Employment Type: Full-time
Posted: