Permanent Spark Streaming Jobs in the UK

9 of 9 Permanent Spark Streaming Jobs in the UK

Kafka Architect

Leeds, England, United Kingdom
PURVIEW
Kafka clusters to ensure high availability and scalability. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam. Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs. … Required Skills Experience : Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks. Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam. Experience with cloud platform such as GCP Pub/Sub. Excellent problem-solving skills. Knowledge & Experience More ❯
Posted:

Kafka Architect

bradford, yorkshire and the humber, United Kingdom
PURVIEW
Kafka clusters to ensure high availability and scalability. Integrating Kafka with other data processing tools and platforms such as Kafka Streams, Kafka Connect, Spark Streaming Schema Registry, Flink and Beam. Collaborating with cross-functional teams to understand data requirements and design solutions that meet business needs. … Required Skills Experience : Extensive Experience with Apache Kafka and real-time architecture including event driven frameworks. Strong Knowledge of Kafka Streams, Kafka Connect, Spark Streaming, Schema Registry, Flink and Beam. Experience with cloud platform such as GCP Pub/Sub. Excellent problem-solving skills. Knowledge & Experience More ❯
Posted:

Developer

Abingdon-On-Thames, England, United Kingdom
Conrad Energy
internal RESTful and event-driven APIs. Establish best practices for versioning, documentation, security, and monitoring. Real-Time Data Architecture Build and manage data streaming pipelines using frameworks such as Spark, Kafka, or equivalents. Ensure high-availability and low-latency delivery of market and industry data. Azure … development role, with a proficiency in Python; comfortable working with other languages (e.g. C#, JavaScript) Hands-on experience building and operating real-time streaming solutions (e.g., Spark Streaming, Kafka, Event-Hub) Thorough understanding of Azure services (Functions, App Services, AKS). Proven design and More ❯
Posted:

Developer

oxford district, south east england, United Kingdom
Conrad Energy
internal RESTful and event-driven APIs. Establish best practices for versioning, documentation, security, and monitoring. Real-Time Data Architecture Build and manage data streaming pipelines using frameworks such as Spark, Kafka, or equivalents. Ensure high-availability and low-latency delivery of market and industry data. Azure … development role, with a proficiency in Python; comfortable working with other languages (e.g. C#, JavaScript) Hands-on experience building and operating real-time streaming solutions (e.g., Spark Streaming, Kafka, Event-Hub) Thorough understanding of Azure services (Functions, App Services, AKS). Proven design and More ❯
Posted:

Lead Data Engineer

London Area, United Kingdom
TogetherWeTech
infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data ingestion and storage. More ❯
Posted:

Lead Data Engineer

london, south east england, United Kingdom
TogetherWeTech
infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data ingestion and storage. More ❯
Posted:

Lead Data Engineer

slough, south east england, United Kingdom
TogetherWeTech
infrastructure. Build efficient data models for real-time analytics. Proven experience in managing real-time data pipelines across multiple initiatives. Expertise in distributed streaming platforms (Kafka, Spark Streaming, Flink). Experience with GCP (preferred), AWS, or Azure for real-time data ingestion and storage. More ❯
Posted:

DevOps Lead

bradford, yorkshire and the humber, United Kingdom
Pyramid Consulting, Inc
a proactive approach to addressing business data needs and ensuring optimal system performance. Key Responsibilities: Design & Architecture: Architect and design scalable, real-time streaming systems using Apache Kafka, ensuring they are robust, highly available, and meet business requirements for data ingestion, processing, and real-time analytics. Kafka Cluster … troubleshoot issues to maintain smooth operations. Integration & Data Processing: Integrate Kafka with key data processing tools and platforms, including Kafka Streams , Kafka Connect , Apache Spark Streaming , Apache Flink , Apache Beam , and Schema Registry . This integration will facilitate data stream processing, event-driven architectures, and continuous More ❯
Posted:

DevOps Lead

leeds, west yorkshire, yorkshire and the humber, United Kingdom
Pyramid Consulting, Inc
a proactive approach to addressing business data needs and ensuring optimal system performance. Key Responsibilities: Design & Architecture: Architect and design scalable, real-time streaming systems using Apache Kafka, ensuring they are robust, highly available, and meet business requirements for data ingestion, processing, and real-time analytics. Kafka Cluster … troubleshoot issues to maintain smooth operations. Integration & Data Processing: Integrate Kafka with key data processing tools and platforms, including Kafka Streams , Kafka Connect , Apache Spark Streaming , Apache Flink , Apache Beam , and Schema Registry . This integration will facilitate data stream processing, event-driven architectures, and continuous More ❯
Posted:
Spark Streaming
10th Percentile
£49,250
25th Percentile
£76,250
Median
£92,500
75th Percentile
£93,750