10 of 10 Spark Streaming Jobs in the UK

product, and ML teams. Treat trust, correctness, and predictability as first-class features of the platform. Develop end-to-end ingestion pipelines (batch & streaming): Build and operate reliable batch and streaming ingestion pipelines that support both real-time and analytical use cases. Contribute to defining clear … equivalent) and modern DevOps practices. Hands-on experience designing and implementing real-time and batch data processing pipelines using modern frameworks like Spark, Flink, Spark Streaming, Kafka, Debezium, etc. Experience with orchestration tools such as Airflow, dbt, or similar. Exceptional problem-solving skills paired ...

team. What We’re Looking For Proficient in one of Python, Scala or Java with strong experience in Big Data technologies such as: Spark, Hadoop etc. Practical knowledge of building real-time event streaming pipelines (e.g., Kafka, Spark Streaming, Kinesis). Proficiency … Points For Expertise in Data Modelling, schema design, and handling both structured and semi-structured data. Familiarity with distributed systems such as Hadoop, Spark, HDFS, Hive, Databricks. Exposure to AWS Lake Formation and automation of ingestion and transformation layers. Background in delivering solutions for highly regulated industries. Passion ...

solutions that support services used across the organisation. Working with cloud‐native technologies, distributed systems and event‐driven architectures, you will help improve streaming capabilities used by a wide range of teams and business areas. This is an opportunity for you to apply your technical skills at scale … event‐driven architecture practices and Confluent Platform technologies, including Kafka Connect, Schema Registry, Cluster Linking and ksqlDB, to deliver reliable, scalable and efficient streaming solutions. Developing secure and automated platform capabilities using Infrastructure as Code, Kubernetes and CI/CD tooling, alongside performance optimisation, capacity planning and Kafka ...

real-time infrastructure that powers decision-making across one of the world's largest digital asset exchanges. We operate at the intersection of streaming data, large-scale platform engineering, and AI-driven automation — processing billions of events daily across trading, compliance, and product systems. This role leads … team responsible for Kraken's streaming and data platform layer — designing systems that move, transform, and serve data in real time. You'll own the architecture around stream processing (RisingWave, Flink), drive adoption of AI-powered automation and workflows across the data stack, and build the platform primitives ...

time insight into live positions and risk. This platform underpins critical trading decisions and represents a major step forward in scalability, resilience, and streaming architecture across our technology estate. Responsibilities Design and build distributed, real‐time streaming components within a Flink‐based architecture. Develop and maintain … detects and publishes meaningful changes in liability. Ensure correctness in a high‐throughput environment through robust handling of ordering, duplication, and idempotency. Optimise streaming jobs for latency, throughput, and resource efficiency. Collaborate closely with trading and product teams to translate domain requirements into scalable, reliable systems. Contribute ...

security threats, actors and their techniques * Experience with data science, big data analytics technology stack, analytic development for endpoint and network security, and streaming technologies (e.g., Kafka, Spark Streaming, and Kinesis). Amazon is an equal opportunities employer. We believe passionately that employing ...

that are measurable and tied to business outcomesBuild — Design and validate solutions on both the customer side and the Treasure AI product sideDesign streaming architectures that handle real-world complexity: late-arriving events, schema drift, backpressure, partial failures, and sub-second SLA requirementsDrive technical decisions with clear rationale … software or data engineering experience, with at least 2 years in a customer-facing, embedded, or solutions engineering capacityStrong hands-on experience with streaming and event-driven architectures — Kafka, Flink, Kinesis, Spark Streaming, or equivalent (DynamoDB and MemoryDB/Redis)AWS Cloud Fluency - understand ...

senior authority for low-latency market data, ticker plants, market microstructure analytics, L1/L2/L3 data, time-series platforms, streaming architectures, and real-time data consumption across Front Office, Quantitative Analytics, Risk, Commercial Operations, and Trading Technology. The role holder will work closely with trading desks … Office, Quants, execution teams, and risk stakeholders to improve insight into liquidity dynamics, market behaviour, execution quality, and trading performance. Time-Series Platforms, Streaming Architecture & Engineering: Act as the technical authority for enterprise time-series platforms, tick-data analytics, streaming architectures, ticker plants, and low-latency ...

Networks training.**Nice-to-Have Qualifications*** Experience with telecom digital twin platforms.* Experience with vector databases, embeddings, semantic search, or RAG.* Experience with streaming data platforms such as Kafka, Pub/Sub, Flink, or Spark Streaming.* Experience supporting closed-loop automation, predictive assurance, or self-healing ...

Drive – the operating manual for how we behave. Join us as a Kafka Platform Engineer To help develop and enhance the enterprise streaming platforms that enable secure, reliable and real-time data movement across Barclays. This role supports the delivery of scalable, resilient and secure platform solutions that … enterprise scale, helping to improve platform reliability, security and automation. This is an opportunity to help shape the future direction of strategic streaming capabilities while contributing to solutions that deliver meaningful business impact. Essential skills Designing, implementing and operating enterprise-scale Confluent Kafka platforms supporting business-critical workloads. ...