3 of 3 Spark Streaming Jobs in London

improve collaboration and delivery.What We’re Looking ForStrong proficiency in Python, Scala, or Java with hands-on experience in Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks.Practical experience building real-time event streaming pipelines using technologies such as Kafka, Spark Streaming … client environments.Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets.Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation.Knowledge of automating cloud-based ingestion and transformation frameworks.Experience delivering data engineering solutions within highly regulated industries such ...

time insight into live positions and risk. This platform underpins critical trading decisions and represents a major step forward in scalability, resilience, and streaming architecture across our technology estate. Responsibilities Design and build distributed, real‐time streaming components within a Flink‐based architecture. Develop and maintain … detects and publishes meaningful changes in liability. Ensure correctness in a high‐throughput environment through robust handling of ordering, duplication, and idempotency. Optimise streaming jobs for latency, throughput, and resource efficiency. Collaborate closely with trading and product teams to translate domain requirements into scalable, reliable systems. Contribute ...

that are measurable and tied to business outcomesBuild — Design and validate solutions on both the customer side and the Treasure AI product sideDesign streaming architectures that handle real-world complexity: late-arriving events, schema drift, backpressure, partial failures, and sub-second SLA requirementsDrive technical decisions with clear rationale … software or data engineering experience, with at least 2 years in a customer-facing, embedded, or solutions engineering capacityStrong hands-on experience with streaming and event-driven architectures — Kafka, Flink, Kinesis, Spark Streaming, or equivalent (DynamoDB and MemoryDB/Redis)AWS Cloud Fluency - understand ...