6 of 6 Spark Streaming Jobs in London

collaboration and delivery. What We're Looking ForStrong proficiency in Python, Scala, or Java, with hands-on experience of Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Experience building real-time event streaming solutions using technologies such as Kafka, Spark Streaming … solutions. Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within highly ...

record of building and managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real ...

time insight into live positions and risk. This platform underpins critical trading decisions and represents a major step forward in scalability, resilience, and streaming architecture across our technology estate. Responsibilities Design and build distributed, real‐time streaming components within a Flink‐based architecture. Develop and maintain … detects and publishes meaningful changes in liability. Ensure correctness in a high‐throughput environment through robust handling of ordering, duplication, and idempotency. Optimise streaming jobs for latency, throughput, and resource efficiency. Collaborate closely with trading and product teams to translate domain requirements into scalable, reliable systems. Contribute ...

senior authority for low-latency market data, ticker plants, market microstructure analytics, L1/L2/L3 data, time-series platforms, streaming architectures, and real-time data consumption across Front Office, Quantitative Analytics, Risk, Commercial Operations, and Trading Technology. The role holder will work closely with trading desks … Quants, execution teams, and risk stakeholders to improve insight into liquidity dynamics, market behaviour, execution quality, and trading performance. 4. Time-Series Platforms, Streaming Architecture & Engineering Act as the technical authority for enterprise time-series platforms, tick-data analytics, streaming architectures, ticker plants, and low-latency ...

DescriptionRole – Senior ConsultantTechnology – Scala, Apache Spark, SQL, PythonNice to Have - AWS, UNIX shell scriptingLocation – London, UKContext and Job Description: Infosys provides Integration/middleware services for global clients covering a multitude of Integration technologies and products. The services are rendered typically following a global delivery model using … Data Structures and their usage At least 5+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies. Having expertise in Spark Core, Spark SQL and Spark Streaming. Experience with Python, Hadoop, HDFS ...

reliable systems in production. What You'll DoDefine and evolve the event-driven architecture strategy for UST FinX.Lead architecture across distributed systems, event streaming, integration, orchestration, and real-time processing services. Build reusable frameworks, libraries, and reference implementations for producers, consumers, retries, replay, resilience, and observability. Establish standards … architecture (12-18 years preferred).Proven ownership of large-scale, production distributed systems. Deep hands-on expertise with Kafka, Redpanda, or comparable event-streaming platforms. Strong experience designing and operating event-driven architectures in enterprise environments. Expert-level Java engineering skills. Deep understanding of: Distributed systems designConsistency modelsOrdering ...