8 of 8 Permanent Spark Streaming Jobs in England

collaboration and delivery. What We're Looking ForStrong proficiency in Python, Scala, or Java, with hands-on experience of Big Data technologies including Spark, Hadoop, or similar distributed processing frameworks. Experience building real-time event streaming solutions using technologies such as Kafka, Spark Streaming … solutions. Bonus Points ForExpertise in data modelling, schema design, and working with structured and semi-structured datasets. Experience with distributed technologies including Hadoop, Spark, HDFS, Hive, Databricks, or AWS Lake Formation. Knowledge of automating ingestion and transformation frameworks within cloud-native data platforms. Experience delivering solutions within highly ...

record of building and managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real ...

solutions that support services used across the organisation. Working with cloud‐native technologies, distributed systems and event‐driven architectures, you will help improve streaming capabilities used by a wide range of teams and business areas. This is an opportunity for you to apply your technical skills at scale … event‐driven architecture practices and Confluent Platform technologies, including Kafka Connect, Schema Registry, Cluster Linking and ksqlDB, to deliver reliable, scalable and efficient streaming solutions. Developing secure and automated platform capabilities using Infrastructure as Code, Kubernetes and CI/CD tooling, alongside performance optimisation, capacity planning and Kafka ...

time insight into live positions and risk. This platform underpins critical trading decisions and represents a major step forward in scalability, resilience, and streaming architecture across our technology estate. Responsibilities Design and build distributed, real‐time streaming components within a Flink‐based architecture. Develop and maintain … detects and publishes meaningful changes in liability. Ensure correctness in a high‐throughput environment through robust handling of ordering, duplication, and idempotency. Optimise streaming jobs for latency, throughput, and resource efficiency. Collaborate closely with trading and product teams to translate domain requirements into scalable, reliable systems. Contribute ...

senior authority for low-latency market data, ticker plants, market microstructure analytics, L1/L2/L3 data, time-series platforms, streaming architectures, and real-time data consumption across Front Office, Quantitative Analytics, Risk, Commercial Operations, and Trading Technology. The role holder will work closely with trading desks … Quants, execution teams, and risk stakeholders to improve insight into liquidity dynamics, market behaviour, execution quality, and trading performance. 4. Time-Series Platforms, Streaming Architecture & Engineering Act as the technical authority for enterprise time-series platforms, tick-data analytics, streaming architectures, ticker plants, and low-latency ...

DescriptionRole – Senior ConsultantTechnology – Scala, Apache Spark, SQL, PythonNice to Have - AWS, UNIX shell scriptingLocation – London, UKContext and Job Description: Infosys provides Integration/middleware services for global clients covering a multitude of Integration technologies and products. The services are rendered typically following a global delivery model using … Data Structures and their usage At least 5+ years of experience in designing and developing large scale, distributed data processing pipelines using Apache Spark and related technologies. Having expertise in Spark Core, Spark SQL and Spark Streaming. Experience with Python, Hadoop, HDFS ...

reliable systems in production. What You'll DoDefine and evolve the event-driven architecture strategy for UST FinX.Lead architecture across distributed systems, event streaming, integration, orchestration, and real-time processing services. Build reusable frameworks, libraries, and reference implementations for producers, consumers, retries, replay, resilience, and observability. Establish standards … architecture (12-18 years preferred).Proven ownership of large-scale, production distributed systems. Deep hands-on expertise with Kafka, Redpanda, or comparable event-streaming platforms. Strong experience designing and operating event-driven architectures in enterprise environments. Expert-level Java engineering skills. Deep understanding of: Distributed systems designConsistency modelsOrdering ...

Drive – the operating manual for how we behave. Join us as a Kafka Platform Engineer To help develop and enhance the enterprise streaming platforms that enable secure, reliable and real-time data movement across Barclays. This role supports the delivery of scalable, resilient and secure platform solutions that … enterprise scale, helping to improve platform reliability, security and automation. This is an opportunity to help shape the future direction of strategic streaming capabilities while contributing to solutions that deliver meaningful business impact. Essential skills Designing, implementing and operating enterprise-scale Confluent Kafka platforms supporting business-critical workloads. ...