managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Programming skills in Python More ❯
managing real-time data pipelines across a track record of multiple initiatives. Expertise in developing data backbones using distributed streaming platforms (Kafka, Spark Streaming, Flink, etc.). Experience working with cloud platforms such as AWS, GCP, or Azure for real-time data ingestion and storage. Ability to optimise and More ❯
London, England, United Kingdom Hybrid / WFH Options
Lloyds Banking Group
databases to build data solutions, such as SQL Server/Oracle , experience with relational and dimensional data structures. Experience in using distributed frameworks ( Spark, Flink, Beam, Hadoop ). Proficiency in infrastructure as code (IaC) using Terraform . Experience with CI/CD pipelines and related tools/frameworks. Containerisation More ❯
London, England, United Kingdom Hybrid / WFH Options
IDEXX
AI/ML components or interest in learning data workflows for ML applications . Bonus if you have e xposure to Kafka, Spark, or Flink . Experience with data compliance regulations (GDPR). What You Can Expect From Us Opportunity for annual bonuses Medical Insurance Cycle to work scheme More ❯
AI/ML components or interest in learning data workflows for ML applications . Bonus if you have e xposure to Kafka, Spark, or Flink . Experience with data compliance regulations (GDPR). What you can expect from us: Salary 65-75k Opportunity for annual bonuses Medical Insurance More ❯
Bristol, England, United Kingdom Hybrid / WFH Options
Lloyds Bank plc
databases to build data solutions, such as SQL Server/Oracle , experience with relational and dimensional data structures. Experience in using distributed frameworks ( Spark, Flink, Beam, Hadoop ). Proficiency in infrastructure as code (IaC) using Terraform . Experience with CI/CD pipelines and related tools/frameworks. Containerisation More ❯
Bristol, England, United Kingdom Hybrid / WFH Options
Lloyds Banking Group
databases to build data solutions, such as SQL Server/Oracle, experience with relational and dimensional data structures Experience in using distributed frameworks (Spark, Flink, Beam, Hadoop) Proficiency in infrastructure as code (IaC) using Terraform Experience with CI/CD pipelines and related tools/frameworks Containerisation Good knowledge More ❯
London, England, United Kingdom Hybrid / WFH Options
Methods
automate data flows and manage complex workflows within hybrid environments. Event Streaming Experience: Utilise event-driven technologies such as Kafka, Apache NiFi, and ApacheFlink to handle real-time data streams effectively. Security and Compliance: Manage security setups and access controls, incorporating tools like Keycloak to protect data integrity More ❯
London, England, United Kingdom Hybrid / WFH Options
Apollo Solutions
with dbt, Fivetran, Apache Airflow, Data Mesh, Data Vault 2.0, Fabric, and Apache Spark Experience working with streaming technologies such as Apache Kafka, ApacheFlink, or Google Cloud Dataflow Hands-on experience with modern data orchestration tools like Dagster or Prefect Knowledge of data governance and cataloging tools like More ❯
London, England, United Kingdom Hybrid / WFH Options
VBeyond Europe
Data-stores/Databases, API design, Networking, Security, Version Control Systems, and CI/CD tools. Deep experience with several of the following: Kafka, Flink, Spark, Kubernetes, API Gateways, messaging systems (Tibco, IBM MQ, and open-source variants). Strong understanding of data streaming, integration patterns, and their impact More ❯
with testing frameworks like Jest, Cypress, or React Testing Library. Experience with authentication strategies using OAuth, JWT, or Cognito Familiarity with Apache Spark/Flink for real-time data processing is an advantage. Hands-on experience with CI/CD tools Commercial awareness and knowledge of public sector. Excellent More ❯
London, England, United Kingdom Hybrid / WFH Options
Aker Systems Limited
with testing frameworks like Jest, Cypress, or React Testing Library. Experience with authentication strategies using OAuth, JWT, or Cognito Familiarity with Apache Spark/Flink for real-time data processing is an advantage. Hands-on experience with CI/CD tools Commercial awareness and knowledge of public sector. Excellent More ❯
is a plus Solid understanding of system design, scalability, and security best practices Nice to Have: Experience with real-time streaming frameworks (e.g., ApacheFlink, Kafka Streams) Background in analytics or visualization tools for IoT metrics Exposure to cloud platforms (AWS, Azure, GCP) Apply or get in touch with More ❯
Staines-upon-Thames, England, United Kingdom Hybrid / WFH Options
IFS
Kubernetes and Cloud services. Experience with Azure stack will be an asset. Experience designing and implementing event-driven/microservices applications using Apache Kafka, Flink, etc. Solid understanding of agentic technologies and frameworks: AI agents, Assistants and RAG patterns, vector/hybrid search, etc. Exposure to model deployment and More ❯
London, England, United Kingdom Hybrid / WFH Options
Cleo
containerisation and orchestration (Docker and Kubernetes). Infrastructure as Code (Terraform or similar). Experience with at least one distributed data-processing framework (Spark, Flink, Kafka, etc.). Familiarity with different storage solutions (e.g., OLTP, OLAP, NoSQL, object storage) and their trade-offs. Product mindset and ability to link More ❯
London, England, United Kingdom Hybrid / WFH Options
Cleo
containerisation and orchestration (Docker and Kubernetes). Infrastructure as Code (Terraform or similar). Experience with at least one distributed data-processing framework (Spark, Flink, Kafka, etc.). Familiarity with different storage solutions (e.g., OLTP, OLAP, NoSQL, object storage) and their trade-offs. Product mindset and ability to link More ❯
Mountain View, California, United States Hybrid / WFH Options
LinkedIn
dynamic environment. Hands-on involvement with large-scale distributed systems and client-server architectures. Familiarity with Data Infrastructure tech stacks: Kafka/PubSub systems, Flink, Airflow. In-depth knowledge of AI/machine learning and data analytics. Skilled at leading and influencing within large, matrixed organizations. Track record of More ❯
London, England, United Kingdom Hybrid / WFH Options
Wikimedia Foundation
data and security best practices. Proven success in managing ambiguous projects and collaborating across teams. Knowledge of scalable data processing frameworks (e.g., Spark, Kafka, Flink). Desired Qualities Commitment to Wikimedia's mission and values. Strong problem-solving and leadership skills. Excellent communication skills. Decision-making ability in complex More ❯
London, England, United Kingdom Hybrid / WFH Options
EMBS Technology
Code tools (Terraform, AWS CloudFormation) Experience with observability and monitoring tools (Prometheus, Grafana, AWS CloudWatch) Familiarity with data streaming frameworks such as Kafka Streams, Flink, or Spark Streaming Knowledge of security best practices , including IAM, encryption, and role-based access control At least 5 plus years of experience in More ❯
London, England, United Kingdom Hybrid / WFH Options
Citi
development and architecture experience in big-data ecosystem – Hadoop, Hive, Impala, NOSQL Hands-on development, architecture and leadership experience in distributed computing technologies – Spark, Flink Hands-on development, and architecture experience in caching, In-memory databases , messaging infra (Kafka, Pulsar, RabbitMQ, etc.) Relevant Risk domain experience within Financial Services More ❯
London, England, United Kingdom Hybrid / WFH Options
The Adaptavist Group
/issues to technical and non-technical staff and stakeholders Experience with streaming technologies Kubernetes experience Kafka experience Experience with Apache Airflow and ApacheFlink Not ticking every box? That’s totally okay! Studies show that women and people of colour might hesitate to apply unless they meet every More ❯
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
ZipRecruiter
Engineer will have the following skills and experience: Ability and experience interacting with key stakeholder Java experience for microservicing Streaming experience e.g. Kafka, Kinesis, Flink Cloud experience - AWS, Azure, GCP THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £75,000-80,000 On More ❯
London, England, United Kingdom Hybrid / WFH Options
Kx Systems, Inc
real-time analytics solutions, preferably with experience in time-series databases. Proficiency in technologies relevant to real-time analytics, such as KX, Kafka, Spark, Flink, and real-time visualization tools. Demonstrated ability to lead and mentor software engineering teams. Excellent problem-solving skills and the ability to work collaboratively More ❯
London, England, United Kingdom Hybrid / WFH Options
Captify Technologies
CD tools (e.g. Jenkins, TeamCity) Know about docker, Kubernetes, and AWS services Have experience with Scala or Python programming languages Experience with spark and flink is advantageous Proactive self-starter who takes ownership, is comfortable with ambiguity and is able to drive the project and mentor team members Passionate More ❯