1 to 25 of 37 Permanent Kafka Jobs in London

based transformation tooling (e.g., dbt) Experience designing and operating orchestration pipelines using Airflow or similar tools Experience designing and building streaming pipelines using Kafka, Pub/Sub, or similar messaging systems Preferred qualifications, capabilities, and skills Data modeling experience for analytics and reporting use cases Knowledge of security, risk ...

based transformation tooling (e.g., dbt) Experience designing and operating orchestration pipelines using Airflow or similar tools Experience designing and building streaming pipelines using Kafka, Pub/Sub, or similar messaging systems Preferred qualifications, capabilities, and skills Data modeling experience for analytics and reporting use cases Knowledge of security, risk ...

based transformation tooling (e.g., dbt) Experience designing and operating orchestration pipelines using Airflow or similar tools Experience designing and building streaming pipelines using Kafka, Pub/Sub, or similar messaging systems Preferred qualifications, capabilities, and skills Data modeling experience for analytics and reporting use cases Knowledge of security, risk ...

DevOps practices is a plus. Experience with TypeScript. Familiarity with GraphQL or other modern data-fetching technologies. Experience in integrating message brokers (e.g., RabbitMQ, Kafka). Familiarity with cloud platforms like AWS, Azure, or Google Cloud. Knowledge of microservices architecture and related tools. Experience with testing frameworks like Mocha ...

engineering experience within complex production environments. Deep hands-on Java development experience. Strong understanding of distributed systems and scalable application design. Strong experience with Kafka and event-driven architectures. Experience designing microservices, APIs and integration patterns. Strong Kubernetes experience within production environments. Good understanding of software architecture, design patterns ...

developers, and set engineering standards Experience working in Agile environments Nice to have: Containerisation experience (Docker, Kubernetes) Nice to have messaging integration experience with Kafka or RabbitMQ Exposure to event-driven architectures Experience integrating systems within membership, retail, leisure, or consumer-facing industries Security, identity, or enterprise authentication experience ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

services and components . Build and maintain platform capabilities supporting batch and real-time data workloads . Develop and operate distributed data services using Kafka, Kinesis, Spark, Flink or equivalent technologies . Build and maintain cloud-native data platform capabilities using AWS and/or Azure . Support data … platforms . Strong programming experience using Java and/or Python . Hands-on experience with real-time streaming and event-driven architectures , including Kafka, Kinesis or equivalent. Experience with distributed data processing technologies such as Spark, Flink, Kafka Streams or equivalent. Strong experience with AWS and/ ...

. Strong knowledge of performance testing methodologies and tools (such as JMeter, LoadRunner, Eggplant Performance, Gatling). Desirable skills: Knowledge of middleware systems (Kafka, IBM MQ). Experience with ELK stack and reporting tools (e.g., Tableau). About Peregrine We build workforces that deliver tech and change programmes ...

microservices. The Tech Stack: Backend: Java (11/17), Spring Boot, Spring Security, Microservices. Frontend: React.js, TypeScript, JavaScript, Redux. Infrastructure & Data: Docker, Kubernetes, Kafka/RabbitMQ, Oracle/PostgreSQL/MongoDB. What You Need: 5+ years of full stack software development experience. Strong foundation in OOP, Design Patterns, Data ...

EXPERIENCE: You will bring strong capability in: Node.js and TypeScript development. React and Next.js. GraphQL and REST API development. Microservices and event-driven architectures. Kafka or similar messaging technologies. PostgreSQL, MongoDB and Redis. AWS, Docker and CI/CD practices. Strong communication skills and the ability to influence stakeholders ...

Desirable Certifications: Databricks and/or AWS certifications at Associate or Professional level. Streaming Architectures: Practical experience with real-time or event-driven streaming (Kafka/MSK, Kinesis, Spark Structured Streaming). Advanced Data Architectures: Exposure to Data Mesh concepts, data products, or federated data governance models. AI/ ...

modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity or experience with classical NLP techniques (BERT, topic modelling, summarisation ...

distributed systems and cloud-native architectures, with experience shaping technical direction across teams and stakeholders Solid expertise in relevant technologies such as AWS, Terraform, Kafka/MSK, Airflow, Glue or Spark, and building scalable data solutions Experience with modern data ecosystems including data lakes/lakehouse architectures, Iceberg ...

gone wrong. Our estate, for context AWS and Azure · Kubernetes and EKS · Karpenter · Terraform · Helm · FluxCD · GitHub Actions · Prometheus, Grafana, Loki and OpenTelemetry · Kafka · Elasticsearch · PostgreSQL · ClickHouse · Python and Go services · You do not need to have used all of it. You should recognise most ...

Responsible AI Principles. Advanced degree in Computer Science, Artificial Intelligence, Data Science, or a related field. Experience designing event-driven, cloud-native architectures using Kafka (or equivalent streaming platforms), including topic design, schema governance, and consumer patterns. Why Join Us? Join our team and contribute to a culture ...

transaction volumes without disrupting existing users. The proposed stack centres on Java 21 and Spring Boot, with REST APIs for synchronous integration and Apache Kafka for asynchronous events. Each service will own its data, using PostgreSQL where appropriate, with Redis for caching. Docker containers will run on Kubernetes … security : Experience designing REST APIs with OpenAPI documentation, OAuth 2.0 or OpenID Connect, and token-based access control. Messaging : Practical experience with Apache Kafka or a comparable messaging platform, including consumer groups, ordering, delivery guarantees and duplicate processing. Databases : Strong SQL skills, relational data modelling, transaction management and query ...

based data processing (PostgreSQL, SQL Server), including complex queries, performance tuning, and large-scale ETL workflows. Implement and support distributed, event-driven architectures (e.g., Kafka, asynchronous workflows) for scalable platform execution. Develop and maintain cloud-native applications on AWS (e.g., Lambda, S3, ECS/EKS, Step Functions, Aurora). … maintainability. Understanding of data engineering principles (data modeling, pipelines, validation, lineage, error handling). Familiarity with distributed systems and event-driven architecture (e.g., Kafka, asynchronous processing). Bachelor's in Statistics, Computer Science or other similar advanced degrees from a top tier educational institution preferred CFA, CPA, CIPM, CAIA ...

principles Analytical, collaborative and a clear communicator Engaging and personable, comfortable giving and taking honest feedback Stack: Python, Django, FastAPI, AWS, PostgreSQL, Elasticsearch, Redis, Kafka, Kubernetes, GitHub What's on offer Competitive salary up to 70k for mid level and up to 82k for senior, plus a performance bonus ...

enjoy writing testable code and believe in Test Driven Development Nice to have: You have experience with Spring boot You have experience with Kafka You have worked with BFFs (Backend-for-Frontends) Additional Information Interested? Find out more: How we work – a practical guide DEI @ Wise Wise Tech Stack ...

driven mindset, with the ability to work closely with engineering teams Hands-on experience with high-performance messaging or sequencing platforms such as Aeron, Kafka, Hydra, or equivalent — including an understanding of message ordering, state machine replication, and fault-tolerant distributed systems Demonstrable exposure to low-latency or high ...

driven mindset, with the ability to work closely with engineering teams. Hands-on experience with high-performance messaging or sequencing platforms such as Aeron, Kafka, Hydra, or equivalent — including an understanding of message ordering, state machine replication, and fault-tolerant distributed systems Demonstrable exposure to low-latency or high ...

such as Cypher or Gremlin - Deep understanding of graph modelling, distributed systems, data architecture and performance optimisation - Experience with streaming technologies such as Apache Kafka and Flink - Able to work hands-on while providing senior architectural guidance within an early-stage environment - Experience within fintech, accounting, payments, banking ...

process large volumes of real-time and batch data Training, deploying, and maintaining machine learning models in production environments Working with Databricks, AWS, Python, Kafka, and modern MLOps tooling Leveraging machine learning, LLMs, and multimodal AI techniques across structured and unstructured data sources Collaborating with engineering, product, and business ...

relational databases, query optimisation and designing schemas is a plus Knowledge of Java and Spring boot and experience with a messaging system, like Kafka, is a plus Being part of the on-call rotation for our critical services and helping the team improve it, normally being on-call every ...