1 to 25 of 361 Kafka Jobs

Streaming/Event-Driven Engineer (Kafka Specialist) 6-Month contract - Inside IR35 - up to £550 per day London based - hybrid working - 3 days a week on site We are seeking an experienced Streaming/Event-Driven Engineer (Kafka Specialist) to own and evolve our event-driven architecture … Responsibilities Own the design and implementation of event-driven architecture across the organisation. Design, build and maintain scalable real-time data pipelines using Kafka technologies. Develop stream processing applications using Kafka Streams and ksqlDB. Implement robust event models that support scalable, loosely coupled systems. Optimise streaming performance, resilience ...

code (Terraform, Helm) Experience integrating process automation with case-management or service-orchestration platforms Understanding of event-driven design and message brokers ( e.g. Kafka, RabbitMQ) Understanding of agentic AI capabilities and how they can complement workflow automation Experience contributing to open-source Camunda extensions Holds UK security clearance What ...

delivery experience. CI/CD pipelines using Jenkins, GitHub Actions, or similar. Desirable Skills AWS or other cloud platform experience. Docker and Kubernetes. Apache Kafka or event-driven architectures. Infrastructure as Code (Terraform, CloudFormation). Experience working on government or public sector projects. Knowledge of GDS standards and accessibility ...

their output, and maintain quality over AI‐generated work product. Experience building event‐driven and distributed systems , including familiarity with messaging platforms (e.g., Apache Kafka), delivery guarantees, and resilience strategies. Strong SDLC practices : version control, CI/CD pipelines, automated build/test/deploy workflows, and code quality ...

.NET in enterprise environments. Frontend development experience using React . Experience with Azure Functions, Azure Service Bus, Event Grid, or Event Hubs. Exposure to Kafka or other messaging technologies. Knowledge of Infrastructure as Code (Terraform or Bicep). Experience with observability platforms such as Prometheus, Grafana, or Azure Monitor. ...

Cloud, Spring Security, and Spring Data. Proven experience in designing and building microservices and highly distributed systems. Deep understanding of architectural and scaling patterns: Kafka and scaling, message brokers, guaranteeing message order, and idempotency. Saga Pattern: practical application of distributed transactions for eventual consistency across microservices. CQRS: understanding ...

platforms. Experience with data governance, metadata services, data catalogues, or secure data access models. Exposure to event-driven architectures and streaming technologies such as Kafka, Flink, or Spark Streaming. Experience evaluating or contributing to open-source technologies. ...

Java and Kotlin. Proven experience developing applications using Spring Boot. Strong understanding of microservices architecture. Experience designing and building REST APIs. Commercial experience with Kafka or similar messaging technologies. Experience with PostgreSQL. Experience working with AWS cloud services. Hands-on experience with Docker and containerised applications. Strong understanding ...

desirable Knowledge of containerisation (Docker, Kubernetes) desirable Strong problem-solving skills and attention to detail Nice to Have Experience with messaging systems (Kafka, RabbitMQ, ActiveMQ) Knowledge of investment banking, retail banking, or payments domain Familiarity with regulatory frameworks (FCA, Basel III, MiFID II) Experience with Agile methodologies (Scrum, SAFe ...

Infrastructure AWS, Azure, GCP, VMware Cloud Foundation Kubernetes and Helm Containerisation technologies Linux and Windows administration Data & Integration Elastic MySQL/MariaDB SQL Server Kafka NiFi Security Security by Design Zero Trust IAM, OAuth/OIDC Keycloak HashiCorp Vault TLS/SSL and PKI What We're Looking ...

development experience with Python and/or Java. Expertise in AWS, Docker, ECS/EKS (Kubernetes), and cloud-native microservices. Experience with Apache Kafka and event-driven architectures. Strong knowledge of GitLab CI/CD, Terraform, Infrastructure as Code, and Continuous Delivery. Proven ability to establish engineering standards, improve ...

Java, Rust, JavaScript Cloud: AWS (Azure/GCP beneficial) Containers: Docker, Kubernetes, GPU containerisation Architecture: Microservices, serverless, APIs, edge compute, pub/sub systems (Kafka, MQTT) DevSecOps: Git, CI/CD, Terraform/Ansible, Linux scripting Proactive mindset, strong problem-solving skills, and ability to work independently ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

optimise CI/CD pipelines, ensuring automated testing and deployment. Architecture Contribution: Contribute to event-driven and distributed system designs using technologies like Kafka or Event Hub. Mentorship: Guide junior developers and foster a collaborative atmosphere within a cross-functional agile team. Why Join Us? Work on innovative projects ...

systems, storage, networking). Global financial services and regulatory/compliance considerations relevant to workload deployment. Database and messaging technologies such as MySQL, Cassandra, Kafka, CockroachDB, or Oracle. What\'s in it for you? You\'ll be building at the leading edge of AI-assisted software engineering ...

DevOps practices is a plus. Experience with TypeScript. Familiarity with GraphQL or other modern data-fetching technologies. Experience in integrating message brokers (e.g., RabbitMQ, Kafka). Familiarity with cloud platforms like AWS, Azure, or Google Cloud. Knowledge of microservices architecture and related tools. Experience with testing frameworks like Mocha ...

systems, storage, networking). Global financial services and regulatory/compliance considerations relevant to workload deployment. Database and messaging technologies such as MySQL, Cassandra, Kafka, CockroachDB, or Oracle. What's in it for you? You'll be building at the leading edge of AI‐assisted software engineering ...

industry experience. Experience with high‐volume, low‐latency SaaS systems. Experience with distributed and event‐driven architectures (Azure Service Bus, Event Hubs, Event Grid, Kafka). Experience building multi‐tenant architectures, including tenant provisioning, routing and per‐tenant configuration/quota management. Experience with Azure ingress and global routing ...

highly experienced Platform Architect to lead the architecture, governance, modernization, and operational excellence of enterprise‐scale Data and Integration Platforms across Snowflake, Confluent Cloud Kafka, Azure Cloud, GitHub Actions CI/CD, Kubernetes, Data Mesh, and broader integration ecosystems. The ideal candidate will combine deep technical expertise with strategic … event‐driven architecture using Confluent Cloud. Define topic governance, schema management, security controls, HA/DR, and cluster strategy. Establish enterprise integration patterns using Kafka, Kafka Connect, APIs, and streaming architectures. Define and implement CI/CD standards using GitHub Actions. Drive Infrastructure‐as‐Code, automation, release governance ...

knowledge or certifications relevant to public cloud, preferably AWS. Experience with any of streaming, messaging, event bus technologies while building event-driven architecture either Kafka, Event Bridge, Kinesis, Rabbit MQ, Active MQ or any other message bus. Familiarity with Infrastructure as Code (IaC) using Terraform or AWS CloudFormation ...

strategies, load balancing, and resource scheduling algorithms Experience building high‐throughput, low‐latency systems with sub‐100ms response time requirements Familiarity with message queues (Kafka, RabbitMQ), databases (PostgreSQL, Redis), and event‐driven architectures Knowledge of GPU computing, model serving optimizations (batching, quantization, multi‐tenancy), and resource allocation Experience with ...

metrics, traces, performance analysis. Proven ability to write clean, testable, well‐structured production code. Qualifications – Nice to Have Experience with streaming or queuing systems (Kafka, Pub/Sub, SQS). Familiarity with AI/LLM systems (AOE integration), though not required across all charters. Knowledge of data engineering patterns ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

engineering solutions within Banking, Financial Services, Capital Markets, Insurance, or other highly regulated enterprise environments would be highly advantageous Desirable experience includes: Databricks certifications Kafka or Structured Streaming CI/CD and DevOps practices Airflow or Databricks Workflows Delta Lake optimisation techniques Docker and Kubernetes Exposure to machine learning ...