1 to 25 of 173 Kafka Jobs in London

Streaming/Event-Driven Engineer (Kafka Specialist) 6-Month contract - Inside IR35 - up to £550 per day London based - hybrid working - 3 days a week on site We are seeking an experienced Streaming/Event-Driven Engineer (Kafka Specialist) to own and evolve our event-driven architecture … Responsibilities Own the design and implementation of event-driven architecture across the organisation. Design, build and maintain scalable real-time data pipelines using Kafka technologies. Develop stream processing applications using Kafka Streams and ksqlDB. Implement robust event models that support scalable, loosely coupled systems. Optimise streaming performance, resilience ...

distributed systems Experience designing and developing REST APIs Strong knowledge of Hibernate/JPA and relational database design Experience with messaging systems such as Kafka or RabbitMQ Hands-on experience with cloud platforms (AWS, Azure, or GCP) Experience with Docker and Kubernetes Strong database experience with PostgreSQL, MySQL, MongoDB ...

delivering solutions. Desirable Experience with containerisation and orchestration tools such as Docker and Kubernetes. Familiarity with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of front-end performance optimisation and accessibility standards. Exposure to machine learning pipelines or data engineering workflows. Prior experience working in startup ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

platforms. Experience with data governance, metadata services, data catalogues, or secure data access models. Exposure to event-driven architectures and streaming technologies such as Kafka, Flink, or Spark Streaming. Experience evaluating or contributing to open-source technologies. ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

development experience with Python and/or Java. Expertise in AWS, Docker, ECS/EKS (Kubernetes), and cloud-native microservices. Experience with Apache Kafka and event-driven architectures. Strong knowledge of GitLab CI/CD, Terraform, Infrastructure as Code, and Continuous Delivery. Proven ability to establish engineering standards, improve ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

expertise in designing large-scale machine learning systems and architectures Advanced programming skills (Python preferred) with experience in frameworks and tools such as JavaScript, Kafka, and reactive systems Extensive experience with cloud-based development, particularly on Azure, including AI/ML services and data platforms Proven experience with Kubernetes ...

modern Java (ideally Java 21), Spring Boot and relational databases. Event-Driven Systems : Experience with event-driven architectures and publish-subscribe systems such as Kafka or AWS SNS/SQS. Quality Mindset : A focus on writing well-tested, maintainable and observable code. DevOps & Cloud : Familiarity with CI/ ...

RESTful API design principles and best practices. Experience with TDD and testing frameworks such as Boost.Test, Google Test, etc... NicetoHaves: ExperiencewithAzureservicesformanagingGPTpipelinesandmulti-cloudinfrastructure. FamiliaritywithbigdatatechnologiessuchasApacheSpark,Kafka,andMSKforlarge-scaledataprocessing. Experience with boost libraries (asio, beast). Advancedexperienceincostoptimizationstrategiesforcloudinfrastructureanddatabaseperformancetuning. Technicalacumen: AdvancedknowledgeofallAWSsystemsandservices. Detailoriented: Responsibleformission-criticalhealthcareproductsandservices. CommunicationsandTrust: Phenomenalcommunicationskillswiththeabilitytomaintainthehighestlevelsofconfidentialityonaconsistentbasis. OrganisationandGettingStuffDone: Jugglingmultipleprojectsandtimelines.Prioritising.Keeneyefordetailinalltasksandprojects.Exceptionalatmakinglistsandmaintainingorganisation. GrowthMindset: Yourabilitytolearnfrommistakes,reflectonmistakes,andnotmakemistakesagain.Beingcuriousandaskingquestionsandfacingresilienceinthefaceofsetbacks. Benefits Join ...

productivity and code quality. Good to have experience with UXUI principles wireframing and accessibility standards Strong understanding of Agile methodologies ScrumSAFe Good to have Kafka/MQ development experience Soft Skills & Competencies Ability to multitask workflows across practice & team management, business development, building engineering capabilities and billable engagements. Exceptional ...

have experience leading projects or teams, mentoring engineers, and operating in production environments. Experience with cloud platforms (AWS, GCP, Azure), Docker, Kubernetes, message queues (Kafka, RabbitMQ), and event-driven systems is highly desirable, along with exposure to AI/LLM integrations. You'll bring strong system design skills ...

quality, deciding when to leverage AI tools versus hands-on implementation. System & Event Architecture : Exposure to event-driven and publish-subscribe technologies such as Kafka, RabbitMQ or SNS/SQS. Testing Skills : Experience writing well-tested code and contributing to robust automated test suites. Collaboration & Communication : Comfortable working closely ...

asynchronous processing, message queues, and distributed systems Demonstrated ability to write clean, well-tested, maintainable code Bonus Familiarity with real-time data processing frameworks (Kafka, Redis Streams, etc.) Experience with ML/AI infrastructure or building tools for AI applications Previous work on developer tools, monitoring systems, or security ...

Essential Skills & Experience Strong experience in Java development, including: Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object ...

skills Good communication and collaboration ability Attention to detail and quality mindset Preferred Qualifications AWS Certified (Developer or Cloud Practitioner) Experience with: Streaming platforms (Kafka/MSK) Performance and security testing tools Exposure to enterprise-scale AWS modernization programs ...

skills Good communication and collaboration ability Attention to detail and quality mindset Preferred Qualifications AWS Certified (Developer or Cloud Practitioner) Experience with: Streaming platforms (Kafka/MSK) Performance and security testing tools Exposure to enterprise-scale AWS modernization programs ...

skills Good communication and collaboration ability Attention to detail and quality mindset Preferred Qualifications AWS Certified (Developer or Cloud Practitioner) Experience with: Streaming platforms (Kafka/MSK) Performance and security testing tools Exposure to enterprise-scale AWS modernization programs ...

Boot for building microservices. Strong expertise with relational databases (Oracle) and data modelling (canonical data models, JSON). Deep experience with enterprise messaging platforms (Kafka, IBM MQ). Proven experience implementing AI/ML solutions (using Python or other frameworks) to solve business problems. Full‐stack development experience (RESTful ...