1 to 25 of 92 Kafka Jobs in London

optimise CI/CD pipelines, ensuring automated testing and deployment. Architecture Contribution: Contribute to event-driven and distributed system designs using technologies like Kafka or Event Hub. Mentorship: Guide junior developers and foster a collaborative atmosphere within a cross-functional agile team. Soft Skills A strong engineering mindset with ...

Technical Consultant role.* Background in data engineering — ETL/ELT pipelines, data modelling, or analytics platforms.* Familiarity with event-driven architectures, message queues (Kafka, SQS, RabbitMQ), and microservices patterns.* Experience with advanced AI/ML engineering, including fine-tuning open-source models, building evaluation frameworks for LLM outputs ...

delivering solutions. Desirable Experience with containerisation and orchestration tools such as Docker and Kubernetes. Familiarity with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of front-end performance optimisation and accessibility standards. Exposure to machine learning pipelines or data engineering workflows. Prior experience working in startup ...

pipeline orchestration tools Containerisation (Docker, EKS, AKS, Kubernetes) Proficiency in CI/CD principles and tools Familiarity with open-source data tools (e.g., Spark, Kafka, PostgreSQL) Infrastructure as Code (Terraform, Ansible) Air-gapped development Automation Client/stakeholder management Public sector domain understanding Technical architecture Experience: You will have ...

highly desirable) Preferred Qualifications Experience with Azure OpenAI/Copilot/Microsoft Fabric Knowledge of knowledge graphs and semantic search Exposure to stream processing (Kafka, Event Hub) Certifications: Azure Data Engineer/AI Engineer AWS Data/ML certifications Experience leading teams or mentoring engineers Soft Skills Strong problem ...

test-driven development, delivery automation and good software engineering practices. · Experience with message-driven architectures and event-driven systems would be beneficial. · Experience with Kafka, Kafka Streams or Kafka Connect would also be beneficial. · Experience working with applications deployed in Kubernetes environments would also be beneficial. ...

banking or financial services, particularly front office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

productivity and code quality. Good to have experience with UXUI principles wireframing and accessibility standards Strong understanding of Agile methodologies ScrumSAFe Good to have Kafka/MQ development experience Soft Skills & Competencies Ability to multitask workflows across practice & team management, business development, building engineering capabilities and billable engagements. Exceptional ...

have experience leading projects or teams, mentoring engineers, and operating in production environments. Experience with cloud platforms (AWS, GCP, Azure), Docker, Kubernetes, message queues (Kafka, RabbitMQ), and event-driven systems is highly desirable, along with exposure to AI/LLM integrations. You'll bring strong system design skills ...

Solid experience with SQL and data modelling concepts Strong analytical and problem-solving skills Nice to Have Skills Experience with data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active ...

quality, deciding when to leverage AI tools versus hands-on implementation. System & Event Architecture : Exposure to event-driven and publish-subscribe technologies such as Kafka, RabbitMQ or SNS/SQS. Testing Skills : Experience writing well-tested code and contributing to robust automated test suites. Collaboration & Communication : Comfortable working closely ...

property graphs Hypergraph structures Entity resolution Graph schema design Data Engineering & Integration Pipeline Development Data Integration Languages & Tools ETL/ELT pipeline design Apache Kafka Apache Spark AWS Glue dbt Apache Airflow Entity matching and resolution Data lineage tracking Schema mapping Semantic data integration Metadata management Data quality frameworks ...

Essential Skills & Experience Strong experience in Java development, including: Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object ...

with DevOps & CI/CD tools like GitHub, Terraform, Docker, Kubernetes, and automated testing and monitoring Skilled in data modelling, APIs, messaging systems (e.g., Kafka), and ETL pipelines Knowledge of secure design, identity management, and regulatory standards (e.g., GDPR) Architecture certifications (e.g., TOGAF, ArchiMate) are a plus ...

collaboration and communication skills. Strong experience in distributed systems and event-driven architectures. Hands-on experience with: Apache Flink (or similar stream processing frameworks) Kafka or other messaging systems. Strong Proficiency in .NET or Java. Experience building systems that are highly observable and operationally mature, with strong monitoring, logging ...

e.g., Airflow, Databricks Workflows) Strong understanding of data modelling and lakehouse architecture Databricks certifications (e.g., Databricks Certified Data Engineer) Experience with streaming data pipelines (Kafka, Structured Streaming) Experience with CI/CD and DevOps practices Knowledge of Delta Lake features (time travel, CDC, optimisation) Experience with containerisation (Docker, Kubernetes ...

working in an IT project environment preferably in banking or financial sector Experience working in an AGILE Experience with message queue like Apache Kafka IBM MQ etc. We are a Disability Confident Employer: Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government ...

knowledge of OOP and data structures), experience in Agile environments, exposure to banking/financial sector projects, and familiarity with messaging systems like Apache Kafka or IBM MQ. ' We are a Disability Confident Employer: Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government ...

Microsoft 365 and exposure to AI productivity tooling is advantageous Desirable Experience: Vector databases and embedding-based pipelines Real-time data streaming technologies (e.g. Kafka, Flink) RPA tools such as UiPath or Power Automate Data transformation tools such as dbt Exposure to modern AI tooling and frameworks (e.g. Claude ...

design. Experience with cloud platforms and containerization technologies. Strong knowledge of modern programming languages (e.g., Java), database technologies (Oracle, MSSQL), and messaging systems (e.g., Kafka). Expertise in building and scaling data‐intensive applications and data analytics platforms. Leadership & Management Exceptional leadership and communication skills, with the ability ...

Experience with cloud platforms and containerization technologies. + Strong knowledge of modern programming languages (e.g., Java), database technologies (Oracle, MSSQL), and messaging systems (e.g., Kafka). + Expertise in building and scaling data-intensive applications and data analytics platforms.* **Leadership & Management:** + Exceptional leadership and communication skills, with ...

write, and debug multithreaded Java code. Hands on experience with enterprise design patterns and web architectures. Experience with memory and performance profiling. Experience with Kafka or MQ (pub/sub middleware). Tools experience: JIRA, Git, IntelliJ IDEA, GitLab, Docker. Strong experience in AWS Lambda, AWS Step Functions ...

Kubernetes networking, security and service mesh technologies Experience with the following would be highly beneficial: Cilium Istio/Service Mesh ArgoCD or Flux OpenTelemetry Kafka or Redpanda Python automation tooling Policy as Code/Kubernetes security tooling To progress matters please send your CV Laura at Services advertised ...

continuous improvement Manage capacity planning, skills development, and vendor contributions The individual: Expertise in Azure data services (ADLS, ADF, Databricks, Synapse, Event Hub/Kafka), Python, SQL, Spark/PySpark. Experience with data modeling, metadata and lineage tooling; performance & cost optimization. Proven leadership in engineering teams; Agile/DevOps ...

wider data platform modernisation programme Supporting both batch and streaming workloads Tech: Python, Java, Spark, Airflow, SQL, Cloud (AWS/Azure), Kubernetes (Kafka/streaming nice to have) Details: £700/day (Umbrella) 6-month contract 3 days onsite - City of London They're looking for a strong, hands ...