1 to 25 of 82 Kafka Jobs in London

Technical Consultant role.* Background in data engineering — ETL/ELT pipelines, data modelling, or analytics platforms.* Familiarity with event-driven architectures, message queues (Kafka, SQS, RabbitMQ), and microservices patterns.* Experience with advanced AI/ML engineering, including fine-tuning open-source models, building evaluation frameworks for LLM outputs ...

distributed systems Experience designing and developing REST APIs Strong knowledge of Hibernate/JPA and relational database design Experience with messaging systems such as Kafka or RabbitMQ Hands-on experience with cloud platforms (AWS, Azure, or GCP) Experience with Docker and Kubernetes Strong database experience with PostgreSQL, MySQL, MongoDB ...

delivering solutions. Desirable Experience with containerisation and orchestration tools such as Docker and Kubernetes. Familiarity with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of front-end performance optimisation and accessibility standards. Exposure to machine learning pipelines or data engineering workflows. Prior experience working in startup ...

environment). Comfortable working in Agile delivery teams with iterative releases and continuous improvement. Nice to Have Experience with event-driven architectures (e.g., Kafka or similar). Knowledge of observability practices (metrics, logging, tracing) and production monitoring. Experience improving performance and scalability in high-throughput systems. Understanding of secure ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

expertise in designing large-scale machine learning systems and architectures Advanced programming skills (Python preferred) with experience in frameworks and tools such as JavaScript, Kafka, and reactive systems Extensive experience with cloud-based development, particularly on Azure, including AI/ML services and data platforms Proven experience with Kubernetes ...

modern Java (ideally Java 21), Spring Boot and relational databases. Event-Driven Systems : Experience with event-driven architectures and publish-subscribe systems such as Kafka or AWS SNS/SQS. Quality Mindset : A focus on writing well-tested, maintainable and observable code. DevOps & Cloud : Familiarity with CI/ ...

RESTful API design principles and best practices. Experience with TDD and testing frameworks such as Boost.Test, Google Test, etc... NicetoHaves: ExperiencewithAzureservicesformanagingGPTpipelinesandmulti-cloudinfrastructure. FamiliaritywithbigdatatechnologiessuchasApacheSpark,Kafka,andMSKforlarge-scaledataprocessing. Experience with boost libraries (asio, beast). Advancedexperienceincostoptimizationstrategiesforcloudinfrastructureanddatabaseperformancetuning. Technicalacumen: AdvancedknowledgeofallAWSsystemsandservices. Detailoriented: Responsibleformission-criticalhealthcareproductsandservices. CommunicationsandTrust: Phenomenalcommunicationskillswiththeabilitytomaintainthehighestlevelsofconfidentialityonaconsistentbasis. OrganisationandGettingStuffDone: Jugglingmultipleprojectsandtimelines.Prioritising.Keeneyefordetailinalltasksandprojects.Exceptionalatmakinglistsandmaintainingorganisation. GrowthMindset: Yourabilitytolearnfrommistakes,reflectonmistakes,andnotmakemistakesagain.Beingcuriousandaskingquestionsandfacingresilienceinthefaceofsetbacks. Benefits Join ...

Functions, SQS/SNS, etc.) · FastAPI and NextJS experience (if we’re still using the latter) · Websockets, Server-Side Events, Pub/Sub (RabbitMQ, Kafka, etc.) Who You'll Work With · Squad members of a specific squad, led by a Product Owner. · Tribe Leaders, Product Owners, and other Chapter ...

have experience leading projects or teams, mentoring engineers, and operating in production environments. Experience with cloud platforms (AWS, GCP, Azure), Docker, Kubernetes, message queues (Kafka, RabbitMQ), and event-driven systems is highly desirable, along with exposure to AI/LLM integrations. You'll bring strong system design skills ...

Solid experience with SQL and data modelling concepts Strong analytical and problem-solving skills Nice to Have Skills Experience with data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active ...

quality, deciding when to leverage AI tools versus hands-on implementation. System & Event Architecture : Exposure to event-driven and publish-subscribe technologies such as Kafka, RabbitMQ or SNS/SQS. Testing Skills : Experience writing well-tested code and contributing to robust automated test suites. Collaboration & Communication : Comfortable working closely ...

Essential Skills & Experience Strong experience in Java development, including: Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object ...

Boot for building microservices. Strong expertise with relational databases (Oracle) and data modelling (canonical data models, JSON). Deep experience with enterprise messaging platforms (Kafka, IBM MQ). Proven experience implementing AI/ML solutions (using Python or other frameworks) to solve business problems. Full‐stack development experience (RESTful ...

frameworks Java, Go, C#, Rust, or other strongly typed languages Internal platform engineering or developer platform ownership Event-driven architectures using EventBridge, Kinesis, Kafka, SQS, or SNS Contact centre, voice, or AWS Connect environments What's on Offer Remote-first working across the UK Exposure to large-scale cloud ...

with DevOps & CI/CD tools like GitHub, Terraform, Docker, Kubernetes, and automated testing and monitoring Skilled in data modelling, APIs, messaging systems (e.g., Kafka), and ETL pipelines Knowledge of secure design, identity management, and regulatory standards (e.g., GDPR) Architecture certifications (e.g., TOGAF, ArchiMate) are a plus ...

publishers and manage commissions and transactions using an event-driven architecture. We use an exciting array of technologies, including Java/Spring, AWS Lambda, Kafka, NodeJS, SQL/NoSQL databases, and more. Key tasks and responsibilities Work within a small, collaborative team using agile methodologies and practices Take ownership ...

collaboration and communication skills. Strong experience in distributed systems and event-driven architectures. Hands-on experience with: Apache Flink (or similar stream processing frameworks) Kafka or other messaging systems. Strong Proficiency in .NET or Java. Experience building systems that are highly observable and operationally mature, with strong monitoring, logging ...

e.g., Airflow, Databricks Workflows) Strong understanding of data modelling and lakehouse architecture Databricks certifications (e.g., Databricks Certified Data Engineer) Experience with streaming data pipelines (Kafka, Structured Streaming) Experience with CI/CD and DevOps practices Knowledge of Delta Lake features (time travel, CDC, optimisation) Experience with containerisation (Docker, Kubernetes ...

lazy loading and code splitting Experience using AI development tools (e.g., GitHub Copilot) within engineering workflows Nice to Have Event-driven architecture experience (Kafka, async patterns) Observability tools (Prometheus, Grafana, ELK) Frontend security (OAuth2, JWT) Automated testing frameworks (Cypress, Playwright, Jest) Design systems and tooling (Storybook, Figma) Experience ...

design. Experience with cloud platforms and containerization technologies. Strong knowledge of modern programming languages (e.g., Java), database technologies (Oracle, MSSQL), and messaging systems (e.g., Kafka). Expertise in building and scaling data-intensive applications and data analytics platforms. Leadership & Management: Exceptional leadership and communication skills, with the ability ...

moving towards a cloud-first architecture with a strong focus on AWS, working with technologies such as Java/Spring, AWS Lambda, Node.js, Kafka, SQL/NoSQL databases, and more. Key Tasks Work within a small, collaborative team using agile methodologies and practices Take ownership of applications across ...

Kubernetes networking, security and service mesh technologies Experience with the following would be highly beneficial: Cilium Istio/Service Mesh ArgoCD or Flux OpenTelemetry Kafka or Redpanda Python automation tooling Policy as Code/Kubernetes security tooling To progress matters please send your CV Laura at Services advertised ...

implementing batch and stream data processing systems. Experience with Datadog, SQL, Terraform, Docker, AWS (ECS, Kinesis, SQS, CloudWatch), GCP (BigQuery). Knowledge of Airflow, Kafka, Flink, dbt, Kubernetes is highly beneficial. Good understanding of AI platforms, experience building infrastructure for LLM orchestration (e.g., vector databases, RAG pipelines, GPU scaling ...