1 to 25 of 157 Kafka Jobs

scope technologies/products: "Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible" Skillsets required: 1. Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs ...

Streaming/Event-Driven Engineer (Kafka Specialist) 6-Month contract - Inside IR35 - up to £550 per day London based - hybrid working - 3 days a week on site We are seeking an experienced Streaming/Event-Driven Engineer (Kafka Specialist) to own and evolve our event-driven architecture … Responsibilities Own the design and implementation of event-driven architecture across the organisation. Design, build and maintain scalable real-time data pipelines using Kafka technologies. Develop stream processing applications using Kafka Streams and ksqlDB. Implement robust event models that support scalable, loosely coupled systems. Optimise streaming performance, resilience ...

architectures. Strong knowledge of RESTful API design and integration. Experience with Hibernate, JPA, and ORM frameworks. Hands-on experience with messaging technologies such as Kafka or RabbitMQ. Experience with cloud platforms including AWS, Azure, or GCP. Strong experience with Docker and Kubernetes. Proficiency with relational and NoSQL databases such ...

working within Agile delivery environments. Excellent problem-solving and communication skills. Desirable Skills Experience with Docker and Kubernetes. Knowledge of messaging technologies such as Kafka or RabbitMQ. Exposure to DevOps practices and CI/CD tools including Jenkins or GitHub Actions. Understanding of API security frameworks including OAuth2 ...

distributed systems Experience designing and developing REST APIs Strong knowledge of Hibernate/JPA and relational database design Experience with messaging systems such as Kafka or RabbitMQ Hands-on experience with cloud platforms (AWS, Azure, or GCP) Experience with Docker and Kubernetes Strong database experience with PostgreSQL, MySQL, MongoDB ...

Azure DevOps. Knowledge of monitoring tools such as Prometheus, Grafana, or ELK Stack. Preferred Skills Experience with event-driven architectures. Experience with Kafka, RabbitMQ, or other messaging platforms. Exposure to distributed systems and high-volume transactional environments. Knowledge of gRPC and Protocol Buffers. Experience working in Agile/Scrum ...

microservices, distributed systems, and system design Experience designing and building RESTful APIs at scale Hands-on experience with: Hibernate/JPA Messaging systems (Kafka, RabbitMQ) Experience with cloud platforms ( AWS/Azure/GCP ) Strong knowledge of Docker, Kubernetes , and container orchestration Expertise in database design ( SQL & NoSQL ) Strong ...

delivering solutions. Desirable Experience with containerisation and orchestration tools such as Docker and Kubernetes. Familiarity with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of front-end performance optimisation and accessibility standards. Exposure to machine learning pipelines or data engineering workflows. Prior experience working in startup ...

platforms. Experience with data governance, metadata services, data catalogues, or secure data access models. Exposure to event-driven architectures and streaming technologies such as Kafka, Flink, or Spark Streaming. Experience evaluating or contributing to open-source technologies. ...

DevOps & Cloud: Hands-on experience with Kubernetes , Docker, Terraform, and CI/CD tools like Jenkins or GitHub Actions. Data & Messaging: Expert knowledge of Kafka , Apache Flink, PostgreSQL, Oracle, and Elasticsearch. Security: Deep understanding of OAuth 2.0, secure web services, and API gateway management. Candidate Profile Enterprise Experience: Proven ...

Java, Rust, JavaScript Cloud: AWS (Azure/GCP beneficial) Containers: Docker, Kubernetes, GPU containerisation Architecture: Microservices, serverless, APIs, edge compute, pub/sub systems (Kafka, MQTT) DevSecOps: Git, CI/CD, Terraform/Ansible, Linux scripting Proactive mindset, strong problem-solving skills, and ability to work independently ...

testing, and containerisation Strong problem-solving and communication skills Technology Stack Python, SQL, FastAPI, PyTorch, Transformers/LLMs, Terraform, Databricks, Kubernetes, AWS, Azure, PostgreSQL, Kafka, Git, CI/CD, Knowledge Graphs What's on Offer Fully remote working within the UK Opportunity to work on cutting-edge ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

technical discussions. Support testing, deployment and operational activities. Follow secure software development and DevOps practices. Essential Skills & Experience (Must Have) Java Spring Boot Kafka MongoDB API development and integration Basic understanding of Docker images and containers Unit Testing/TDD Gherkin-style BDD testing, preferably using Cucumber CI/ ...

expertise in designing large-scale machine learning systems and architectures Advanced programming skills (Python preferred) with experience in frameworks and tools such as JavaScript, Kafka, and reactive systems Extensive experience with cloud-based development, particularly on Azure, including AI/ML services and data platforms Proven experience with Kubernetes ...

using OAuth2/OIDC, session management, and fine-grained permissions. Design and maintain event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. ...

RESTful API design principles and best practices. Experience with TDD and testing frameworks such as Boost.Test, Google Test, etc... NicetoHaves: ExperiencewithAzureservicesformanagingGPTpipelinesandmulti-cloudinfrastructure. FamiliaritywithbigdatatechnologiessuchasApacheSpark,Kafka,andMSKforlarge-scaledataprocessing. Experience with boost libraries (asio, beast). Advancedexperienceincostoptimizationstrategiesforcloudinfrastructureanddatabaseperformancetuning. Technicalacumen: AdvancedknowledgeofallAWSsystemsandservices. Detailoriented: Responsibleformission-criticalhealthcareproductsandservices. CommunicationsandTrust: Phenomenalcommunicationskillswiththeabilitytomaintainthehighestlevelsofconfidentialityonaconsistentbasis. OrganisationandGettingStuffDone: Jugglingmultipleprojectsandtimelines.Prioritising.Keeneyefordetailinalltasksandprojects.Exceptionalatmakinglistsandmaintainingorganisation. GrowthMindset: Yourabilitytolearnfrommistakes,reflectonmistakes,andnotmakemistakesagain.Beingcuriousandaskingquestionsandfacingresilienceinthefaceofsetbacks. Benefits Join ...

have experience leading projects or teams, mentoring engineers, and operating in production environments. Experience with cloud platforms (AWS, GCP, Azure), Docker, Kubernetes, message queues (Kafka, RabbitMQ), and event-driven systems is highly desirable, along with exposure to AI/LLM integrations. You'll bring strong system design skills ...

Solid experience with SQL and data modelling concepts Strong analytical and problem-solving skills Nice to Have Skills Experience with data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

CentOS Windows Server and Active Directory VMware vSphere/ESXi Terraform and Ansible Docker and Kubernetes AWS or Azure Elasticsearch/Kibana MongoDB Apache Kafka Helm Concourse CI/CD Atlassian toolset (Jira, Confluence, Bitbucket) Infrastructure as Code (IaC) Networking and infrastructure monitoring TOGAF or MODAF architecture frameworks Enterprise ...

Essential Skills & Experience Strong experience in Java development, including: Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object ...

both systems and teams Confidence in collaborating with technical and non-technical stakeholders Additional experience (nice to have) Exposure to event-driven architectures (e.g. Kafka, RabbitMQ, SNS/SQS) Knowledge of Domain-Driven Design (DDD) Experience building resilient, scalable systems Familiarity with Infrastructure as Code tools such as Terraform ...