1 to 25 of 336 Kafka Jobs

Scope Technologies: Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs, authentication, encryption 2. DevOps & Automation ...

Scope Technologies: Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs, authentication, encryption 2. DevOps & Automation ...

scope technologies/products: "Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible" Skillsets required: 1. Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs ...

Streaming/Event-Driven Engineer (Kafka Specialist) 6-Month contract - Inside IR35 - up to £550 per day London based - hybrid working - 3 days a week on site We are seeking an experienced Streaming/Event-Driven Engineer (Kafka Specialist) to own and evolve our event-driven architecture … Responsibilities Own the design and implementation of event-driven architecture across the organisation. Design, build and maintain scalable real-time data pipelines using Kafka technologies. Develop stream processing applications using Kafka Streams and ksqlDB. Implement robust event models that support scalable, loosely coupled systems. Optimise streaming performance, resilience ...

distributed systems Experience designing and developing REST APIs Strong knowledge of Hibernate/JPA and relational database design Experience with messaging systems such as Kafka or RabbitMQ Hands-on experience with cloud platforms (AWS, Azure, or GCP) Experience with Docker and Kubernetes Strong database experience with PostgreSQL, MySQL, MongoDB ...

Azure DevOps. Knowledge of monitoring tools such as Prometheus, Grafana, or ELK Stack. Preferred Skills Experience with event-driven architectures. Experience with Kafka, RabbitMQ, or other messaging platforms. Exposure to distributed systems and high-volume transactional environments. Knowledge of gRPC and Protocol Buffers. Experience working in Agile/Scrum ...

desirable Knowledge of containerisation (Docker, Kubernetes) desirable Strong problem-solving skills and attention to detail Nice to Have Experience with messaging systems (Kafka, RabbitMQ, ActiveMQ) Knowledge of investment banking, retail banking, or payments domain Familiarity with regulatory frameworks (FCA, Basel III, MiFID II) Experience with Agile methodologies (Scrum, SAFe ...

desirable Knowledge of containerisation (Docker, Kubernetes) desirable Strong problem-solving skills and attention to detail Nice to Have Experience with messaging systems (Kafka, RabbitMQ, ActiveMQ) Knowledge of investment banking, retail banking, or payments domain Familiarity with regulatory frameworks (FCA, Basel III, MiFID II) Experience with Agile methodologies (Scrum, SAFe ...

delivering solutions. Desirable Experience with containerisation and orchestration tools such as Docker and Kubernetes. Familiarity with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of front-end performance optimisation and accessibility standards. Exposure to machine learning pipelines or data engineering workflows. Prior experience working in startup ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

platforms. Experience with data governance, metadata services, data catalogues, or secure data access models. Exposure to event-driven architectures and streaming technologies such as Kafka, Flink, or Spark Streaming. Experience evaluating or contributing to open-source technologies. ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

disabilities to perform the essential functions. Professional Experience Very desirable is experience with Agentic AI in a ELT/ETL capacity (Preferred) Exposure to Kafka or streaming platforms from an infrastructure or operational perspective (Preferred) Experience with observability tooling (logging, metrics, alerting) for cloud platforms (Preferred) Understanding of FinOps ...

DevOps tools Bonus Points For Terraform, CloudFormation, or other infrastructure-as-code tools Experience with serverless functions (AWS Lambda, Azure Functions) Messaging systems like Kafka or RabbitMQ Familiarity with security protocols such as OAuth2 and SAML QA automation and integration with third-party platforms Why Join Capco ...

testing and version control. Data Engineering Stack Experience building pipelines using streaming frameworks, distributed processing engines and relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL. Orchestration Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect. Data Quality and Lineage Familiarity ...

Java, Rust, JavaScript Cloud: AWS (Azure/GCP beneficial) Containers: Docker, Kubernetes, GPU containerisation Architecture: Microservices, serverless, APIs, edge compute, pub/sub systems (Kafka, MQTT) DevSecOps: Git, CI/CD, Terraform/Ansible, Linux scripting Proactive mindset, strong problem-solving skills, and ability to work independently ...

testing, and containerisation Strong problem-solving and communication skills Technology Stack Python, SQL, FastAPI, PyTorch, Transformers/LLMs, Terraform, Databricks, Kubernetes, AWS, Azure, PostgreSQL, Kafka, Git, CI/CD, Knowledge Graphs What's on Offer Fully remote working within the UK Opportunity to work on cutting-edge ...

pipeline orchestration tools Containerisation (Docker, EKS, AKS, Kubernetes) Proficiency in CI/CD principles and tools Familiarity with open-source data tools (e.g., Spark, Kafka, PostgreSQL) Infrastructure as Code (Terraform, Ansible) Air-gapped development Automation Client/stakeholder management Public sector domain understanding Technical architecture Experience: You will have ...

development experience with Python and/or Java. Expertise in AWS, Docker, ECS/EKS (Kubernetes), and cloud-native microservices. Experience with Apache Kafka and event-driven architectures. Strong knowledge of GitLab CI/CD, Terraform, Infrastructure as Code, and Continuous Delivery. Proven ability to establish engineering standards, improve ...

automated test scripts if required, leveraging testing frameworks and tools to facilitate early detection of defects and quality issues. Hands-on experience with Apache Kafka, encompassing design, development, integration, and debugging. Hands on experience with MongoDB (CRUD, indexing, aggregation pipelines). Strong knowledge of MS SQL includes writing queries ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...