1 to 25 of 274 Permanent Kafka Jobs in the UK

Scope Technologies: Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs, authentication, encryption 2. DevOps & Automation ...

Scope Technologies: Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs, authentication, encryption 2. DevOps & Automation ...

distributed systems Experience designing and developing REST APIs Strong knowledge of Hibernate/JPA and relational database design Experience with messaging systems such as Kafka or RabbitMQ Hands-on experience with cloud platforms (AWS, Azure, or GCP) Experience with Docker and Kubernetes Strong database experience with PostgreSQL, MySQL, MongoDB ...

desirable Knowledge of containerisation (Docker, Kubernetes) desirable Strong problem-solving skills and attention to detail Nice to Have Experience with messaging systems (Kafka, RabbitMQ, ActiveMQ) Knowledge of investment banking, retail banking, or payments domain Familiarity with regulatory frameworks (FCA, Basel III, MiFID II) Experience with Agile methodologies (Scrum, SAFe ...

desirable Knowledge of containerisation (Docker, Kubernetes) desirable Strong problem-solving skills and attention to detail Nice to Have Experience with messaging systems (Kafka, RabbitMQ, ActiveMQ) Knowledge of investment banking, retail banking, or payments domain Familiarity with regulatory frameworks (FCA, Basel III, MiFID II) Experience with Agile methodologies (Scrum, SAFe ...

delivering solutions. Desirable Experience with containerisation and orchestration tools such as Docker and Kubernetes. Familiarity with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of front-end performance optimisation and accessibility standards. Exposure to machine learning pipelines or data engineering workflows. Prior experience working in startup ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

logging, distributed tracing, metrics, and alerting hygiene. Desirable Qualifications and Skills Insurance or Insurtech domain knowledge — Policy Administration, Claims, or Underwriting workflows. Familiarity with Kafka or event-streaming patterns (producing, consuming, DLQs, retries) at design-ownership level. Knowledge of containerisation and orchestration: Docker, Kubernetes/AKS, including capacity ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

tasks. Experience with cloud platforms such as: AWS, Azure, Google Cloud Platform (GCP) Hands-on experience with data technologies such as: Apache Spark, Databricks, Kafka, Airflow, Snowflake, Hadoop ecosystems Experience designing and maintaining data warehouses and data lakes. Knowledge of DevOps and CI/CD tooling (e.g. Git, Jenkins ...

disabilities to perform the essential functions. Professional Experience Very desirable is experience with Agentic AI in a ELT/ETL capacity (Preferred) Exposure to Kafka or streaming platforms from an infrastructure or operational perspective (Preferred) Experience with observability tooling (logging, metrics, alerting) for cloud platforms (Preferred) Understanding of FinOps ...

DevOps tools Bonus Points For Terraform, CloudFormation, or other infrastructure-as-code tools Experience with serverless functions (AWS Lambda, Azure Functions) Messaging systems like Kafka or RabbitMQ Familiarity with security protocols such as OAuth2 and SAML QA automation and integration with third-party platforms Why Join Capco ...

testing and version control. Data Engineering Stack Experience building pipelines using streaming frameworks, distributed processing engines and relational or analytical storage technologies. Examples include Kafka, Spark, PostgreSQL. Orchestration Experience defining and running data workflows using modern orchestration frameworks. Examples include Airflow, Dagster or Prefect. Data Quality and Lineage Familiarity ...

Java, Rust, JavaScript Cloud: AWS (Azure/GCP beneficial) Containers: Docker, Kubernetes, GPU containerisation Architecture: Microservices, serverless, APIs, edge compute, pub/sub systems (Kafka, MQTT) DevSecOps: Git, CI/CD, Terraform/Ansible, Linux scripting Proactive mindset, strong problem-solving skills, and ability to work independently ...

testing, and containerisation Strong problem-solving and communication skills Technology Stack Python, SQL, FastAPI, PyTorch, Transformers/LLMs, Terraform, Databricks, Kubernetes, AWS, Azure, PostgreSQL, Kafka, Git, CI/CD, Knowledge Graphs What's on Offer Fully remote working within the UK Opportunity to work on cutting-edge ...

pipeline orchestration tools Containerisation (Docker, EKS, AKS, Kubernetes) Proficiency in CI/CD principles and tools Familiarity with open-source data tools (e.g., Spark, Kafka, PostgreSQL) Infrastructure as Code (Terraform, Ansible) Air-gapped development Automation Client/stakeholder management Public sector domain understanding Technical architecture Experience: You will have ...

automated test scripts if required, leveraging testing frameworks and tools to facilitate early detection of defects and quality issues. Hands-on experience with Apache Kafka, encompassing design, development, integration, and debugging. Hands on experience with MongoDB (CRUD, indexing, aggregation pipelines). Strong knowledge of MS SQL includes writing queries ...

architectures. Cloud Platforms Deep knowledge of AWS/GCP/Azure services. Databases Proficiency with PostgreSQL, Redis, MongoDB, or similar. Messaging Systems Experience with Kafka, RabbitMQ, or event-streaming platforms. CI/CD Strong understanding of automated testing, deployment pipelines, and observability. Leadership Proven ability to lead teams, influence ...

banking or financial services, particularly front‐office systems Experience with cloud platforms (AWS, GCP, or Azure) Familiarity with containerisation technologies (Docker, Kubernetes) Experience with Kafka or similar messaging/event platforms Understanding of distributed systems design and immutable event patterns Experience with observability, monitoring, and incident response tools Exposure ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

environments What we’re looking for: Strong Python development and software engineering experience Experience building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised ...

environments What we’re looking for: Strong Python development and software engineering experience Experience building scalable data pipelines and distributed data platforms Knowledge of Kafka, Spark and modern data processing technologies Experience with orchestration tools such as Airflow, Dagster or Prefect Hands-on experience with Docker, Kubernetes and containerised ...

technical discussions. Support testing, deployment and operational activities. Follow secure software development and DevOps practices. Essential Skills & Experience (Must Have) Java Spring Boot Kafka MongoDB API development and integration Basic understanding of Docker images and containers Unit Testing/TDD Gherkin-style BDD testing, preferably using Cucumber CI/ ...