1 to 25 of 141 Kafka Jobs in the UK

Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible 1. Core Kafka Expertise (Must-Have) Kafka architecture: brokers, topics, partitions, replication Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft Topic & partition management, consumer groups Performance tuning, retention, throughput optimisation Cluster setup, upgrades, scaling and failover Troubleshooting (eg lag, ISR, leader issues) Security: SSL/TLS, ACLs, authentication, encryption 2. DevOps & Automation ...

working within Agile delivery environments. Excellent problem-solving and communication skills. Desirable Skills Experience with Docker and Kubernetes. Knowledge of messaging technologies such as Kafka or RabbitMQ. Exposure to DevOps practices and CI/CD tools including Jenkins or GitHub Actions. Understanding of API security frameworks including OAuth2 ...

optimise CI/CD pipelines, ensuring automated testing and deployment. Architecture Contribution: Contribute to event-driven and distributed system designs using technologies like Kafka or Event Hub. Mentorship: Guide junior developers and foster a collaborative atmosphere within a cross-functional agile team. Soft Skills A strong engineering mindset with ...

Azure DevOps. Knowledge of monitoring tools such as Prometheus, Grafana, or ELK Stack. Preferred Skills Experience with event-driven architectures. Experience with Kafka, RabbitMQ, or other messaging platforms. Exposure to distributed systems and high-volume transactional environments. Knowledge of gRPC and Protocol Buffers. Experience working in Agile/Scrum ...

microservices, distributed systems, and system design Experience designing and building RESTful APIs at scale Hands-on experience with: Hibernate/JPA Messaging systems (Kafka, RabbitMQ) Experience with cloud platforms ( AWS/Azure/GCP ) Strong knowledge of Docker, Kubernetes , and container orchestration Expertise in database design ( SQL & NoSQL ) Strong ...

delivering solutions. Desirable Experience with containerisation and orchestration tools such as Docker and Kubernetes. Familiarity with event-driven architecture and message brokers (e.g., Kafka, RabbitMQ). Knowledge of front-end performance optimisation and accessibility standards. Exposure to machine learning pipelines or data engineering workflows. Prior experience working in startup ...

environment). Comfortable working in Agile delivery teams with iterative releases and continuous improvement. Nice to Have Experience with event-driven architectures (e.g., Kafka or similar). Knowledge of observability practices (metrics, logging, tracing) and production monitoring. Experience improving performance and scalability in high-throughput systems. Understanding of secure ...

.* Experience with **React** and modern UI frameworks (Gradio, Streamlit).* Understanding of **REST/WebSocket APIs**, CI/CD pipelines, and messaging systems (Kafka, JMS/MQ).**Leadership & Delivery*** Proven ability to **build, coach, and scale** engineering teams.* Strong communication and stakeholder management skills.* Ability to lead ...

DevOps & Cloud: Hands-on experience with Kubernetes , Docker, Terraform, and CI/CD tools like Jenkins or GitHub Actions. Data & Messaging: Expert knowledge of Kafka , Apache Flink, PostgreSQL, Oracle, and Elasticsearch. Security: Deep understanding of OAuth 2.0, secure web services, and API gateway management. Candidate Profile Enterprise Experience: Proven ...

Java, Rust, JavaScript Cloud: AWS (Azure/GCP beneficial) Containers: Docker, Kubernetes, GPU containerisation Architecture: Microservices, serverless, APIs, edge compute, pub/sub systems (Kafka, MQTT) DevSecOps: Git, CI/CD, Terraform/Ansible, Linux scripting Proactive mindset, strong problem-solving skills, and ability to work independently ...

test-driven development, delivery automation and good software engineering practices. · Experience with message-driven architectures and event-driven systems would be beneficial. · Experience with Kafka, Kafka Streams or Kafka Connect would also be beneficial. · Experience working with applications deployed in Kubernetes environments would also be beneficial. ...

experience, specifically with Java 8+ (Java 11 or 17 preferred). Frameworks: Strong expertise in Spring Boot and Microservices architecture. Messaging: Proven experience with Kafka and its integrations. Databases: Proficiency in both SQL (Oracle, PostgreSQL) and NoSQL (Couchbase, Cassandra). Architecture: Experience with Event-driven Microservices and high-availability ...

using OAuth2/OIDC, session management, and fine-grained permissions. Design and maintain event-driven architectures and background processing pipelines (e.g. Celery, Redis Streams, Kafka) to enable scalable async workloads, retries, and fault-tolerant integrations. Design data models and optimise relational databases (PostgreSQL) for performance, partitioning, and horizontal scale. ...

Functions, SQS/SNS, etc.) FastAPI and NextJS experience (if we’re still using the latter) Websockets, Server‐Side Events, Pub/Sub (RabbitMQ, Kafka, etc.) Who You'll Work With Squad members of a specific squad, led by a Product Owner. Tribe Leaders, Product Owners, and other Chapter ...

Trading Systems: Expert knowledge of FIX protocol , Market Connectivity, and low-latency programming. Messaging & Data Middleware: Proficiency with middle-layer messaging (JMS, MQ, EMS, Kafka) and strong RDBMS concepts (Oracle, Sybase, MS SQL). Cloud & DevOps: Experience with Microservices, Containerization (Docker/Kubernetes), Unix/Linux scripting ...

have experience leading projects or teams, mentoring engineers, and operating in production environments. Experience with cloud platforms (AWS, GCP, Azure), Docker, Kubernetes, message queues (Kafka, RabbitMQ), and event-driven systems is highly desirable, along with exposure to AI/LLM integrations. You'll bring strong system design skills ...

Solid experience with SQL and data modelling concepts Strong analytical and problem-solving skills Nice to Have Skills Experience with data pipeline tools (Airflow, Kafka, Spark) Knowledge of cloud platforms (AWS, Azure or GCP) Familiarity with relational and NoSQL databases Additional programming experience (Python, Scala) Essential Requirements Active ...

Nice to Have Experience building cybersecurity or threat detection platforms Exposure to AI/ML security challenges and AI-driven security tooling Experience with Kafka, Pulsar, Splunk, or real-time streaming systems Golang expertise Experience contributing to open-source projects or internal developer platforms Knowledge of Microsoft Copilot ecosystem ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

quality, deciding when to leverage AI tools versus hands-on implementation. System & Event Architecture : Exposure to event-driven and publish-subscribe technologies such as Kafka, RabbitMQ or SNS/SQS. Testing Skills : Experience writing well-tested code and contributing to robust automated test suites. Collaboration & Communication : Comfortable working closely ...

Practice, and the GOV.UK Design System Desirable Experience leading Legacy modernisation, including strangler-pattern migrations away from Mainframe systems Experience with event-driven architectures (Kafka, EventBridge, SNS/SQS) Familiarity with accessibility standards (WCAG 2.2) and inclusive design Experience supporting services through GDS Alpha, Beta, and Live assessments Active ...

/version control systems - Active DV Clearance essential - Sole British National essential DESIRABLE EXPERIENCE - AWS, Azure or GCP within secure environments - Docker and Kubernetes - Kafka, Spark or additional data engineering technologies WHY APPLY? This is an opportunity to work on highly secure, technically advanced programmes within a complex ...

property graphs Hypergraph structures Entity resolution Graph schema design Data Engineering & Integration Pipeline Development Data Integration Languages & Tools ETL/ELT pipeline design Apache Kafka Apache Spark AWS Glue dbt Apache Airflow Entity matching and resolution Data lineage tracking Schema mapping Semantic data integration Metadata management Data quality frameworks ...

CentOS Windows Server and Active Directory VMware vSphere/ESXi Terraform and Ansible Docker and Kubernetes AWS or Azure Elasticsearch/Kibana MongoDB Apache Kafka Helm Concourse CI/CD Atlassian toolset (Jira, Confluence, Bitbucket) Infrastructure as Code (IaC) Networking and infrastructure monitoring TOGAF or MODAF architecture frameworks Enterprise ...

Essential Skills & Experience Strong experience in Java development, including: Core Java Spring Boot frameworks Proven experience building distributed backend systems Hands-on experience with Kafka (or similar streaming platforms) Experience with Scala and Apache Spark for data processing Integration withbackend services such as: PostgreSQL Redis S3 (or equivalent object ...