17 of 17 Kafka Jobs in the North of England

Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible 1. Core Kafka Expertise (Must-Have) Kafka architecture: brokers, topics, partitions, replication Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft Topic & partition management, consumer groups Performance tuning, retention, throughput optimisation Cluster setup, upgrades, scaling and failover Troubleshooting (eg lag, ISR, leader issues) Security: SSL/TLS, ACLs, authentication, encryption 2. DevOps & Automation ...

working within Agile delivery environments. Excellent problem-solving and communication skills. Desirable Skills Experience with Docker and Kubernetes. Knowledge of messaging technologies such as Kafka or RabbitMQ. Exposure to DevOps practices and CI/CD tools including Jenkins or GitHub Actions. Understanding of API security frameworks including OAuth2 ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

microservices, API design and DevOps practices. Hands on experience with conversational AI (Kore.AI and similar platforms), intelligent automation, and data heavy architectures (AWS, Kafka); familiarity with Adobe tools. Proven capability with modern development stacks (Java, .NET, Python, JavaScript frameworks), Agile/SAFe delivery methods, and build versus buy, vendor ...

design and shape modern, scalable architectures that support critical government services. Experience Cloud & architecture expertise - strong AWS architecture experience, including event-driven systems (e.g. Kafka) and RESTful API design. Data & public sector experience - experience with document-based databases (e.g. MongoDB) and a solid understanding of public sector governance ...

tooling such as Co-Pilot, Claude, OpenCode, or Mistral Experience building agentic AI workflows in enterprise environments Kubernetes and event-driven architecture experience, including Kafka and Google Pub/Sub Public cloud agnostic engineering experience Strong stakeholder engagement and technical leadership capability Additional information available on successful application. ...

Data Engineer (Streaming) – Requirements Strong coding in Java (preferred) or Python Experience with Kafka, Flink, or Spark (Flink/Kafka ideal) Solid understanding of stream processing (event time, state, backpressure) Experience building ETL/ELT or real-time data pipelines Knowledge of microservices and distributed systems Tech & Cloud ...

expertise in C#, PowerShell scripting, WebAPI, and JSON/API integration Solid experience in backend development with MSSQL (MongoDB desirable) Hands-on experience with Kafka, Ansible (AAP 2.4/2.5), and DevOps tooling (Git, Jenkins, Confluence) Exposure to AI-assisted development (e.g. GitLab Duo, Claude) Good understanding of SDLC ...

Experience testing in cloud-based environments including, deployments and configuration of CI/CD pipelines for test runs. Experiences with Grafana, RabitMQ or Apache Kafka, API testing, Kubernetes and SQL databases. Please apply now to be considered for this position. ...

testing data platforms such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data governance The role is 100% remote, however you must be based ...

that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … Strong experience in data engineering or large-scale data platforms (3+ years) Proficiency in Java or Python Hands-on experience with streaming technologies (Kafka/Flink preferred) Good understanding of distributed systems and cloud platforms (AWS ideally) Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices ...

engineering experience, operating at Principal level Deep Java (Spring Boot) expertise in microservices environments Strong architecture experience across scalable, distributed systems Experience with messaging (Kafka/MQ), data modelling, and APIs Solid DevOps: CI/CD, containers, cloud platforms Hands‐on AI/ML experience and integrating AI into … Background in financial services (ideally Corporate Actions or post‐trade) Ability to influence without authority in complex organisations Tech stack Java, Spring Boot, Angular, Kafka, Oracle, Docker, CI/CD tooling A rare opportunity to build a critical platform from scratch while operating at the highest level of technical ...

forward. Tech Environment: The stack includes technologies such as: Kubernetes Linux CI/CD pipelines GitOps/Argo CD Bitbucket & Bamboo MongoDB/PostgreSQL Kafka OpenSearch Bash/PowerShell scripting Cloud infrastructure Theyre open to candidates from DevOps, Platform Engineering, SRE, Cloud Engineering, or strong Infrastructure backgrounds. What Theyre … cloud-hosted infrastructure Kubernetes/container experience Scripting/automation experience Understanding of monitoring, logging, and operational support Experience with GitOps, Argo CD, Kafka, or database platforms would be beneficial but isnt essential. In return the Company offers: A competitive salary and benefits package Modern engineering environment Strong focus ...

Data Engineer Salary up to £70,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via ABOUT THE CLIENT Due to continued growth, we're seeking a skilled Data Engineer … Lakehouse environment. You'll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...

container-related issues in production environments Implement and maintain monitoring, alerting, and logging solutions Support operational aspects of platforms such as MongoDB, PostgreSQL, Apache Kafka, and OpenSearch Required Skills & Experience: Experience in a DevOps or Platform Engineering role Strong Linux knowledge and working knowledge of Windows Hands-on experience … Familiarity with monitoring, alerting, and incident management practices Desirable Skills: Experience with GitOps tooling (e.g., Argo CD) Experience with Bamboo and Bitbucket Knowledge of Kafka, MongoDB, or PostgreSQL operations Experience operating OpenSearch or similar logging platforms Understanding of cloud security and access control (RBAC, secrets) This is an exciting ...

Months 2 days p/w in the office, 3 days WFH Location is Manchester Must have C#, MS SQL, PowerShell, API's, Kafka Join a high-performing engineering team responsible for delivering critical cyber and infrastructure solutions across the organisation. You'll play a key role in designing … C# and Web APIs. Proven expertise with SQL Server and database-driven application development. Experience with PowerShell scripting, automation and DevOps practices. Knowledge of Kafka, Ansible and modern CI/CD toolchains. Familiarity with Agile delivery methodologies and software development lifecycle best practices. Understanding of software design principles, data ...