25 of 25 Permanent Kafka Jobs in the North of England

Scope Technologies: Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs, authentication, encryption 2. DevOps & Automation ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

technical discussions. Support testing, deployment and operational activities. Follow secure software development and DevOps practices. Essential Skills & Experience (Must Have) Java Spring Boot Kafka MongoDB API development and integration Basic understanding of Docker images and containers Unit Testing/TDD Gherkin-style BDD testing, preferably using Cucumber CI/ ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

/CD pipelines Exposure to cloud platforms (AWS, Azure or GCP) A passion for innovation and delivering high‐quality solutions Nice to have Kafka, SQS, Serverless (Lambda) Monitoring & logging tools (ELK, Dynatrace, Splunk) JPA/Hibernate, Swagger/OpenAPI, automated testing Mentoring experience 🔐 Security: Willingness to obtain ...

both systems and teams Confidence in collaborating with technical and non-technical stakeholders Additional experience (nice to have) Exposure to event-driven architectures (e.g. Kafka, RabbitMQ, SNS/SQS) Knowledge of Domain-Driven Design (DDD) Experience building resilient, scalable systems Familiarity with Infrastructure as Code tools such as Terraform ...

concepts (Prometheus, Grafana, ELK, etc.). Experience with test automation tools (JUnit, Cucumber, Selenium, Postman). Knowledge of messaging and streaming platforms (Kafka) and service mesh (Istio). Understanding of network protocols, security best practices, and compliance requirements for banking. Curiosity, adaptability, and a commitment to continuous improvement ...

Ability to diagnose and resolve performance issues Strong communication skills +AngularJS and AWS for the role in Leeds Nice to have Message queueing systems (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring tools (Dynatrace, ELK, Splunk) JPA/Hibernate Swagger/OpenAPI Testing tools (Selenium, Postman, etc.) Experience delivering ...

solutions using MLflow or integrating with cloud ML services. Experience in BFSI, Retail, Telecom, or Healthcare data environments. Experience with real-time data processing (Kafka, EventHub, Kinesis). Soft Skills Excellent communication and stakeholder management skills. Strong problem-solving and solution-oriented mindset. Ability to lead in a fast ...

data pipelines and distributed data platforms - Knowledge of AWS, Azure or GCP - Experience with Python, Java or Scala - Exposure to technologies such as Spark, Kafka, Airflow, dbt or Hadoop - Strong analytical and problem-solving skills - Excellent communication and stakeholder management - An entrepreneurial mindset with the desire to help build ...

modern cloud-native engineering practices and distributed systems. Key technologies include: AWS .NET 8/.NET Core Microservices Architecture Event-Driven Systems REST APIs Kafka EventBridge SNS/SQS ECS/EKS/Kubernetes Terraform CI/CD Pipelines GitHub Actions SQL & NoSQL Databases Domain Driven Design Observability & Monitoring ...

environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities: Low-Code ...

software development background with hands‐on experience in platform, infrastructure, or data‐centric environments Deep expertise in event‐driven architectures, streaming technologies (e.g. Apache Kafka, Flink, and/or Pulsar) Proficiency across full stack technologies (Java, .Net, React) with the ability to guide technical decisions Knowledge of hybrid/ ...

integrate, transform and manage data effectively. Strong experience building and delivering data pipelines using cloud platforms (AWS preferred) and big data tools like Kafka or Spark. Confident using Python (or PySpark) and SQL to process, transform and analyse data, and able to guide others in doing the same. Good ...

integrate, transform and manage data effectively. Strong experience building and delivering data pipelines using cloud platforms (AWS preferred) and big data tools like Kafka or Spark. Confident using Python (or PySpark) and SQL to process, transform and analyse data, and able to guide others in doing the same. Good ...

integrate, transform and manage data effectively. Strong experience building and delivering data pipelines using cloud platforms (AWS preferred) and big data tools like Kafka or Spark. Confident using Python (or PySpark) and SQL to process, transform and analyse data, and able to guide others in doing the same. Good ...

Python DBT Cloud techs such as Snowflake, BigQuery or Databricks Dimensional Modelling such as Kimball Desirable to have experience with: CI/CD pipelines Kafka; real-time streaming Snowflake as a data warehouse Interview Process: There are 4 stages to the process: A 30 minute discussion about experience ...

that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … Strong experience in data engineering or large-scale data platforms (3+ years) Proficiency in Java or Python Hands-on experience with streaming technologies (Kafka/Flink preferred) Good understanding of distributed systems and cloud platforms (AWS ideally) Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices ...

engineering experience, operating at Principal level Deep Java (Spring Boot) expertise in microservices environments Strong architecture experience across scalable, distributed systems Experience with messaging (Kafka/MQ), data modelling, and APIs Solid DevOps: CI/CD, containers, cloud platforms Hands‐on AI/ML experience and integrating AI into … Background in financial services (ideally Corporate Actions or post‐trade) Ability to influence without authority in complex organisations Tech stack Java, Spring Boot, Angular, Kafka, Oracle, Docker, CI/CD tooling A rare opportunity to build a critical platform from scratch while operating at the highest level of technical ...

Implement solutions for ISO 20022 message formats, transformations (XML/JSON), validations, and routing. Build integrations using Mule ESB (or similar), messaging patterns, and Kafka/event streams. Write performant SQL/PL‐SQL queries for Oracle‐based transactional systems. Contribute to system designs, code reviews, and technical discussions … collaborate in multi‐team delivery environments. Nice to Have Bachelor’s degree in Computer Science or related technical discipline. Certifications related to Java, Cloud, Kafka, MuleSoft, or SAFe. Experience with WebLogic/JBoss or other enterprise application servers. Background in payments platform modernisation or event‐driven systems. Familiarity with ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...

initiatives. This is an opportunity to work on large-scale projects, collaborate with international teams, and develop your expertise across MuleSoft, AWS, Kafka, APIs, and cloud technologies within a highly supportive environment that offers genuine long-term career progression. What You'll Be Doing Designing, developing, and supporting integrations … RESTful APIs Experience working with SQL and databases Exposure to AWS services such as S3, SNS, SQS, IAM, CloudWatch, or EventBridge Experience working with Kafka or similar messaging technologies Understanding of OAuth, JWT, and API security principles Strong communication skills and fluent English Desirable Experience Azure DevOps Integration certifications ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/MANCHESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Software Architect – Shape the Future of a High-Scale Platform Kafka, SQL, C#, .NET, Golang, GCP Are you ready to define and drive the architecture of a platform built to handle millions of transactions per second, powering international growth and long-term scalability? We’re embarking on a full … Define solution architecture and technical strategy for a complex, high-scale platform Own end-to-end design across distributed, event-driven systems (Kafka, SQL, cloud-native) Partner with product, engineering, and business stakeholders to translate vision into architecture Lead technical planning, standards, and best practices across multiple teams Provide ...