1 to 25 of 30 Permanent Kafka Jobs in the North of England

with data governance, quality, lineage, and security practices. \n \n Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). \n \n Strong proficiency in relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra). ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

technical discussions. Support testing, deployment and operational activities. Follow secure software development and DevOps practices. Essential Skills & Experience (Must Have) Java Spring Boot Kafka MongoDB API development and integration Basic understanding of Docker images and containers Unit Testing/TDD Gherkin-style BDD testing, preferably using Cucumber CI/ ...

with data governance, quality, lineage, and security practices. \n \n Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). \n \n Experience in, or knowledge of, DevSecOps Tooling and Processes. \n \n Self-starter with ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

power intelligent decision‐making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real‐time streaming pipelines and event‐driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed … junior engineers where needed. Qualification Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands-on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding ...

both systems and teams Confidence in collaborating with technical and non-technical stakeholders Additional experience (nice to have) Exposure to event-driven architectures (e.g. Kafka, RabbitMQ, SNS/SQS) Knowledge of Domain-Driven Design (DDD) Experience building resilient, scalable systems Familiarity with Infrastructure as Code tools such as Terraform ...

concepts (Prometheus, Grafana, ELK, etc.). Experience with test automation tools (JUnit, Cucumber, Selenium, Postman). Knowledge of messaging and streaming platforms (Kafka) and service mesh (Istio). Understanding of network protocols, security best practices, and compliance requirements for banking. Curiosity, adaptability, and a commitment to continuous improvement ...

Boot for building microservices Strong expertise with relational databases (Oracle) and data modelling expertise (canonical data models, JSON) Deep experience with enterprise messaging platforms (Kafka, IBM MQ) Proven experience implementing AI/ML solutions ( using Python or other frameworks) to solve business problems Full-stack development experience (RESTful APIs ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/ ...

solutions using MLflow or integrating with cloud ML services. Experience in BFSI, Retail, Telecom, or Healthcare data environments. Experience with real-time data processing (Kafka, EventHub, Kinesis). Soft Skills Excellent communication and stakeholder management skills. Strong problem-solving and solution-oriented mindset. Ability to lead in a fast ...

environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities: Low-Code ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

microservices, API design and DevOps practices. Hands on experience with conversational AI (Kore.AI and similar platforms), intelligent automation, and data heavy architectures (AWS, Kafka); familiarity with Adobe tools. Proven capability with modern development stacks (Java, .NET, Python, JavaScript frameworks), Agile/SAFe delivery methods, and build versus buy, vendor ...

software development background with hands‐on experience in platform, infrastructure, or data‐centric environments Deep expertise in event‐driven architectures, streaming technologies (e.g. Apache Kafka, Flink, and/or Pulsar) Proficiency across full stack technologies (Java, .Net, React) with the ability to guide technical decisions Knowledge of hybrid/ ...

Skills Significant demonstrable experience in one or both of: modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins); Significant demonstrable experience of leading engineering teams providing ...

Experience Significant demonstrable experience in one or both of: Modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins) Lead engineering teams Collaborative Working and leading ...

luxury tech brand. Bonus Points Prior experience in e‐commerce, marketplaces, or membership‐based platforms. Familiarity with event‐driven architectures and message queues (Kafka, SQS, etc). Experience working closely with design or product teams in consumer‐facing companies. Passion for fashion, luxury, or retail innovation. Why Join MILE ...

cloud environments thereby putting automation at the heart of everything. \n You will support complex application ecosystems including microservices, serverless workloads, event-driven integrations (Kafka), and Front End applications, ensuring environments are secure, cost-optimised, and compliant with organisational standards \n Key Responsibilities: \n * Build, support, and manage multiple … roles, MFA, access controls) in cloud environments \n * Experience supporting diverse application stacks including React Front End, microservices, serverless (Lambda), and event-driven systems (Kafka) \n * Strong experience managing CI/CD pipelines across distributed systems and cloud-native architecture \n * Awareness of accessibility requirements (eg, WCAG standards ...

Solution development and design \n 2. Strong/practised skills \n Back End Dev - RDBMS - Practitioner \n - Client \n - MongoDB (nice to have) \n Kafka integration \n Ansible (AAP 2.4/2.5) \n React \n AI development/co-development experience (GitLab Duo/Claude code) \n 3. SDLB ...

that power analytics and AI-driven decision making. What youll be doing Building and optimising scalable data pipelines using Java (primary) and technologies like Kafka, Flink, or Spark Developing real-time streaming solutions and event-driven architectures using AWS services (Kinesis, MSK, Lambda, Glue) Contributing to data architecture, modelling … Strong experience in data engineering or large-scale data platforms (3+ years) Proficiency in Java or Python Hands-on experience with streaming technologies (Kafka/Flink preferred) Good understanding of distributed systems and cloud platforms (AWS ideally) Experience with CI/CD, Docker, Kubernetes, and modern DevOps practices ...

customer base across Gaming and Sportsbook. What you’ll do Drive platform capability improvements - continuously enhance distributed data platforms using knowledge of Spark, Databricks, Kafka, Pulsar, Cassandra, and object stores to maintain best‐in‐class capabilities Enable application data consumption - understand how applications produce and consume data, designing solutions … access patterns, real‐time streaming, and batch processing for application needs Architect data streaming solutions - design and implement real‐time data streaming architectures using Kafka and Pulsar, ensuring low‐latency data delivery to downstream applications and services Design distributed data structures - work with engineering teams to design effective data ...

tools Required Experience 5+ years in professional Java backend development Core Tech Stack Java, Spring Boot, JPA/Hibernate, MySQL (or other RDBMS), Apache Kafka, Linux Preferred/Plus Tech Directed Acyclic Graphs, Graph Databases, FFmpeg, CI/CD systems, Spring Cloud, Swagger, Snowflake, Apache Doris, Debezium Application Materials … Management: Solid understanding of MySQL (or other major RDBMS) along with practical query‐tuning and optimisation experience. Data Streams: Hands‐on experience with Apache Kafka and building Change Data Capture (CDC) pipelines. Optimization: Proficient in Java performance profiling, memory management, and advanced debugging techniques. Environment: Comfortable working in Linux ...

initiatives. This is an opportunity to work on large-scale projects, collaborate with international teams, and develop your expertise across MuleSoft, AWS, Kafka, APIs, and cloud technologies within a highly supportive environment that offers genuine long-term career progression. What You'll Be Doing Designing, developing, and supporting integrations … RESTful APIs Experience working with SQL and databases Exposure to AWS services such as S3, SNS, SQS, IAM, CloudWatch, or EventBridge Experience working with Kafka or similar messaging technologies Understanding of OAuth, JWT, and API security principles Strong communication skills and fluent English Desirable Experience Azure DevOps Integration certifications ...