1 to 25 of 36 Permanent Kafka Jobs in the North of England

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

technical discussions. Support testing, deployment and operational activities. Follow secure software development and DevOps practices. Essential Skills & Experience (Must Have) Java Spring Boot Kafka MongoDB API development and integration Basic understanding of Docker images and containers Unit Testing/TDD Gherkin-style BDD testing, preferably using Cucumber CI/ ...

teams and contribute to engineering best practices Skills & Experience * 3+ years' commercial experience in Data Engineering * Strong Java or Python development skills * Experience with Kafka, Flink or Spark * Experience building ETL/ELT or streaming data pipelines * Knowledge of AWS (Azure or GCP also considered) * Experience with Docker, Kubernetes ...

both systems and teams Confidence in collaborating with technical and non-technical stakeholders Additional experience (nice to have) Exposure to event-driven architectures (e.g. Kafka, RabbitMQ, SNS/SQS) Knowledge of Domain-Driven Design (DDD) Experience building resilient, scalable systems Familiarity with Infrastructure as Code tools such as Terraform ...

Boot for building microservices Strong expertise with relational databases (Oracle) and data modelling expertise (canonical data models, JSON) Deep experience with enterprise messaging platforms (Kafka, IBM MQ) Proven experience implementing AI/ML solutions (using Python or other frameworks) to solve business problems Full‐stack development experience (RESTful APIs ...

architectures that power intelligent decision making. Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed services (e.g., Data Architecture & Standards Contribute to data modelling, data architecture ...

enterprise API integrations, and implementing agentic guardrails. Data Engineering (30%): Practical experience implementing components of data pipelines, including real-time streaming tools (AWS Kinesis, Kafka), data orchestration (dbt, Airflow), and managing vector databases for RAG architectures. Observability & Cost Management: SRE/Platform experience with the practical application of real ...

enterprise API integrations, and implementing agentic guardrails. Data Engineering (30%): Practical experience implementing components of data pipelines, including real-time streaming tools (AWS Kinesis, Kafka), data orchestration (dbt, Airflow), and managing vector databases for RAG architectures. Observability & Cost Management: SRE/Platform experience with the practical application of real ...

power intelligent decision making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real time streaming pipelines and event driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed … junior engineers where needed. Qualification Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands-on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/ ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/ ...

Boot for building microservices Strong expertise with relational databases (Oracle) and data modelling expertise (canonical data models, JSON) Deep experience with enterprise messaging platforms (Kafka, IBM MQ) Proven experience implementing AI/ML solutions ( using Python or other frameworks) to solve business problems Full-stack development experience (RESTful APIs ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

Native Observability, Prometheus, Grafana, OpenTelemetry, Wiz, HashiCorp Vault, and CheckMarxOne or similar tools. Strong working knowledge of platform and data technologies including PostgreSQL, Redis, Kafka, Ping and/or Keycloak IAM, Kong APIM, Cloudflare, and application security best practices. What's in it for you? At TransUnion you will ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

software development background with hands‐on experience in platform, infrastructure, or data‐centric environments Deep expertise in event‐driven architectures, streaming technologies (e.g. Apache Kafka, Flink, and/or Pulsar) Proficiency across full stack technologies (Java, .Net, React) with the ability to guide technical decisions Knowledge of hybrid/ ...

luxury tech brand. Bonus Points Prior experience in e‐commerce, marketplaces, or membership‐based platforms. Familiarity with event‐driven architectures and message queues (Kafka, SQS, etc). Experience working closely with design or product teams in consumer‐facing companies. Passion for fashion, luxury, or retail innovation. Why Join MILE ...

multi-agent and event-driven orchestration architectures. Full-stack engineering capability with architectural ownership, including front-end (Angular or equivalent), middleware/event streaming (Kafka, JMS, RabbitMQ), and relational data platforms (Oracle/MySQL), enabling end-to-end platform design and optimisation. Proven track record of delivering production-grade ...

engineering direction and standards across the platform. Full-stack engineering capability with architectural ownership, including front-end (Angular or equivalent), middleware/event streaming (Kafka, JMS, RabbitMQ), and relational data platforms (Oracle/MySQL), enabling end-to-end platform design and optimisation. Proven track record of delivering production-grade ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake) Testing frameworks and best practices ...

Skills Significant demonstrable experience in one or both of: modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins); Significant demonstrable experience of leading engineering teams providing ...

Engineer Significant demonstrable experience in one or both of: Modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins) Lead engineering teams Collaborative Working and leading ...

such as Jira, Confluence, GitHub Exposure to BDD/TDD practices Awareness of accessibility standards and inclusive design Experience or interest in AWS, Kubernetes, Kafka, Postgres Life at BAE Systems Digital Intelligence We are embracing Hybrid Working. This means you and your colleagues may be working in different locations ...

bring an excellent understanding of implementing programming best practices, especially around scalability, availability and performance Java and AWS are used, as well as Kafka for real‐time You’ll also need A strong background in leading software development teams (20+ member teams), introducing and executing technical strategies Knowledge ...