25 of 25 Kafka Jobs in the North of England

/enterprise settings. Desirable Skills Experience with public sector or GDS-aligned projects. Knowledge of Docker, Kubernetes, or containerised environments. Exposure to messaging technologies (Kafka, SNS/SQS, RabbitMQ). Understanding of monitoring/logging tools (ELK, Grafana, Prometheus). Additional Information Role is Inside IR35 payable via umbrella. ...

Java development experience Deep expertise in Spring Framework and microservices architecture Proven ability to mentor and develop engineering talent Strong background in messaging systems (Kafka, RabbitMQ) Proficiency with AWS, Docker, SQL/NoSQL, and automated testing Experience in Agile environments with a DevOps mindset Mindset & Skills Ownership mentality with ...

transformation tasks across the engineering team Programmatically ingest large volumes of structured and unstructured data from REST APIs, streaming platforms (e.g. Event Hubs, Kafka), and legacy databases into ADLS Gen2 and OneLake Develop structured data models aligned to Lakehouse, Medallion Architecture, and Delta Lake patterns Continuously profile, debug ...

infrastructure teams Technical Skills Architecture & Design: Microservices, event-driven architecture, domain-driven design (DDD), layered architecture Integration: RESTful APIs, OpenAPI specs, messaging systems (Kafka, MQ), asynchronous processing Cloud & Infrastructure: Cloud-native design, containerisation (Docker, Kubernetes), CI/CD pipelines Data: Distributed data systems, RDBMS/NoSQL, data modelling, data ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/ ...

integrating with third-party APIs End-to-end ownership of systems (design/build/operate) Technical Expertise Event-driven architecture (EventBridge, SQS, SNS, Kafka) Reliability patterns (retries, idempotency, DLQs) Observability and debugging in distributed systems Data modelling and schema evolution Leadership & Collaboration Ability to lead technical design ...

power intelligent decision-making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed ...

platforms Experience owning systems end-to-end (design, delivery, operation, and iteration) Technical Expertise Event-driven architectures and messaging systems (e.g. EventBridge, SQS, SNS, Kafka) Designing for failure retries, idempotency, backoff strategies, DLQs Observability, monitoring, and debugging in distributed systems Data modelling, transformation, and schema evolution across systems Leadership ...

NoSQL databases. Secure development practices. Git-based source control. Knowledge of CI automation systems such as Jenkins Bonus points for: Event streaming (e.g. Kafka, Kinesis) and change data capture (CDC). Messaging (e.g. RabbitMQ, SQS). Docker and Kubernetes. Solution and architecture design. Test-driven development (TDD). ...

systems Experience integrating with third-party APIs End-to-end ownership of systems (design build operate) Technical Expertise Event-driven architecture (EventBridge, SQS, SNS, Kafka) Reliability patterns (retries, idempotency, DLQs) Observability and debugging in distributed systems Data modelling and schema evolution Leadership & Collaboration Ability to lead technical design ...

systems Experience integrating with third-party APIs End-to-end ownership of systems (design build operate) Technical Expertise Event-driven architecture (EventBridge, SQS, SNS, Kafka) Reliability patterns (retries, idempotency, DLQs) Observability and debugging in distributed systems Data modelling and schema evolution Leadership & Collaboration Ability to lead technical design ...

operate real-time IoT data ingestion pipelines handling telemetry, logs, and events from thousands of devices. Implement processing workflows using Kinesis, Lambda, SQS, Kafka, Step Functions , or similar. Ensure data quality, schema governance, and reliability across ingestion and downstream data consumers. API Development Build and maintain RESTful and GraphQL ...

companies You are degree educated, Computer Science or similar tech or numerate discipline You're collaborative with great communication skills Nice to haves: Databricks, Kafka, Data Governance (GRC) What's in it for you: As a Data Engineer (Python ETL SaaS) you will earn a competitive package ...

role: SQL Server MS SSIS T-SQL Azure Data Factory Visual Studio Strong written & verbal communication Desirables: Python Azure Synapse/Databricks Flink/Kafka The role will be on a hybrid working basis with 3 days per week in the Liverpool office. The role is commutable from ...

testing data platforms such as Snowflake, BigQuery, Redshift, Databricks, Azure Synapse Experience of testing pipelines in things like Airflow, Azure Data Factory, AWS Glue, Kafka Data Concepts ETL/ELT, data modelling, data warehousing, data governance The role is 100% remote, however you must be based ...

building data pipelines and platforms end-to-end. Hands on engineering across ingestion, transformation and data centralisation. Experience with tools such as Glue, Fivetran, Kafka, Dataflow, ADF or Kinesis. Transformation experience using dbt, Spark or Databricks. Confidence working directly with clients and engaging in technical discussions. Exposure to dashboards ...

building data pipelines and platforms end-to-end. Hands on engineering across ingestion, transformation and data centralisation. Experience with tools such as Glue, Fivetran, Kafka, Dataflow, ADF or Kinesis. Transformation experience using dbt, Spark or Databricks. Confidence working directly with clients and engaging in technical discussions. Exposure to dashboards ...

Implement solutions for ISO 20022 message formats , transformations (XML/JSON), validations, and routing. Build integrations using Mule ESB (or similar), messaging patterns, and Kafka/event streams . Write performant SQL/PL‐SQL queries for Oracle‐based transactional systems. Contribute to system designs, code reviews, and technical … volume systems. Solid understanding of XML/JSON structures and message mapping/transformation. Experience with Mule ESB or equivalent middleware , messaging tools, and Kafka . Strong understanding of Agile delivery, CI/CD pipelines, and DevOps practices. Skilled in unit/integration testing frameworks (JUnit, Cucumber/Litmus ...

planning and data archiving/housekeeping Familiarity with Cloud platforms and serverless architectures Understanding of software design patterns and their practical application Exposure to Kafka (advantageous) Experience working in Agile/DevOps environments Ability to mentor junior team members Experience supporting live production environments ...

Design and implement Real Time and batch data pipelines to support fraud detection and operational decision-making. Develop event-driven solutions using Kafka, Flink, and data transformation frameworks such as PySpark or Pandas. Write maintainable, high-quality Python or Java code with strong SQL capabilities. Build and manage cloud … with AWS, SQL, Python, and PySpark, including building cloud infrastructure using IaC (CloudFormation/Terraform). Hands-on experience with streaming frameworks such as Kafka and Flink. Familiarity with data quality frameworks (eg, Great Expectations) and graph databases is a plus. Agile development experience (Scrum preferred), with strong code ...

working with relational databases such as PostgreSQL or Microsoft SQL Server Experience working with NoSQL technologies such as DynamoDB, MongoDB or similar Hands-on Kafka (or equivalent streaming) and workflow orchestration (Airflow) experience Strong understanding of data architecture patterns including data lakes, warehouses and event-driven architectures Experience … maintainable Design, develop and deploy ETL/ELT pipelines to ingest, transform and optimise large-scale datasets Build and operate event-driven architectures (Kafka) and orchestrate workflows (Airflow) Apply strong data architecture principles across data lakes, warehouses and event-driven solutions Develop and maintain streaming pipelines using technologies such ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled Data … Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed ...

container-related issues in production environments Implement and maintain monitoring, alerting, and logging solutions Support operational aspects of platforms such as: MongoDB, PostgreSQL, Apache Kafka, OpenSearch Required Skills & Experience Experience working in a DevOps or Platform Engineering role Strong knowledge of Linux and working knowledge of Windows Hands … PowerShell Familiarity with monitoring, alerting, and incident management practices Desirable Skills: Experience with GitOps tooling (Argo CD) Experience with Bamboo and Bitbucket Knowledge of Kafka, MongoDB, or PostgreSQL operations Experience operating OpenSearch or similar logging platforms Understanding of cloud security and access control (RBAC, secrets ...

Solution Architect – Shape the Future of a High-Scale Platform Kafka, SQL, C#, .NET, Golang, TypeScript Are you ready to define and drive the architecture of a platform built to handle millions of transactions per second, powering international growth and long-term scalability? We’re embarking on a full … Define solution architecture and technical strategy for a complex, high-scale platform Own end-to-end design across distributed, event-driven systems (Kafka, SQL, cloud-native) Partner with product, engineering, and business stakeholders to translate vision into architecture Lead technical planning, standards, and best practices across multiple teams Provide ...

controls (RBAC, retention, PII handling, TLS, token governance, index and role mapping) Integrate telemetry pipelines including OpenTelemetry, Prometheus, Fluentd/Fluent Bit/Vector, Kafka, CMDB and AIOps/ML solutions Drive SLO/KPI alignment, golden signal monitoring, rollout/rollback health validation, and executive reporting What … events, logs, workload correlation, and capacity management Hands-on experience with telemetry pipelines (OpenTelemetry/OTLP, Prometheus exporters, Fluentd/Fluent Bit/Vector, Kafka with TLS, HEC/UF/DS onboarding) Strong understanding of reliability engineering principles (golden signals, SLO design, namespace/application KPI mapping) Experience ...