11 of 11 Kafka Jobs in the North West

systems Experience integrating with third-party APIs End-to-end ownership of systems (design build operate) Technical Expertise Event-driven architecture (EventBridge, SQS, SNS, Kafka) Reliability patterns (retries, idempotency, DLQs) Observability and debugging in distributed systems Data modelling and schema evolution Leadership & Collaboration Ability to lead technical design ...

Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) Experience with big data technologies such as Spark, Hadoop, or Kafka Proficiency with ETL/ELT tools and frameworks (e.g. Airflow, dbt, Informatica) Strong programming skills in Python, Java, Scala, or similar Experience implementing data ...

operate real-time IoT data ingestion pipelines handling telemetry, logs, and events from thousands of devices. Implement processing workflows using Kinesis, Lambda, SQS, Kafka, Step Functions , or similar. Ensure data quality, schema governance, and reliability across ingestion and downstream data consumers. API Development Build and maintain RESTful and GraphQL ...

with large, imperfect datasets Experience in product-led or scale-up environments Engineers who take ownership and enjoy solving complex problems Nice to have Kafka, Hadoop, Cassandra, Redis or similar Experience with real-time or event-driven systems Exposure to recommendation systems, ML or data-driven products Cloud experience ...

evidence your clearance) Required Skills & Experience Strong experience designing modern cloud-based data platforms. Hands-on architectural experience with: AWS (essential): S3, EMR, Glue Kafka/event streaming architectures Python & PySpark-based data processing Experience designing data ingestion pipelines (batch and real-time). Proficiency in Infrastructure as Code ...

Python DBT Cloud techs such as Snowflake, BigQuery or Databricks Dimensional Modelling such as Kimball Desirable to have experience with: CI/CD pipelines Kafka; real-time streaming Snowflake as a data warehouse Interview Process: There are 4 stages to the process: A 30 minute discussion about experience ...

regulated data Desirable Experience Experience working with healthcare data standards (e.g. FHIR, HL7) Exposure to real-time data processing or streaming tools (e.g. Kafka) Familiarity with data governance, security, and compliance frameworks in healthcare Experience supporting analytics or machine learning workloads Apply Now If you’re a contract Data ...

Data Engineer up to £90,000 + Benefits Manchester (Hybrid) This is a great opportunity to join a high-growth adtech scale-up where you can take ownership of large-scale data infrastructure that directly ...

driving engineering direction across a large-scale distributed system. What you’ll do Design and build Java (Spring Boot) microservices Architect event-driven systems (Kafka/messaging) Apply AI/ML to real-world business problems Work with modern development tooling, including AI-assisted environments Influence technical direction … Principal/Staff/Architect level Strong Java and distributed systems background Hands-on AI/ML experience (Python or similar) Experience with Kafka or MQ, SQL/Oracle, cloud and containerisation Nice to have Financial services experience (post-trade, custody, corporate actions, trading ...

ingestion, processing, and access layers Design scalable, resilient data platforms (hub-and-spoke, lake/lakehouse) Lead implementation of batch and real-time pipelines (Kafka, APIs, SFTP) Architect solutions using: AWS (S3, EMR, Glue) PySpark/Python Support cloud migrations and platform modernisation Ensure best practices in CI/… Required Experience Active SC Clearance (essential) Strong experience with AWS data platforms (S3, EMR, Glue) Expertise in data lake/lakehouse architectures Experience with Kafka/event-driven architectures Strong Python & PySpark skills Experience with Terraform and CI/CD pipelines Proven track record designing large-scale data solutions ...

Senior Data Engineer - Manchester (Hybrid) - £80,000 + bonus The Company Our client is undergoing a significant digital transformation, modernising their data platform to better support high-volume, real-time products and analytics. This is ...