19 of 19 Permanent Kafka Jobs in the North West

containerized solutions DevOps Tools Jenkins GitLab and integration with various CICD tools Application Design APIfirst and event driven architectures and prior handson experience with Kafka ecosystem Observability Monitoring Familiarity with tools for logging metrics and tracing specially ELK and observe tools Your Skills: Excellent written and verbal communication ...

systems (e.g. C#/.NET to Go) Exposure to containerisation (Docker, Kubernetes) Experience in public sector or highly regulated environments Familiarity with event streaming (Kafka, SNS/SQS, etc.) Why This Contract Stands Out | Senior Go Backend Engineer (B2B, Contract) | Golang, AWS, SQL, Distributed Systems | Large-Scale Migration Programme ...

transformation tasks across the engineering team Programmatically ingest large volumes of structured and unstructured data from REST APIs, streaming platforms (e.g. Event Hubs, Kafka), and legacy databases into ADLS Gen2 and OneLake Develop structured data models aligned to Lakehouse, Medallion Architecture, and Delta Lake patterns Continuously profile, debug ...

systems Experience integrating with third-party APIs End-to-end ownership of systems (design build operate) Technical Expertise Event-driven architecture (EventBridge, SQS, SNS, Kafka) Reliability patterns (retries, idempotency, DLQs) Observability and debugging in distributed systems Data modelling and schema evolution Leadership & Collaboration Ability to lead technical design ...

integrating with third-party APIs End-to-end ownership of systems (design/build/operate) Technical Expertise Event-driven architecture (EventBridge, SQS, SNS, Kafka) Reliability patterns (retries, idempotency, DLQs) Observability and debugging in distributed systems xkybehq Data modelling and schema evolution Leadership & Collaboration Ability to lead technical design ...

Hands-on experience with at least one major cloud platform (Azure, AWS, or GCP) Experience with big data technologies such as Spark, Hadoop, or Kafka Proficiency with ETL/ELT tools and frameworks (e.g. Airflow, dbt, Informatica) Strong programming skills in Python, Java, Scala, or similar Experience implementing data ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL databases and storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/ ...

NoSQL databases. Secure development practices. Git-based source control. Knowledge of CI automation systems such as Jenkins Bonus points for: Event streaming (e.g. Kafka, Kinesis) and change data capture (CDC). Messaging (e.g. RabbitMQ, SQS). Docker and Kubernetes. Solution and architecture design. Test-driven development (TDD). ...

Software Engineer – FinTech – Manchester 🚀 💰Up to £90,000 🏡Hybrid working – Manchester based 💻Java, Spring Boot, Kafka We’re partnered with a leading FinTech business who are now looking for a Software Engineer to join their team as they continue to build new products. The business works on large-scale ...

operate real-time IoT data ingestion pipelines handling telemetry, logs, and events from thousands of devices. Implement processing workflows using Kinesis, Lambda, SQS, Kafka, Step Functions , or similar. Ensure data quality, schema governance, and reliability across ingestion and downstream data consumers. API Development Build and maintain RESTful and GraphQL ...

role: SQL Server MS SSIS T-SQL Azure Data Factory Visual Studio Strong written & verbal communication Desirables: Python Azure Synapse/Databricks Flink/Kafka The role will be on a hybrid working basis with 3 days per week in the Liverpool office. The role is commutable from ...

Python DBT Cloud techs such as Snowflake, BigQuery or Databricks Dimensional Modelling such as Kimball Desirable to have experience with: CI/CD pipelines Kafka; real-time streaming Snowflake as a data warehouse Interview Process: There are 4 stages to the process: A 30 minute discussion about experience ...

GitHub Hands-on expertise integrating Azure AI/ML/OpenAI, with knowledge of real-time data streaming technologies such as Event Hub and Kafka Proven capability in enterprise BI environments (Power BI, Qlik), MLOps practices, and Azure cloud architecture design Demonstrated team leadership skills, with relevant certifications such ...

scalability into everything we build. What You’ll Do Own the solution architecture for a large-scale, distributed, event-driven platform Design systems using Kafka, SQL, and cloud-native patterns (AWS/GCP) Lead technical strategy, standards, and key architectural decisions Partner with product and engineering leaders to turn ...

Implement solutions for ISO 20022 message formats , transformations (XML/JSON), validations, and routing. Build integrations using Mule ESB (or similar), messaging patterns, and Kafka/event streams . Write performant SQL/PL‐SQL queries for Oracle‐based transactional systems. Contribute to system designs, code reviews, and technical … volume systems. Solid understanding of XML/JSON structures and message mapping/transformation. Experience with Mule ESB or equivalent middleware , messaging tools, and Kafka . Strong understanding of Agile delivery, CI/CD pipelines, and DevOps practices. Skilled in unit/integration testing frameworks (JUnit, Cucumber/Litmus ...

Manchester (Hybrid) | Digital Transformation Consultancy Location : Manchester (Hybrid - 3 days a week) Package : £60k-£70k + Benefits Python | Cloud (AWS/Azure/GCP) | Kafka | Airflow | PostgreSQL | Observability This client builds mission‐critical digital platforms that make the UK smarter, safer, greener and healthier. They are a growing digital … Doing Design and implement scalable ETL/ELT pipelines and data models for enterprise platforms Build and operate event‐driven architectures (Kafka) and orchestrate workflows (Airflow) Implement data quality, testing and validation as first‐class concerns across pipelines Deliver monitoring and observability (Prometheus, Grafana or equivalent) and runbook automation ...

Data Engineer Salary up to £60,000 + discretionary bonus Hybrid working model with collaborative office environment Work with Databricks, Spark Structured Streaming, Kafka (MSK), and AWS Apply online or contact Chelsea Hackett via chelsea.hackett@searchability.com ABOUT THE CLIENT Due to continued growth, we’re seeking a skilled Data … Lakehouse environment. You’ll work with both streaming and batch data pipelines using technologies such as Apache Spark Structured Streaming, Delta Live Tables, and Kafka, ensuring data flows efficiently and reliably across the organisation. Working closely with BI, product, and engineering teams, you will help deliver high-quality, governed ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/MANCHESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

container-related issues in production environments Implement and maintain monitoring, alerting, and logging solutions Support operational aspects of platforms such as: MongoDB, PostgreSQL, Apache Kafka, OpenSearch Required Skills & Experience Experience working in a DevOps or Platform Engineering role Strong knowledge of Linux and working knowledge of Windows Hands … PowerShell Familiarity with monitoring, alerting, and incident management practices Desirable Skills: Experience with GitOps tooling (Argo CD) Experience with Bamboo and Bitbucket Knowledge of Kafka, MongoDB, or PostgreSQL operations Experience operating OpenSearch or similar logging platforms Understanding of cloud security and access control (RBAC, secrets ...