1 to 25 of 29 Kafka Jobs in the North West

scope technologies/products: "Streaming Platform: Kafka, Kafka Connect, Schema Registry, Streams, ZooKeeper/KRaft DevOps/CI-CD: Jenkins, GitHub Actions, Azure DevOps Container Platform: Kubernetes, Helm, ArgoCD Cloud: AWS, Azure, GCP Monitoring: Prometheus, Grafana, Dynatrace, Confluent Control Centre Supporting: Terraform, Ansible" Skillsets required: 1. Core Kafka Expertise (Must-Have) • Kafka architecture: brokers, topics, partitions, replication • Kafka components: Kafka Connect, Schema Registry, Streams, ZooKeeper/Kraft • Topic & partition management, consumer groups • Performance tuning, retention, throughput optimisation • Cluster setup, upgrades, scaling and failover • Troubleshooting (e.g. lag, ISR, leader issues) • Security: SSL/TLS, ACLs ...

with data governance, quality, lineage, and security practices. \n \n Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). \n \n Strong proficiency in relational and non-relational databases (e.g., PostgreSQL, MongoDB, Cassandra). ...

Airflow, AWS Step Functions or Apache NiFi. Cloud platform experience across AWS, Azure and/or GCP. Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services. Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch ...

with data governance, quality, lineage, and security practices. \n \n Experience with real-time/streaming data technologies, data Ingestion/ETL (e.g., Apache Kafka, Apache NiFi, Kinesis, Pub/Sub). \n \n Experience in, or knowledge of, DevSecOps Tooling and Processes. \n \n Self-starter with ...

improve application performance Strong understanding of secure coding practices Exposure to the following would be advantageous but not essential: - Messaging/streaming technologies (Kafka, SQS) Serverless technologies (e.g., AWS Lambda) Monitoring/logging tools (ELK, Splunk, Dynatrace) ORM technologies (JPA, Hibernate) API documentation tools (e.g., Swagger/OpenAPI) Test ...

both systems and teams Confidence in collaborating with technical and non-technical stakeholders Additional experience (nice to have) Exposure to event-driven architectures (e.g. Kafka, RabbitMQ, SNS/SQS) Knowledge of Domain-Driven Design (DDD) Experience building resilient, scalable systems Familiarity with Infrastructure as Code tools such as Terraform ...

concepts (Prometheus, Grafana, ELK, etc.). Experience with test automation tools (JUnit, Cucumber, Selenium, Postman). Knowledge of messaging and streaming platforms (Kafka) and service mesh (Istio). Understanding of network protocols, security best practices, and compliance requirements for banking. Curiosity, adaptability, and a commitment to continuous improvement ...

Strong expertise with relational databases (Oracle) and data modelling expertise (canonical data models, JSON) \n \n Deep experience with enterprise messaging platforms (Kafka, IBM MQ) \n \n Proven experience implementing AI/ML solutions ( using Python or other frameworks) to solve business problems \n \n Full-stack development experience ...

Boot for building microservices Strong expertise with relational databases (Oracle) and data modelling expertise (canonical data models, JSON) Deep experience with enterprise messaging platforms (Kafka, IBM MQ) Proven experience implementing AI/ML solutions ( using Python or other frameworks) to solve business problems Full-stack development experience (RESTful APIs ...

PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud services (AWS, Azure or GCP) Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/ ...

working in Agile environments Experience supporting live production systems Solid understanding of scalable web architecture Comfortable working in Linux/Unix environments Desirable Experience Kafka, ActiveMQ, or similar messaging systems MongoDB or other NoSQL databases Mockito, Jackson, JAX-RS High-scale or high-traffic system experience Cloud platforms ...

environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB. Data Platform Capabilities: Low-Code ...

Engineering (30%): Experience deploying and maintaining data orchestration toolsets (e.g., dbt, Apache Airflow), ETL/ELT methodologies, real‐time streaming (e.g., AWS Kinesis, Apache Kafka), Vector databases, and RAG architectures. Observability & FinOps: Experience implementing modern observability tooling (OpenTelemetry) alongside automated cost‐control systems (such as Karpenter, Infracost, OpenCost ...

technical stakeholders Ability to learn new technologies quickly and adapt to changing priorities Desirable Experience Jackson JAX-RS Mockito or similar mocking frameworks Kafka or ActiveMQ MongoDB or other NoSQL databases High-traffic, large-scale web applications Large data processing and distributed systems Responsive Web Design What ...

microservices, API design and DevOps practices. Hands on experience with conversational AI (Kore.AI and similar platforms), intelligent automation, and data heavy architectures (AWS, Kafka); familiarity with Adobe tools. Proven capability with modern development stacks (Java, .NET, Python, JavaScript frameworks), Agile/SAFe delivery methods, and build versus buy, vendor ...

software development background with hands‐on experience in platform, infrastructure, or data‐centric environments Deep expertise in event‐driven architectures, streaming technologies (e.g. Apache Kafka, Flink, and/or Pulsar) Proficiency across full stack technologies (Java, .Net, React) with the ability to guide technical decisions Knowledge of hybrid/ ...

Experience Significant demonstrable experience in one or both of: Modern software engineering for digital products (ideally Java, microservice architectures, Hexagonal software architecture, Mongo and Kafka); OR designing and implementing modern cloud infrastructure, DevOps, and automation (ideally AWS, Terraform, GitLab CI, Jenkins) Lead engineering teams Collaborative Working and leading ...

luxury tech brand. Bonus Points Prior experience in e‐commerce, marketplaces, or membership‐based platforms. Familiarity with event‐driven architectures and message queues (Kafka, SQS, etc). Experience working closely with design or product teams in consumer‐facing companies. Passion for fashion, luxury, or retail innovation. Why Join MILE ...

Authorization JSON/API interfaces Solution development and design 2. Strong/practised skills Back End Dev - RDBMS - Practitioner - Client - MongoDB (nice to have) Kafka integration Ansible (AAP 2.4/2.5) React AI development/co-development experience (GitLab Duo/Claude code) 3. SDLB DevOps - Openshift, Gitlab CICD ...

Solution development and design \n 2. Strong/practised skills \n Back End Dev - RDBMS - Practitioner \n - Client \n - MongoDB (nice to have) \n Kafka integration \n Ansible (AAP 2.4/2.5) \n React \n AI development/co-development experience (GitLab Duo/Claude code) \n 3. SDLB ...

expertise in C#, PowerShell scripting, WebAPI, and JSON/API integration Solid experience in backend development with MSSQL (MongoDB desirable) Hands-on experience with Kafka, Ansible (AAP 2.4/2.5), and DevOps tooling (Git, Jenkins, Confluence) Exposure to AI-assisted development (e.g. GitLab Duo, Claude) Good understanding of SDLC ...

initiatives. This is an opportunity to work on large-scale projects, collaborate with international teams, and develop your expertise across MuleSoft, AWS, Kafka, APIs, and cloud technologies within a highly supportive environment that offers genuine long-term career progression. What You'll Be Doing Designing, developing, and supporting integrations … RESTful APIs Experience working with SQL and databases Exposure to AWS services such as S3, SNS, SQS, IAM, CloudWatch, or EventBridge Experience working with Kafka or similar messaging technologies Understanding of OAuth, JWT, and API security principles Strong communication skills and fluent English Desirable Experience Azure DevOps Integration certifications ...

Should Have: Active eDV clearance (West) Willingness to work full-time on-site in Manchester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/MANCHESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

Months 2 days p/w in the office, 3 days WFH Location is Manchester Must have C#, MS SQL, PowerShell, API's, Kafka Join a high-performing engineering team responsible for delivering critical cyber and infrastructure solutions across the organisation. You'll play a key role in designing … C# and Web APIs. Proven expertise with SQL Server and database-driven application development. Experience with PowerShell scripting, automation and DevOps practices. Knowledge of Kafka, Ansible and modern CI/CD toolchains. Familiarity with Agile delivery methodologies and software development lifecycle best practices. Understanding of software design principles, data ...

Role: Senior Java Developer Location: Manchester/Leeds 60% Hybrid Role Type: 12 months Salary: Depending on experience Role Overview: We are seeking an experienced Java Developer to join a high-profile digital transformation programme ...