1 to 25 of 29 Permanent Kafka Jobs in the North of England

Gateway, and CloudWatch. Design, develop, and maintain data pipelines and ETL workflows using technologies such as Glue, Spark/PySpark, Kafka, or similar platforms. Implement and maintain Infrastructure as Code (IaC) using Terraform or equivalent tools. Drive observability, monitoring, logging, and operational readiness across software platforms and services. ...

Java development experience. Java (JDK 11+). Spring Boot. REST APIs. Microservices. AWS. Agile/Scrum. CI/CD exposure. Desirable Skills Docker Kubernetes Kafka JUnit/Mockito TDD Oracle WebLogic Enterprise-scale systems Security Clearance Requirement Applicants must be eligible for UK SC Clearance. This means you must ...

Machine Learning – Understanding of AI/ML concepts, experience with LLMs, prompt engineering, or integrating AI capabilities into applications • Data Technologies – Experience with Kafka, PySpark, Parquet and Avro data formats, Apache Airflow for workflow management, or Streamlit for building interactive data applications • Advanced Data Management – Strong SQL design, query ...

JavaScript Experience in developing and deploying microservices architectures using Spring Boot, Spring Batch, Spring Data, or similar frameworks Knowledge of JIRA, Junit, and Apache Kafka are preferred Hands-on experience with NoSQL DB (CosmosDB, MongoDB) In-depth knowledge of REST API principles, HTTP protocol Familiarity with containerization tools ...

work on, from design through to deployment and supporting them in production. Skills: Java and Spring Boot TypeScript (Vue or React) REST APIs and Kafka event-driven systems AWS (including S3, Lambda, ECS, EKS, MSK) TDD, CI/CD and IaC Observability AI assisted engineering The money is good ...

comfortable with agentic AI coding You're collaborative and pragmatic with great communication and stakeholder management skills Nice to have (not essential): Kafka, Kubernetes, Docker, AWS What's in it for you: Salary to £78k Personalised training budget Pension Healthcare including dental and optical Various wellness experiences, gym subsidy ...

power intelligent decision-making. Key Responsibilities Data Pipeline Development Build, optimize, and maintain scalable data pipelines using Java (primary), plus exposure to Python, Flink, Kafka, or Spark. Develop and support real-time streaming pipelines and event-driven integrations. Integrate data from multiple sources (streaming, batch, APIs) using AWS managed … junior engineers where needed. Core Data Engineering Strong programming proficiency in Java (preferred) or Python. Hands-on experience with at least one of: Kafka, Flink, Spark (Flink/Kafka preferred for streaming). Solid understanding of stream processing concepts (e.g., event time, state, backpressure). Understanding of software ...

systems they work on, from design through to deployment and supporting them in production. Skills: Java and Spring Boot REST APIs and Kafka event-driven systems AWS (including S3, Lambda, ECS, EKS, MSK) TDD, CI/CD and IaC Observability AI assisted engineering The money is good ...

Patterns, Data StructuresYou're comfortable with agentic AI codingYou're collaborative and pragmatic with great communication and stakeholder management skillsNice to have (not essential): Kafka, Kubernetes, Docker, AWSWhat's in it for you: Salary to 78kPersonalised training budgetPensionHealthcare including dental and opticalVarious wellness experiences, gym subsidy, cycle to work ...

Cloud Load balancers, DNS, firewalls, and ingress controllers Operating Systems & Middleware Red Hat Enterprise Linux (RHEL) Experience with: IBM Db2, Oracle & MS SQL Server Kafka (as used within MAS) Object storage (S3-compatible) Automation & Tooling Infrastructure as Code (Terraform, Ansible desirable) CI/CD pipelines (Git-based tooling) Monitoring ...

with experience developing and maintaining data pipelines Familiarity with ETL/ELT technologies and data streaming tools such as Airflow, Azure, SSIS, Spark or Kafka Experience working with databases and data platforms such as PostgreSQL, SQL Server, Oracle, Snowflake or similar technologies Knowledge of data visualisation tools, particularly Power ...

Required Skills & ExperienceExtensive hands‐on experience with Java 11, Spring Boot, and microservices‐based architecturesStrong experience working in AWS cloud environmentsSolid experience with Apache Kafka and asynchronous messagingIn‐depth knowledge of ISO 20022 payments, including payment types and schemesHands‐on experience implementing ICON IPF Proven experience working closely with ...

making practical technical decisions in an early-stage environment. Desirable experience Working with banking, payments, financial or regulatory datasets. Streaming technologies such as Kafka and real-time data processing. Building datasets and processes for regulatory reporting. Supporting analytics or machine learning use cases. Experience working within a regulated industry. ...

such as Jira, Confluence, GitHub Exposure to BDD/TDD practices Awareness of accessibility standards and inclusive design Experience or interest in AWS, Kubernetes, Kafka, Postgres Life at BAE Systems Digital Intelligence We are embracing Hybrid Working. This means you and your colleagues may be working in different locations ...

Technical Lead (hands-on) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver ...

reconciliation, parallel running, decommissioning) Deep, hands-on AWS data experience: Glue, Lambda, S3, Redshift and EMR Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver ...

Databricks and Snowflake running on top of any of the three Spark and distributed processing frameworks for large-scale data Streaming technologies such as Kafka or the native cloud equivalents You’re expected to pick the right tools for the problem within the cloud platform in question, not just ...

Companys hybrid work from home policy. Qualifications Commercial GCP background including BigQuery, Dataform and GCS Knowledge of Data Lake technologies such as Airflow, Kafka, Flink and Python Relational set-based processing through complex SQL queries Proven ability to leverage AI within a production workflow Background working within a Data ...

including camt.052, camt.053 and camt.054.Familiarity with SWIFT MT 940, 942 and 950 and BAI2 reporting standards. Experience owning statement production and reconciliation platforms. Strong Kafka and event-driven architecture experience. Experience designing webhook and asynchronous client delivery solutions. Evidence of defining technical reporting strategy and standards. Nice-to-HavesExperience ...

End DateSunday 01 November 2026Salary Range63,152 - 94,728We support flexible working – click here for more information on flexible working optionsFlexible Working OptionsHybrid Working, Job ShareJob Description SummaryWe are looking for a motivated front-end ...

data platforms using Snowflake for analytics and reporting, ensuring seamless integration with broader enterprise data ecosystemsBuild and maintain real-time event streaming architectures (e.g., Kafka, Azure Event Hubs) to power high-throughput, low-latency financial data flowsDeliver robust full-stack solutions utilising .NET/C# and SQL where appropriate … data pipelinesProficiency with Snowflake for data warehousing, analytics, and building scalable data platformsExperience designing and building event streaming architectures using technologies such as Apache Kafka and Azure Event HubsStrong working knowledge of Azure and/or AWS cloud services, including compute, storage, serverless, and container orchestration (e.g. ...

/CD pipelines using Git-based tooling. Manage AWS infrastructure supporting a mix of React Front End applications, microservices, AWS Lambda functions, and Kafka event integrations. Support integrations involving ETL processes and Robotic Process Automation (RPA) solutions. Implement and manage secure networking patterns, including AWS Transit Gateway and PrivateLink … pipelines and Git-based workflows. Experience supporting modern application architectures, including: React Front End applications Microservices AWS Lambda functions Event-driven architectures using Kafka Experience with Infrastructure as Code (Terraform, CloudFormation, or equivalent). Strong understanding of AWS networking concepts, including Transit Gateway and PrivateLink. Experience administering ...

focus on production reliability. Essential skills and experience Strong hands-on experience developing data engineering solutions using Python and PySpark. Practical experience with Apache Kafka and Apache NiFi for streaming, ingestion and orchestration. Experience working with Hadoop, Hive or comparable enterprise data-lake technologies. Solid knowledge of SQL, data … development tools. Exposure to agentic AI, workflow orchestration or retrieval-augmented generation. Key responsibilities Design and develop scalable data pipelines using Python, PySpark, Apache Kafka and Apache NiFi. Integrate vendor platforms and enterprise systems through REST APIs and secure authentication mechanisms. Build data processing and storage solutions using Spark ...

also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave. Join us as a Kafka Platform Engineer, to help develop and enhance the enterprise streaming platforms that enable secure, reliable and real-time data movement across Barclays. This role … help shape the future direction of strategic streaming capabilities while contributing to solutions that deliver meaningful business impact. To be successful as a Kafka Platform Engineer, you must have the following essential skills: Designing, implementing and operating enterprise-scale Confluent Kafka platforms supporting business-critical workloads. Building secure ...

external data sources means that we'll be able to power businesses across the automotive industry. Spring Boot, Apache Solr, Cloud SQL and Apache Kafka power our platform and process millions of events per day. As a team, our software developers are responsible for ensuring service availability and responsiveness … technical expertise Architectural and system design knowledge Experience leading and delivering technical projectsSQL/Relational databasesDocument/Map based storage (eg: MongoDB)Working with Kafka messaging/streamingBenefits and moreWe're offering a salary of 60,000 – 80,000, plus an additional 10% of your salary awarded ...