22 of 22 Kafka Jobs in the South West

events/transactions daily. Real-time data synchronization across multiple platforms. Strong expertise in low-latency application design and performance optimization. Proven experience with Kafka, event streaming, and asynchronous architectures. Experience implementing Change Data Capture (CDC) solutions using Debezium or similar technologies. Experience with cloud-native application development. Your … knowledge/experience: Strong experience in Java 17+ Solid experience with Spring Boot, Microservices Experience in working with Dynatrance, Splunk, Grafana Expertise in Apache Kafka, Kafka Streams, Kafka Connect Expertise in Change Data Capture (CDC) solutions using Debezium or similar technologies. Real Time Streaming & Event-Driven architectures ...

Experience working with other JVM-based technologies such as Kotlin and/or Scala . Experience with messaging and event-streaming technologies such as Kafka . Strong experience integrating with backend services including PostgreSQL , Redis , and S3/Object Storage solutions. Deep understanding of microservices architecture , distributed systems ...

based transformation tooling (e.g., dbt) Experience designing and operating orchestration pipelines using Airflow or similar tools Experience designing and building streaming pipelines using Kafka, Pub/Sub, or similar messaging systems Preferred qualifications, capabilities, and skills Data modeling experience for analytics and reporting use cases Knowledge of security, risk ...

DevOps practices is a plus. Experience with TypeScript. Familiarity with GraphQL or other modern data-fetching technologies. Experience in integrating message brokers (e.g., RabbitMQ, Kafka). Familiarity with cloud platforms like AWS, Azure, or Google Cloud. Knowledge of microservices architecture and related tools. Experience with testing frameworks like Mocha ...

Strong knowledge of containerisation and orchestration technologies including Kubernetes, Docker, ECS, EKS, and AKS . Experience working with distributed event-streaming technologies such as Kafka and Apache Flink . Strong troubleshooting skills with the ability to resolve complex technical and operational issues. Proven ability to lead, mentor, and develop ...

stakeholders and translate business requirements into scalable technical solutions Desirable Experience AWS Data Services (Glue, EMR, Lambda, S3, Athena, Redshift) Streaming technologies such as Kafka or Kinesis Data modelling and metadata management AI/ML data pipelines and feature engineering Geospatial, sensor, operational or intelligence-related datasets Experience working ...

Django, Docker Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such ...

areas, please get in touch Spring Boot microservices React and Node.js frontend web application development Database technologies e.g. PostgreSQL Messaging technologies e.g. ActiveMQ or Kafka Continuous Integration and Continuous Deployment Cloud platforms, e.g. AWS, and Kubernetes platforms e.g. OpenShift Who you'll be working with Working in an agile ...

Angular, Node.js, C#/.NET Core 10+ and SQL Server 19+. Programming: JavaScript and TypeScript Architecture: Microservices and distributed applications Event-Driven Architecture: Apache Kafka Kafka: Producers, consumers, topics, partitions and consumer groups Cloud: AWS application deployment and support DevOps: CI/CD pipeline implementation and automation Containers … with Open API standard Source Control: GitHub and Azure DevOps Production Engineering: Troubleshooting, monitoring, logging and performance optimization Highly Desirable Amazon MSK or managed Kafka experience AWS EKS/ECS Terraform/AWS CloudFormation AWS Lambda, API Gateway, SQS, SNS and EventBridge Redis and distributed caching CloudWatch, ELK/ ...

authentication technologies such as LDAP, certificates and similar security frameworks. Hands-on experience with messaging and event-driven architectures, using technologies such as Kafka, AMQP or equivalent platforms. Deep understanding of object-oriented design and SOLID principles, combined with experience using modern DevOps and containerisation tools such as Jenkins ...

domain-driven design (DDD), bounded contexts, data ownership, event-driven integration, eventual consistency and distributed transactions. Event Streaming: Hands-on experience designing and operating Kafka, Kinesis or equivalent platforms, including partitioning, ordering, event contracts, schema evolution, idempotency, replay, delivery guarantees, fault tolerance, security and operational support. Data Modelling & Storage ...

modern data stack, building data ingestion pipelines and working with ETL and orchestration tools (e.g., Airflow, Luigi, Argo, dbt), big data technologies (Spark, Kafka, Parquet), and web frameworks for model serving (e.g. Flask or FastAPI). Data Science: Familiarity or experience with classical NLP techniques (BERT, topic modelling, summarisation ...

. Experience with Natural Language Processing (NLP) and Large Language Models (LLMs). Experience in areas of model development, data processing and streaming (Spark, Kafka), microservices in python (Flask or FastAPI), and interactive visualisations and User Interfaces (Streamlit, Plotly, Gradio etc). These lists are not exhaustive ...

proficiency level appropriate to the seniority of the role; Fluent in writing JAVA coding and experience with JVM compatible languages (Kotlin, Scala) Experience with Kafka or a similar platform. Experience working in Agile DevSecOps environments and Zero Trust Architecture Integrating with backing services, such as PostgreSQL, Redis ...

4HANA, Oracle, Salesforce, engineering systems and master data management solutions. Experience designing API interfaces and event schemas for cloud environments, including technologies such as Kafka, AWS EventBridge or Azure Event Hubs. Familiarity with schema standards such as Avro, JSON Schema or Protobuf, and delivery through CI/CD, DevSecOps ...

relational databases, query optimisation and designing schemas is a plus Knowledge of Java and Spring boot and experience with a messaging system, like Kafka, is a plus Being part of the on-call rotation for our critical services and helping the team improve it, normally being on-call every ...

Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time streaming (Kafka, Flink) • RPA tooling (UiPath, Power Automate) dbt for data transformation • Claude Code, Claude Cowork, or Claude Skills • Experience with vector databases, real-time streaming (Kafka … Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot • Vector databases and embedding pipelines • Real-time streaming (Kafka, Flink) • RPA tooling (UiPath, Power Automate) dbt for data transformation • Claude Code, Claude Cowork, or Claude Skills • Experience with vector databases, real-time streaming ...

Software Architect - AWS/Apache Kafka Outside IR35 Due to the nature of the role an Active SC clearance is required, preferrable you will hold NPPV3 clearance What you will do as a Technical/Software Architect • Design and maintain secure, scalable, and resilient software architectures aligned to customer ...

Software Architect - AWS/Apache Kafka Outside IR35 Due to the nature of the role an Active SC clearance is required, preferrable you will hold NPPV3 clearance What you will do as a Technical/Software Architect • Design and maintain secure, scalable, and resilient software architectures aligned to customer … standards. • Experience working in Agile or SAFe environments. • Demonstrated experience with software lifecycle management, CI/CD, and DevSecOps practices. • Technical capabilities with Apache Kafka, AWS Architecture, Human Interface Design, Software Architecture, Software Performance Desirable: • Familiarity with service design, operational transformation, and digital modernisation • Industry certifications (e.g. AWS, Azure ...

working on? You will transform the financial engineering impact by pioneering our real-time Liquidity Attribution Model (LAM)! You will architect high-throughput Kafka and Flink streaming pipelines that continuously process global bank transactions, dynamically balancing demand against supply intraday. This is an opportunity to architect low-latency streaming … from you! Advanced Stream Processing & Event-Driven Architecture: Proven track record building, deploying, and operating production-grade, low-latency stream processing pipelines using Apache Kafka (or Kafka Streams, Flink, Spark Streaming). Idempotency & Event Reliability: Deep hands-on experience handling duplicate events, out-of-order log processing, late ...

Should Have: Active eDV clearance (West) Willingness to work full time on site in Gloucester when required. Required technical experience in the following: Apache Kafka Apache NiFI SQL and noSQL databases (e.g. MongoDB) ETL processing languages such as Groovy, Python or Java To be Considered: Please either apply … ENGINEERING/DEFENCE/NATIONAL SECURITY/DATA STRATEGY/DATA PIPELINES/DATA GOVERNANCE/SQL/NOSQL/APACHE/NIFI/KAFKA/ETL/GLOUCESTER/DV/SECURITY CLEARED/DV CLEARANCE ...

elevate our current data pipelines and streaming architectures. Establish best practices for monitoring, reliability, and scale across our data ecosystem (using Python, dbt, Airflow, Kafka, and Trino/Iceberg). Build the Unified Customer View: Productionize PoCs into scalable Airflow/dbt data workflows to lay the groundwork … Python & Big Data Expertise: Advanced proficiency in Python and proven experience architecting, deploying, and maintaining Big Data and streaming/batch pipelines (e.g., Kafka Streams, Event Streaming, Trino, Iceberg). dbt & Airflow Proficiency: Hands-on experience using dbt for scalable data transformations and Airflow for workflow orchestration. Data Architecture ...