276 to 300 of 302 Kafka Jobs in the South East

pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and automate deployments. (For … Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time processing principles. Proficiency with Docker, Terraform, and cloud platforms (AWS, GCP, or Azure) for scalable data infrastructure. Demonstrated ability to lead, coach, and elevate More ❯

pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and automate deployments. (For … Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time processing principles. Proficiency with Docker, Terraform, and cloud platforms (AWS, GCP, or Azure) for scalable data infrastructure. Demonstrated ability to lead, coach, and elevate More ❯

pipelines across Bronze → Silver → Gold layers, ensuring quality, scalability, and reliability. Develop and optimise Spark (PySpark) jobs for large-scale distributed processing. Design and implement streaming data pipelines with Kafka/MSK, applying best practices for late event handling and throughput. Use Terraform and CI/CD pipelines (GitHub Actions or similar) to manage infrastructure and automate deployments. (For … Expected Proven experience delivering end-to-end data pipelines in Databricks and Spark environments. Strong understanding of data modelling, schema evolution, and data contract management. Hands-on experience with Kafka, streaming architectures, and real-time processing principles. Proficiency with Docker, Terraform, and cloud platforms (AWS, GCP, or Azure) for scalable data infrastructure. Demonstrated ability to lead, coach, and elevate More ❯

Developer will design, develop, and implement data-intensive applications across the full engineering lifecycle. You’ll architect and deliver microservices-based systems using Go (Golang), AWS, Kubernetes, Docker, and Kafka, working closely with cross-functional teams to build scalable, reliable, and resilient platforms. You’ll also play a key role in optimising system performance, improving reliability, and ensuring scalability … including system design and architecture Background in complex, large-scale, data-driven applications Product-focused approach, ideally within fast-paced tech organisations (start-ups or scale-ups) Knowledge of Kafka, Cassandra, gRPC, and microservices is a strong advantage Open-source contributions are beneficial If you’re a Senior Go Developer looking for a challenging 6-month contract with a More ❯

Developer will design, develop, and implement data-intensive applications across the full engineering lifecycle. You’ll architect and deliver microservices-based systems using Go (Golang), AWS, Kubernetes, Docker, and Kafka, working closely with cross-functional teams to build scalable, reliable, and resilient platforms. You’ll also play a key role in optimising system performance, improving reliability, and ensuring scalability … including system design and architecture Background in complex, large-scale, data-driven applications Product-focused approach, ideally within fast-paced tech organisations (start-ups or scale-ups) Knowledge of Kafka, Cassandra, gRPC, and microservices is a strong advantage Open-source contributions are beneficial If you’re a Senior Go Developer looking for a challenging 6-month contract with a More ❯

looking for a Lead Site Reliability Engineer to support and scale their Video on Demand (VOD) infrastructure. You’ll work across modern tech stacks including AWS, GCP, Cassandra, and Kafka, helping deliver reliable, high-performance systems used by millions. What you’ll do Lead project delivery while supporting day-to-day operations and incident management Build and manage infrastructure … functional environment What you’ll bring Strong Linux administration skills (Ubuntu preferred) Hands-on experience with AWS and GCP Proficiency in Terraform, Ansible, Jenkins, or GitLab CI Knowledge of Kafka, Cassandra, and relational or NoSQL databases Scripting skills in Python, Bash, Go, or Java Familiarity with monitoring tools like Prometheus, Nagios, or Icinga Understanding of networking fundamentals and virtualisation More ❯

looking for a Lead Site Reliability Engineer to support and scale their Video on Demand (VOD) infrastructure. You’ll work across modern tech stacks including AWS, GCP, Cassandra, and Kafka, helping deliver reliable, high-performance systems used by millions. What you’ll do Lead project delivery while supporting day-to-day operations and incident management Build and manage infrastructure … functional environment What you’ll bring Strong Linux administration skills (Ubuntu preferred) Hands-on experience with AWS and GCP Proficiency in Terraform, Ansible, Jenkins, or GitLab CI Knowledge of Kafka, Cassandra, and relational or NoSQL databases Scripting skills in Python, Bash, Go, or Java Familiarity with monitoring tools like Prometheus, Nagios, or Icinga Understanding of networking fundamentals and virtualisation More ❯

looking for a Lead Site Reliability Engineer to support and scale their Video on Demand (VOD) infrastructure. You’ll work across modern tech stacks including AWS, GCP, Cassandra, and Kafka, helping deliver reliable, high-performance systems used by millions. What you’ll do Lead project delivery while supporting day-to-day operations and incident management Build and manage infrastructure … functional environment What you’ll bring Strong Linux administration skills (Ubuntu preferred) Hands-on experience with AWS and GCP Proficiency in Terraform, Ansible, Jenkins, or GitLab CI Knowledge of Kafka, Cassandra, and relational or NoSQL databases Scripting skills in Python, Bash, Go, or Java Familiarity with monitoring tools like Prometheus, Nagios, or Icinga Understanding of networking fundamentals and virtualisation More ❯

engineering role with a strong focus on data, customer collaboration, and real-world outcomes. Essential Requirements Proficiency in Python and/or TypeScript Experience with distributed systems (e.g. Spark, Kafka, Hadoop) Background in AI/ML , ideally with exposure to GenAI or LLMs SC Clearance Strong communication skills and ability to gather requirements from non-technical stakeholders Bachelor’s … Keywords for Search: Forward Deployed Engineer, FDE, Software Engineer, Data Engineer, Machine Learning Engineer, AI Engineer, GenAI, LLM, Python Developer, TypeScript Developer, Full Stack Engineer, Distributed Systems Engineer, Spark, Kafka, Hadoop, React Developer, Enterprise Software Engineer, Consulting Engineer, Analytics Engineer, Technical Consultant, Palantir Foundry, AIP, Hybrid Software Engineer, London Tech Jobs, Mission-Driven Engineering Roles, FDSE, Python, Java Disclaimer More ❯

engineering role with a strong focus on data, customer collaboration, and real-world outcomes. Essential Requirements Proficiency in Python and/or TypeScript Experience with distributed systems (e.g. Spark, Kafka, Hadoop) Background in AI/ML , ideally with exposure to GenAI or LLMs SC Clearance Strong communication skills and ability to gather requirements from non-technical stakeholders Bachelor’s … Keywords for Search: Forward Deployed Engineer, FDE, Software Engineer, Data Engineer, Machine Learning Engineer, AI Engineer, GenAI, LLM, Python Developer, TypeScript Developer, Full Stack Engineer, Distributed Systems Engineer, Spark, Kafka, Hadoop, React Developer, Enterprise Software Engineer, Consulting Engineer, Analytics Engineer, Technical Consultant, Palantir Foundry, AIP, Hybrid Software Engineer, London Tech Jobs, Mission-Driven Engineering Roles, FDSE, Python, Java Disclaimer More ❯

engineering role with a strong focus on data, customer collaboration, and real-world outcomes. Essential Requirements Proficiency in Python and/or TypeScript Experience with distributed systems (e.g. Spark, Kafka, Hadoop) Background in AI/ML , ideally with exposure to GenAI or LLMs SC Clearance Strong communication skills and ability to gather requirements from non-technical stakeholders Bachelor’s … Keywords for Search: Forward Deployed Engineer, FDE, Software Engineer, Data Engineer, Machine Learning Engineer, AI Engineer, GenAI, LLM, Python Developer, TypeScript Developer, Full Stack Engineer, Distributed Systems Engineer, Spark, Kafka, Hadoop, React Developer, Enterprise Software Engineer, Consulting Engineer, Analytics Engineer, Technical Consultant, Palantir Foundry, AIP, Hybrid Software Engineer, London Tech Jobs, Mission-Driven Engineering Roles, FDSE, Python, Java Disclaimer More ❯

structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data workflows using technologies such as Apache Kafka Monitor and ensure data quality, reliability, and security across the stack Contribute to the evolution of data engineering practices, tooling, and automation Collaborate with analytics, product, and data science … cloud-based data environments (e.g. AWS, GCP, or Azure) Exposure to modern data tools such as Airflow, dbt, or Snowflake Experience or strong interest in streaming technologies like Apache Kafka Interest in MLOps and modern data engineering best practices Why join: You’ll be part of a company with a clear mission and strong data culture, joining a team More ❯

structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data workflows using technologies such as Apache Kafka Monitor and ensure data quality, reliability, and security across the stack Contribute to the evolution of data engineering practices, tooling, and automation Collaborate with analytics, product, and data science … cloud-based data environments (e.g. AWS, GCP, or Azure) Exposure to modern data tools such as Airflow, dbt, or Snowflake Experience or strong interest in streaming technologies like Apache Kafka Interest in MLOps and modern data engineering best practices Why join: You’ll be part of a company with a clear mission and strong data culture, joining a team More ❯

global scale. We’re looking for a Data Engineer to join the platform team. You’ll help design, build, and run pipelines and services on a modern data stack (Kafka, AWS, Iceberg, Kubernetes), collaborating with engineers, data scientists, and product teams across multiple regions. What you’ll do Build & maintain streaming and batch pipelines Develop our Lakehouse (AWS S3 … is trustworthy, accessible, and reusable Implement schemas, contracts, and observability Support compliance with global data regulations What you’ll bring Good working experience in data engineering Hands-on with Kafka/Pulsar/Kinesis Strong SQL & relational DBs (Postgres/MySQL) Coding experience in Java/Scala Cloud (AWS preferred) + Infrastructure-as-Code familiarity Solid understanding of ETL More ❯

global scale. We’re looking for a Data Engineer to join the platform team. You’ll help design, build, and run pipelines and services on a modern data stack (Kafka, AWS, Iceberg, Kubernetes), collaborating with engineers, data scientists, and product teams across multiple regions. What you’ll do Build & maintain streaming and batch pipelines Develop our Lakehouse (AWS S3 … is trustworthy, accessible, and reusable Implement schemas, contracts, and observability Support compliance with global data regulations What you’ll bring Good working experience in data engineering Hands-on with Kafka/Pulsar/Kinesis Strong SQL & relational DBs (Postgres/MySQL) Coding experience in Java/Scala Cloud (AWS preferred) + Infrastructure-as-Code familiarity Solid understanding of ETL More ❯

researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader data … programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering, or More ❯

researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader data … programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering, or More ❯

researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader data … programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering, or More ❯

Solutions Architect Up to £120,000 + Bonus Hybrid | London (2–3 days a week in office ) We’re partnered with a global leader in loyalty and customer engagement, looking for a Solutions Architect to join their London team. This More ❯

Solutions Architect Up to £120,000 + Bonus Hybrid | London (2–3 days a week in office ) We’re partnered with a global leader in loyalty and customer engagement, looking for a Solutions Architect to join their London team. This More ❯

join their ever-expanding platform/DevOps team remotely from the UK. They are looking for you to have excellent cloud knowledge, ideally AWS as well as Terraform and Kafka experience. As well as this you will also be expected to have knowledge of GitLab as well as having Python experience is a must. As the AWS Engineer, you … fully remote position but they have an office based in Southwark should you wish to go in. Skills required for the AWS Engineer: * Knowledge of AWS* Working experience of Kafka* Python experience*Excellent communicator This is a really exciting opportunity to rapidly grow your skill set and work closely with some of the most talented Developers and Analyst's More ❯

the next-generation interface to the core data system, directly influencing mission-critical trading and risk infrastructure. You will work hands-on with modern technologies such as Python, AWS, Kafka, Redis, and GraphQL to build robust, production-grade solutions. Collaboration with top-tier engineers and quantitative specialists will be central to your role as you deliver tools that power … software development experience at a top-tier firm BS or higher in Computer Science, Mathematics, or related field Experience with databases, ORM models, and ETL workflows Familiarity with AWS, Kafka, Redis, and GraphQL Background in financial reference data and large-scale systems More ❯

the next-generation interface to the core data system, directly influencing mission-critical trading and risk infrastructure. You will work hands-on with modern technologies such as Python, AWS, Kafka, Redis, and GraphQL to build robust, production-grade solutions. Collaboration with top-tier engineers and quantitative specialists will be central to your role as you deliver tools that power … software development experience at a top-tier firm BS or higher in Computer Science, Mathematics, or related field Experience with databases, ORM models, and ETL workflows Familiarity with AWS, Kafka, Redis, and GraphQL Background in financial reference data and large-scale systems More ❯

security and governance through robust access controls, including RBAC, SSO, token policies, and pseudonymisation frameworks. Develop resilient data flows for both batch and streaming workloads using technologies such as Kafka, Airflow, DBT, and Terraform. Shape data strategy and standards by contributing to architectural decisions, authoring ADRs, and participating in reviews, data councils, and platform enablement initiatives. What we’d … reporting requirements Direct exposure to cloud-native data infrastructures (Databricks, Snowflake) especially in AWS environments is a plus Experience in building and maintaining batch and streaming data pipelines using Kafka, Airflow, or Spark Familiarity with governance frameworks, access controls (RBAC), and implementation of pseudonymisation and retention policies Exposure to enabling GenAI and ML workloads by preparing model-ready and More ❯

data at scale. This is a hands-on engineering role that blends software craftsmanship with data architecture expertise. Key responsibilities: Design and implement high-throughput data streaming solutions using Kafka, Flink, or Confluent. Build and maintain scalable backend systems in Python or Scala, following clean code and testing principles. Develop tools and frameworks for data governance, privacy, and quality … advanced data use cases. Contribute to an engineering culture that values testing, peer reviews, and automation-first principles. What You'll Bring Strong experience in streaming technologies such as Kafka, Flink, or Confluent. Advanced proficiency in Python or Scala, with a solid grasp of software engineering fundamentals. Proven ability to design, deploy, and scale production-grade data platforms and More ❯