5 of 5 Data Pipeline Jobs in East London

project. Due to the nature of the work, candidates hold UKSV DV clearance. Key Skills & Experience Strong expertise in Python, Docker, Kubernetes, and Data Governance Experience working in air-gapped … environments, including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range ...

Senior Data Engineer (AWS Kafka Big Data) London/WFH to £85k Are you a tech savvy Data Engineer with AWS expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance … clients in a senior, hands-on Data Engineer role. As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using AWS native tools, Kafka and modern data architectures, applying AWS Well-Architected Principles to ensure ...

Description Who we are At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for jobseekers and companies around the world to find a perfect match in fair and equitable way. With … product discovery by supporting opportunity sizing, hypothesis generation, and experiment design. Design and refinebehavioraltracking and measurement plans, ensuring high-quality and reliable data capture across user journeys. Work with data teams to source, transform, andvalidatedata for analysis, dashboards, and experimentation. Build andmaintaindashboards and analytical outputs using ...

Data Engineer Start April initially until Dec 2026 Central London Certain Advantage are seeking Engineers skilled in Python, PySpark and Azure infrastructure services to join a platform team supporting a major data and analytics initiative within a globally renowned Trading business in London. You must … days a week onsite in central London. This Engineer position is critical to enhancing the teams ability to deliver re-usable, high quality data pipelines, reduce bottlenecks, and accelerate insight availability for business stakeholders. We need Engineers to have a solid architectural foundation to be able to solve ...

like pytest, playwright . Key Responsibilities • Design and build high-performance tools and services to validate the reliability, performance, and correctness of ML data pipelines and AI infrastructure. … Develop platform-level test solutions and automation frameworks using Python, Terraform, and modern cloud-native practices.• Contribute to the platform’s CI/CD pipeline by integrating automated testing, resilience checks, and observability hooks at every stage.• Lead initiatives that drive testability, platform resilience, and validation as code across ...