126 to 130 of 130 Apache Airflow Jobs

distributed processing frameworks such as Spark or Databricks Build and optimise data workflows across cloud platforms (AWS, Azure, GCP) Implement orchestration frameworks such as Airflow Test, troubleshoot, and improve data products to ensure reliability and quality Collaborate with engineering teams to deliver robust, maintainable systems Key Requirements: Experience building … Experience working with at least some of: Distributed computing frameworks (e.g. Spark, Databricks) Cloud platforms (AWS, Azure, or GCP) Workflow orchestration tools (e.g. Airflow) Strong understanding of data system reliability, testing, and performance Experience troubleshooting and improving production data systems Strong problem-solving skills and attention to detail Ability ...

distributed processing frameworks such as Spark or Databricks Build and optimise data workflows across cloud platforms (AWS, Azure, GCP) Implement orchestration frameworks such as Airflow Test, troubleshoot, and improve data products to ensure reliability and quality Collaborate with engineering teams to deliver robust, maintainable systems Key Requirements: Experience building … Experience working with at least some of: Distributed computing frameworks (e.g. Spark, Databricks) Cloud platforms (AWS, Azure, or GCP) Workflow orchestration tools (e.g. Airflow) Strong understanding of data system reliability, testing, and performance Experience troubleshooting and improving production data systems Strong problem-solving skills and attention to detail Ability ...

Data Engineer - Investment Platform (Python - Azure - Airflow - AI) £90k–£140k + bonus + benefits Hybrid | Central London There's a quiet data problem at the heart of private markets and a London fintech is building the infrastructure to solve it. Every PE fund, credit strategy and infrastructure vehicle reports … experiment, but as core infrastructure. The engineering environment is modern and evolving fast. You get room to shape systems, not just maintain them. Python, airflow and Azure underpin a modern distributed data platform built around ingestion pipelines, lakehouse architecture, streaming workflows, CI/CD, observability and product-facing data ...

DRW Holdings, LLC. is seeking a Senior Software Engineer for their Unified Platform in London. The role involves building robust systems with an emphasis on testing and scalability, designing and programming in languages such as ...

possibility of extension) About the Role We are seeking a Capacity Engineer (CFD) to support large-scale data centre projects , focusing on cooling optimisation, airflow modelling, and capacity planning . This role involves leveraging Computational Fluid Dynamics (CFD) to simulate and improve data centre environments, ensuring efficient cooling strategies … Perform CFD simulations for single and multi-storey data centre environments Model and analyse cooling effectiveness under normal and failure scenarios Evaluate and optimise: Airflow management Cooling systems (CRAC units, ventilation, diffusers) Data hall layouts and rack configurations Work on high- and low-density cabinet modelling , including next-generation ...