101 to 112 of 112 Permanent Apache Airflow Jobs

We're looking for an experienced Analytics Engineer to help shape our data foundations and deliver high quality, trusted insights across the business. You'll design and maintain scalable analytics models, ensure data quality, and ...

Manchester, UK, to develop scalable APIs and manage big data solutions. Candidates should have 8+ years in software or data engineering, with skills in Apache Spark, Airflow, and a strong foundation in Java, Python, or Scala. The role requires collaboration with cross-functional teams to deliver high-quality ...

high-impact, early-stage business £100K plus equity in a well-funded Series A start-up. Own and shape a GCP data platform (BigQuery, Airflow, dbt). Real progression into a future leadership role. We’re working with an early-stage, well-funded tech-led start-up. They … production-ready systems that scientists can trust and use daily. You’ll manage and extend a GCP-first platform, working with tools like BigQuery, Airflow, dbt, and and so much more. Sound like you? What experience you’ll need to apply Strong Data Engineering experience in a cloud environment ...

reliable, production-ready systems that scientists can trust and use daily.You’ll manage and extend a GCP-first platform, working with tools like BigQuery, Airflow, dbt, and Terraform. You’ll also help build internal applications using Python, FastAPI, and React, giving teams easy ways to trigger workflows and access … backend services and working with data workflows A few years of experience with GCP, including BigQuery and cloud-native tools Hands-on experience with Airflow, dbt, and modern data pipelines Infrastructure as code experience, ideally using Terraform Experience building or contributing to internal tools or application Strong ...

framework on top of our data platform. Implement MCP- and A2A-based architectures for agent collaboration and orchestration. Integrate AI services with data pipelines (Airflow, Spark, Trino, StarRocks, DBT). Build APIs, SDKs, and tooling to enable other teams to use the framework. Work with platform and application teams … Have) Strong programming skills in Python with 5+ years of experience Proven experience with data engineering or distributed systems (Spark, Hive, Trino, StarRocks, DBT, Airflow, Kubernetes). Deep understanding of LLM-based systems and agent frameworks (LangChain, LlamaIndex, DSPy, OpenAI MCP, A2A). Hands-on experience with API design ...

Principal Data Engineer Location: Newcastle/Manchester/Leeds/Southwest England | Hybrid with regular client-site travel Salary: £100,000 - £140,000 Security Clearance: Eligible for UK SC clearance required Employer Overview Our client ...

Senior Data Engineer | Python | Airbyte | Apache | BigQuery | EducationTech | Remote, London | £70k Looking to help shape Data Strategy for a scaling Tech-for-Good business I'm partnered with a AI-first data and analytics platform built for schools, multi-academy trusts and education groups. Their technology connects fragmented school … Engineer to build and maintain the data infrastructure that underpins the entire platform.You’ll own and extend the ELT pipeline - Airbyte (OSS) for extraction, Airflow on Astro for orchestration, dbt via Cosmos for transformation - and the BigQuery lakehouse beneath it, with a semantic layer on top.These are hands ...

distributed processing frameworks such as Spark or Databricks Build and optimise data workflows across cloud platforms (AWS, Azure, GCP) Implement orchestration frameworks such as Airflow Test, troubleshoot, and improve data products to ensure reliability and quality Collaborate with engineering teams to deliver robust, maintainable systems Key Requirements: Experience building … Experience working with at least some of: Distributed computing frameworks (e.g. Spark, Databricks) Cloud platforms (AWS, Azure, or GCP) Workflow orchestration tools (e.g. Airflow) Strong understanding of data system reliability, testing, and performance Experience troubleshooting and improving production data systems Strong problem-solving skills and attention to detail Ability ...

distributed processing frameworks such as Spark or Databricks Build and optimise data workflows across cloud platforms (AWS, Azure, GCP) Implement orchestration frameworks such as Airflow Test, troubleshoot, and improve data products to ensure reliability and quality Collaborate with engineering teams to deliver robust, maintainable systems Key Requirements: Experience building … Experience working with at least some of: Distributed computing frameworks (e.g. Spark, Databricks) Cloud platforms (AWS, Azure, or GCP) Workflow orchestration tools (e.g. Airflow) Strong understanding of data system reliability, testing, and performance Experience troubleshooting and improving production data systems Strong problem-solving skills and attention to detail Ability ...

Data Engineer - Investment Platform (Python - Azure - Airflow - AI) £90k–£140k + bonus + benefits Hybrid | Central London There's a quiet data problem at the heart of private markets and a London fintech is building the infrastructure to solve it. Every PE fund, credit strategy and infrastructure vehicle reports … experiment, but as core infrastructure. The engineering environment is modern and evolving fast. You get room to shape systems, not just maintain them. Python, airflow and Azure underpin a modern distributed data platform built around ingestion pipelines, lakehouse architecture, streaming workflows, CI/CD, observability and product-facing data ...

DRW Holdings, LLC. is seeking a Senior Software Engineer for their Unified Platform in London. The role involves building robust systems with an emphasis on testing and scalability, designing and programming in languages such as ...

possibility of extension) About the Role We are seeking a Capacity Engineer (CFD) to support large-scale data centre projects , focusing on cooling optimisation, airflow modelling, and capacity planning . This role involves leveraging Computational Fluid Dynamics (CFD) to simulate and improve data centre environments, ensuring efficient cooling strategies … Perform CFD simulations for single and multi-storey data centre environments Model and analyse cooling effectiveness under normal and failure scenarios Evaluate and optimise: Airflow management Cooling systems (CRAC units, ventilation, diffusers) Data hall layouts and rack configurations Work on high- and low-density cabinet modelling , including next-generation ...