1 to 25 of 27 Remote Apache Airflow Jobs in London

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

deliver high-quality, reliable data. Governance & Quality: Use Dataplex for cataloguing, classification, and governance; enforce data standards and validation. Automation & Orchestration: Design workflows in Apache Airflow and automate data quality checks, schema changes, and lifecycle processes. Continuous Improvement: Champion best practices, mentor junior engineers, and push for scalable … Dataproc, Dataplex. Strong development skills in Java and Python. Experience with weblog ingestion & processing, both real-time and batch. Solid hands-on use of Apache Airflow. Familiarity with AWS Kinesis Firehose for log/data ingestion. Knowledge of data governance, metadata management, and stewardship. Comfort working with clickstream/ ...

maintain highly reliable and well-tested data and ML pipelines to extract, transform, and structure large datasets for ML applications. Expertise in using Apache Airflow (or similar orchestration tools like Prefect/Dagster) to define, schedule, and monitor complex data and ML workflows (DAGs). Implement comprehensive software … engineering teams. Bonus Skills to Stand Out (Optional): Experience with CI/CD tooling (e.g., GitHub Actions, Jenkins) specifically for ML pipelines and Airflow DAG deployment. Experience with data quality monitoring tools and frameworks. Master's or PhD in Computer Science, Data Science, or a related field. Relevant certifications ...

governance, and data architecture. Familiarity with modern data architectures and cloud-based/distributed systems. Proficiency in SQL, Python and data pipeline tools (e.g., Apache Airflow, Spark). Experience working with major cloud platforms (AWS, Azure, GCP) and big data technologies. Awareness of data governance, data sharing across ...

performance, cost efficiency, and scalability.* Troubleshoot and resolve data pipeline issues swiftly and effectively across the data platform.* Work with orchestration tools such as Airflow, ADF, or Prefect to schedule and automate workflows.* Keep abreast of industry trends and emerging technologies in data engineering, and continuously improve your skills ...

complex or secure environments Strong understanding of data modelling, data integration and data management principles Proficiency in SQL, Python and pipeline tools (e.g., Airflow, Spark) Experience with cloud platforms such as AWS, Azure or GCP Awareness of modern data architectures, analytics and visualisation tooling Strong analytical skills and ability ...

have indepth technical knowledge of Python for data workflows, SQL and Data Modelling, DBT, Cloud platforms (AWS, GCP or Azure), Workflow Orchestration tools (e.g. Airflow, Dagster, Prefect, DBT Cloud), CI/CD (GitHub Actions, GitLab CI, CircleCI) You have experience of leading technical deployments, running customer projects, diagnosing issues ...

cloud services and Databricks . Advanced proficiency in Python and SQL for data engineering. Experience with ETL/ELT tools and orchestration frameworks (e.g., Airflow, dbt). Strong knowledge of data warehousing and cloud-based data architectures. Understanding of BI tools such as Power BI or Tableau. Strong problem ...

data pipelines using Python and SQL to ensure clean, reliable, and well-structured data. You'll design and optimise workflows using tools such as Airflow and dbt to support scalable, high-quality analytics layers. You'll help architect and evolve cloud-based data platforms across technologies like BigQuery, Redshift ...

models that support analytics, machine learning, and operational use cases. The role involves working with modern data stack technologies such as Databricks, AWS, dbt, Airflow, and Looker. They lead complex technical initiatives, improve engineering efficiency through better CI/CD, observability, and tooling, and ensure data reliability at scale. ...

Factory (ADF) and Python . Ensure high-quality raw datasets to enable accurate analytics and data modeling. Deploy and maintain data tools on Kubernetes (Airflow, Superset, RStudio Connect). Support Data Analytics initiatives through DBT , DevOps , and deployment governance. You will work closely with a small, focused team, contributing ...

environments Strong Python for automation workflows and data pipelines Proficiency in SQL, data warehousing, and cloud platforms (GCP/Azure preferred) Experience with dbt, Airflow, or similar data modeling tools Understanding of digital marketing data (GA4, ad servers, programmatic platforms) Team management/mentoring experience with collaborative leadership style ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

operate effectively in a fast-paced, scaling organisation. Excellent communication skills and a collaborative approach. Desirable Skills Experience with analytics engineering tools (e.g., dbt, Airflow). Familiarity with experimentation frameworks and A/B testing platforms. Exposure to cloud-based data environments (e.g., Google Cloud Platform). Experience within ...

Adobe Analytics, GTM and Adobe Dynamic Tag Manager) changes. Integrate data sources via web and REST APIs. Data pipping and modelling using SQL, DBT, Airflow, ETL, Data Warehousing, Redshift and Python. Transfer knowledge of the business processes and requirements to the development teams. Collaborate with Product, Marketing and Development ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

Build and optimise scalable data pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality data validation Translate business needs into technical solutions with full ownership What You Need … engineering/analytics/software Strong Python + SQL 2+ years ETL, APIs, CI/CD, Docker, AWS Ideally but not essential experience with Airflow/Prefect/Dagster Background in Financial Services, FinTech, Insurance, PE/VC, or Banking Package & Benefits High performance bonus 25 days holiday Pension ...

right individual. You will play a pivotal role in evolving the company's data stack, working with modern tools such as DBT and Airflow, and developing scalable, high-quality data pipelines and infrastructure. Key Responsibilities: Lead the evolution of the company's data stack, with a focus on automation … managing complex data estates and developing automated data pipelines. Good understanding of testing principles and deployment processes. Experience with technologies such as Redshift, Airflow, DBT, and AWS. Strong grasp of data modelling, database architecture, and governance principles. Hands-on experience with Git and modern development workflows. Excellent problem-solving ...

Nice-to-Have Skills: Experience with GCP/BigQuery or other cloud data warehouses (e.g., Snowflake, Redshift). Familiarity with data orchestration tools (e.g., Airflow). Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). Exposure to CI/CD pipelines, ideally using ...

Nice-to-Have Skills: ·Experience with GCP/BigQuery or other cloud data warehouses (e.g., Snowflake, Redshift). ·Familiarity with data orchestration tools (e.g., Airflow). ·Experience with data visualisation platforms (such as Preset.io/Apache Superset or other). ·Exposure to CI/CD pipelines, ideally using ...