1 to 25 of 72 Apache Airflow Jobs in the UK excluding London

Platform DevOps team to build and run highly reliable CI/CD pipelines and infrastructure for the bank’s modern data estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform ...

governance, security, and regulatory compliance . Ability to work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI ...

driving innovation in data engineering. Desirable Criteria Experience delivering data pipelines on Hortonworks/Cloudera on-prem and leading cloud migration initiatives. Familiarity with: Apache Airflow Data modelling and metadata management Experience influencing enterprise data strategy and contributing to architectural governance. To apply for this position please submit ...

/GCP beneficial) Strong data modelling knowledge Understanding of data governance and security best practices Ability to translate business needs into scalable solutions Desirable Airflow, dbt, Kafka, CI/CD, BI tools, governance platforms, financial services experience. Interested in building modern, enterprise-scale data platforms in a highly regulated ...

cloud data technologies such as Redshift, Glue, S3, Lambda or IAM. Proficiency in SQL and Python for data processing and orchestration tools such as Airflow Experience with modern modelling approaches and tooling such as dbt. Practical experience with infrastructure as code and CI/CD practices BENEFITS The successful ...

cloud data technologies such as Redshift, Glue, S3, Lambda or IAM. Proficiency in SQL and Python for data processing and orchestration tools such as Airflow Experience with modern modelling approaches and tooling such as dbt. Practical experience with infrastructure as code and CI/CD practices BENEFITS The successful ...

days per week in the office. • A collaborative culture and clear opportunities for technical growth. • Exposure to modern tooling including AWS, Redshift, Airflow, Terraform, and dbt. • The chance to shape a data platform and have meaningful influence on engineering standards. How to Apply If you are interested in this ...

days per week in the office. * A collaborative culture and clear opportunities for technical growth. * Exposure to modern tooling including AWS, Redshift, Airflow, Terraform, and dbt. * The chance to shape a data platform and have meaningful influence on engineering standards. How to Apply If you are interested in this ...

based data engineering, including Redshift, S3, IAM and related services Building and maintaining data pipelines using Python and SQL Orchestration tools such as Airflow Data modelling and warehouse architecture in modern cloud environments Git-based development and Infrastructure as Code (e.g. Terraform) Desirable experience includes exposure to regulated industries ...

provisioning automation. Nice to Have Skills: Experience with Power BI, DAX, and data modeling for optimized reporting. Knowledge of big data orchestration tools like Apache Airflow. Previous exposure to regulated environments such as finance, healthcare, or gaming. Experience in a lottery or similar domain is a plus. Preferred Education ...

modern cloud data warehouse (e.g., Snowflake, BigQuery, Redshift, or Azure Synapse). Experience with transformation tooling (e.g., dbt or equivalent) and orchestration (e.g., Airflow, Azure Data Factory, or similar). Proficiency with Git-based version control and CI/CD principles. Understanding of data governance, lineage, and metric definitions. ...

role Strong proficiency in SQL, Python and Spark (PySpark) Experience designing data models and implementing reliable pipeline patterns Knowledge of orchestration tools such as Airflow Experience with low-code or no-code integration tools Hands-on experience with cloud platforms (AWS preferred), including services for storage, transformation and warehousing ...

Skills and Experience * Strong commercial experience working with AWS in production environments. * Proficiency in Python and SQL for data processing and orchestration. * Experience with Airflow for workflow management. * Knowledge of cloud data warehousing, ideally Redshift. * Experience with infrastructure as code and CI/CD tooling such as Terraform ...

with a strong focus on ETL/ELT. • Advanced SQL and Python development skills. • Hands-on experience with DBT, GIT, Terraform, Docker, IAM, and Airflow (Composer). • Proven experience working on cloud platforms – ideally GCP (BigQuery), but Azure or AWS also considered. • Strong understanding of Data Mesh, Test Driven ...

compliance across data services that underpin critical national infrastructure programmes. Preferred Tech Stack Expertise Google Cloud Platform including BigQuery, Cloud SQL and Cloud Composer, Apache Airflow, Dataplex, Dataform, Great Expectations or similar data quality tools, Terraform, Python and SQL Responsibilities Lead design and delivery of enterprise-scale data ...

1classification ) Strong SQL&Python Hands-onETL/ELTexperience(e.g.,Matillion,Talend,Fivetran,ADF) Experiencewith Snowflake (AWS/Azure/GCPbeneficial) Strongdatamodellingknowledge Understandingofdatagovernanceandsecuritybestpractices Abilitytotranslatebusinessneedsintoscalablesolutions Desirable Airflow,dbt,Kafka,CI/CD,BItools,governanceplatforms,financialservicesexperience. Interestedinbuildingmodern,enterprise-scaledataplatformsinahighlyregulatedenvironment Applynow ...

processes Experience working within Agile delivery environments Desirable Experience: Experience with cloud platforms such as AWS Familiarity with job scheduling or orchestration tools (e.g. Airflow or similar) Knowledge of reporting and visualisation tools such as Power BI, Business Objects, or Pentaho Experience with CI/CD and version control ...

while contributing to best practices across the wider platform. You'll be working heavily with Python , SQL and Spark , using tools such as Databricks , Airflow , dbt and Kafka within AWS . Experience with modern data stacks is important, along with a solid understanding of data warehousing concepts, ETL/ ...

SENIOR DATA ENGINEER £75,000 + BENEFITS MANCHESTER (Hybrid) This is an opportunity to take real ownership of a modern data platform within a growing, technology-driven bank. You will join a collaborative data team ...

Experience with AWS and cloud-native data engineering patterns Clear communicator who can work effectively with both technical colleagues and business stakeholders Exposure to Apache Airflow, Databricks Workflows, or Informatica Cloud is a bonus — as are Databricks or AWS certifications Why Join Us? You'll be part ...

modern data warehouse such as Snowflake, Redshift, or BigQuery. Experience building and maintaining ETL pipelines and data models. Knowledge of orchestration tools such as Airflow or Dagster. Infrastructure-as-code experience such as Terraform or similar. A background working in smaller, high-growth companies or strong engineering-led environments. ...

Overview Lead a team of Data Analysts and own the delivery of high-impact analytical products using modern data engineering tooling (AWS, Databricks, dbt, Airflow). You will bridge the gap between business stakeholders and the data platform. Key Responsibilities Lead and mentor a team of Data Analysts Build … maintain self-serve analytical assets using dbt models and Databricks Design and orchestrate analytical pipelines in Airflow Translate complex business requirements into actionable insights and dashboards Perform deep-dive analysis across Retail, Commercial, Risk and Marketing domains Ensure all deliverables meet strict data governance and regulatory standards Work closely ...

Required Data Integration & Ingestion Data Manipulation & Processing GitHub, GitHub Actions, Azure DevOps Azure Data Factory Databricks SQL Database Azure Synapse Stream Analytics AWS Glue Apache Airflow AWS Kinesis Amazon Redshift SonarQube PyTest Optional/Nice to Have Experience managing projects or running Scrum teams Experience with BPC/ ...

locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...