9 of 9 Apache Airflow Jobs in the North West

using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both technical ...

cloud platform (Azure, AWS or GCP). Exposure to big data technologies such as Spark or Hadoop. Experience with ETL/orchestration tools like Airflow, Talend or Azure Data Factory. Understanding of data warehousing solutions (Snowflake, BigQuery, Redshift or similar). Good understanding of data governance, GDPR and modern ...

tuning. Hands-on expertise with Fivetran and dbt. Good understanding of data modelling, governance, and security best practices. Familiarity with orchestration tools such as Airflow or Prefect (advantageous). Experience working in Azure (or AWS/GCP). Strong analytical and collaboration skills, with great attention to detail. ...

will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values ...

. Develop robust backend systems and APIs to support workflows. Build and maintain CI/CD pipelines, infrastructure-as-code, and container orchestration (Kubernetes, Airflow, Databricks Jobs). Ensure best practices in model tracking, versioning, performance monitoring, logging, and retraining workflows. Collaborate with cross-functional teams to align technical ...

Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, working hands on with; Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously ...

management. Requirements for the Principal Data Engineer: Experience as a lead or principal data engineer. Prior experience designing data platform(s) within GCP, across Airflow, Big Query, Data Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh design and Data Lake/Warehouse solutions. Previously led teams ...

experienced team members and fostering a culture of knowledge sharing Communicating clearly and effectively with diverse technical and non-technical audiences Tech stack Python , Airflow , Terraform Azure (but open to other cloud experience) DBT (nice to have) Exposure to ML pipelines beneficial ...