14 of 14 Permanent Apache Airflow Jobs in Yorkshire

embedding models, and RAG architectures. Familiarity with document processing pipelines, chunking strategies, and semantic search patterns. Familiarity with data pipeline and orchestration tools (e.g., Airflow, dbt, Spark, Kafka, cloud-native ETL tools) and batch vs. streaming patterns. Understanding of data governance (catalog, lineage, security, RBAC, masking, compliance requirements like ...

cloud data technologies such as Redshift, Glue, S3, Lambda or IAM. Proficiency in SQL and Python for data processing and orchestration tools such as Airflow Experience with modern modelling approaches and tooling such as dbt. Practical experience with infrastructure as code and CI/CD practices BENEFITS The successful ...

SENIOR DATA ENGINEER £75,000 + BENEFITS PRIMARILY REMOTE This is an opportunity to take real ownership of a modern data platform within a growing, technology-driven bank. You will join a collaborative data team ...

EXPERIENCE The successful Lead Data Engineer will have the following skills and experience: Strong Python and SQL skills AWS or GCP Orchestration, ideally with Airflow or Dagsta but open to others Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) Terraform or Palumi BENEFITS The successful Lead Data Engineer will receive ...

commercial experience working as a Data Engineer in AWS. Solid programming skills in Python and strong SQL capability. Exposure to orchestration tools such as Airflow or Dagster. Experience with modern data warehouses such as Snowflake, Redshift or BigQuery. Infrastructure-as-code experience, ideally Terraform or Pulumi. BENEFITS The successful ...

Azure, or Google Cloud) including data lakes, warehouses, and lakehouse solutions. Transform and process structured and unstructured data using modern ETL/ELT frameworks (Apache Spark, Airflow, dbt). Collaborate closely with product managers, analysts, and software developers to ensure seamless integration and high-quality data availability. Develop ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...