1 to 25 of 30 Contract Apache Airflow Jobs in the UK

technical delivery of data platforms and pipelines built in AWS-with a focus on AWS Glue, Managed Workflows for Apache Airflow (MWAA), and Python-and collaborate closely with Directors, Senior Architects, and Program Leadership to deliver business outcomes at scale. This is a player-coach role: you will … Your Responsibilities: Lead the design and implementation of scalable, secure, and cost-efficient ETL/ELT pipelines using AWS Glue, Python (PySpark), and MWAA (Airflow). Define solution architectures, data models, orchestration patterns, and CI/CD for data workflows. Own the technical roadmap, decomposition, and delivery plan-including ...

Platform DevOps team to build and run highly reliable CI/CD pipelines and infrastructure for the bank’s modern data estate (AWS + Airflow + Databricks). Key Responsibilities Design, build and maintain Infrastructure as Code using CloudFormation and AWS services Manage and scale Apache Airflow … call rotation and incident resolution Essential Skills & Experience 5+ years as a DevOps/Platform Engineer Strong AWS experience + CloudFormation Production experience with Apache Airflow (MWAA) Lambda , Linux + Bash scripting CI/CD expertise (Git, Jenkins, GitHub Actions) IaC and GitOps practices Nice to Have Terraform ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest … predictive analytics, recommendation engines, and customer behaviour analytics. Ability to design AI-ready data platforms for future analytics use cases. Preferred Skills Experience with Apache Airflow for pipeline orchestration. Knowledge of CI/CD pipelines, DevOps, and Git-based development workflows. Experience with data governance, metadata management ...

with SQL and modern data warehousing technologies (e.g., Snowflake, BigQuery, Redshift, Databricks). Proven experience building production-ready pipelines using tools such as dbt, Airflow, Dagster, Prefect, or similar. Experience integrating data from HRIS and talent systems (e.g., Workday, BambooHR, Greenhouse, Lever, HiBob, Personio). Ability to work with ...

with dimensional modelling, star schemas, SCDs etc.Experience within regulated financial servicesDesirableExperience in pensions, asset management or institutional investingUnderstanding of performance measurement and attributionExposure to Airflow or dbtCloud platform familiarity (Azure or AWS)Knowledge of data governance best practiceAbout YouHighly detail-driven with a strong approach to data qualityComfortable operating ...

architects & product teams Driving best practice across the data platform Tech stack Snowflake, SQL, Python, dbt, AWS (or Azure/GCP), CI/CD, Airflow/Prefect/Dagster, Fivetran/Matillion Ideal profile Strong Snowflake engineering background Comfortable owning end-to-end pipeline delivery Experience in regulated environments ...

behavioural data (web, apps, ads, etc.) Awareness of privacy and governance considerations Familiarity with AWS-based data stacks (S3, Spark/EMR, Athena, Airflow, notebooks) How you'll work Hybrid role, Manchester-based 2 days per week in the office, the rest flexible Flexible start and finish times Data ...

processes with strong monitoring, logging and error handling Develop and maintain data models to support reporting and analytics Manage workflow orchestration and scheduling (e.g. Airflow or similar) Support CI/CD, version control and deployments across dev, test and production environments Implement data quality checks, governance and documentation Collaborate ...

architecture to support data consumption for reporting systems, operational applications, and analytics platforms. Implement automation, orchestration, and scalable pipeline frameworks using tools such as Apache Airflow. Collaborate with business stakeholders and technical teams to align the data platform with enterprise data strategy. Support hospitality analytics use cases, including guest ...

understanding ML pipelines and models in a production setting. Direct experience with Google Cloud Platform, BigQuery, and associated tooling. Experience with workflow tools like Airflow or Kubeflow. Familiarity with dbt (Data Build Tool). Please send your CV for more information on these roles. Reasonable Adjustments: Respect and equality ...

match/merge, survivorship, stewardship, integrations. Data integration: APIs/events, batch/streaming ingestion, CDC, lineage. Data engineering: data lake/lakehouse, orchestration (Airflow/MWAA), ETL/ELT (e.g., Glue), DQ frameworks. Discovery services: BI/analytics (Power BI/Tableau), ML feature pipelines, self-service data ...

with non-technical teams Experience working with operational or business process data Desirable: Experience with Zendesk or similar customer/operations platforms Familiarity with Airflow Python experience Experience working with operational data ...

with non-technical teams Experience working with operational or business process data Desirable: Experience with Zendesk or similar customer/operations platforms Familiarity with Airflow or similar orchestration tools Python experience for data processing or automation Experience working with operational, transactional, or workflow-driven datasets ...

background as a Machine Learning Engineer. Technical Skills: Strong in SQL and Python (Pandas, Scikit-learn, Jupyter, Matplotlib). Data transformation & manipulation : experience with Airflow, DBT and Kubeflow Cloud: Experience with GCP and Vertex AI (developing ML services). Expertise: Solid understanding of computer science fundamentals and time-series ...

MLOps tooling such as SageMaker, MLflow, or TFServing * Experience with Spark, Databricks, CI/CD tools, and streaming or orchestration systems like Kafka or Airflow How to Apply If you are interested in this Machine Learning Engineer position, please apply with your CV. ...

experience (Lightdash, Looker or similar) Experience identifying automation opportunities within data workflows Strong stakeholder engagement skills (non-technical teams) Nice to Have Exposure to Airflow Python experience ...

experience (Lightdash, Looker or similar) Experience identifying automation opportunities within data workflows Strong stakeholder engagement skills (non-technical teams) Nice to Have Exposure to Airflow Python experience ...

scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding … management Ability to work in cross functional, agile environments Preferred Qualifications Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding ...

secrets and access control using Azure Key Vault and Azure AD Enable hybrid connectivity between on-premises and cloud environments Support orchestration workflows using Apache Airflow Monitor system performance using tools such as Azure Monitor, Prometheus, and Grafana Collaborate across engineering teams to ensure reproducibility, scalability, and compliance … Solid understanding of cloud networking (hub/spoke, private endpoints) Experience troubleshooting infrastructure and deployment issues Strong collaboration and communication skills Desirable: Experience with Airflow or similar orchestration tools Knowledge of observability tooling (Prometheus, Grafana) Exposure to AI/ML platform environments Qualifications Relevant degree or equivalent industry experience ...

initial 6-month contract. Key Skills: Snowflake Agile methodology and working within small multiskilled feature teams. Knowledge of older coding standards and practices. AWS Airflow, Python nice to have. If you find this opportunity intriguing and aligning with your skill set, we welcome the submission of your CV without ...

client or similar public sector environments. Familiarity with DevOps practices and cloud-hosted platforms (AWS, Azure, SAS PaaS). Knowledge of scheduling tools - Airflow Exposure to SAS Migration Factory Delivery Models. All profiles will be reviewed against the required skills and experience. Due to the high number of applications ...

client or similar public sector environments. Familiarity with DevOps practices and cloud-hosted platforms (AWS, Azure, SAS PaaS). Knowledge of scheduling tools - Airflow Exposure to SAS Migration Factory Delivery Models. All profiles will be reviewed against the required skills and experience. Due to the high number of applications ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

Azure) Solid understanding of environment management, deployments & testing lifecycle Exposure to CI/CD pipelines (GitLab), automation, or IaC Nice to have: Experience with Airflow or scheduling tools Broader DevOps/platform engineering mindset If you are interested in this role, please feel free to submit your CV. ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...