101 to 125 of 131 Apache Airflow Jobs in the UK

client or similar public sector environments. Familiarity with DevOps practices and cloud-hosted platforms (AWS, Azure, SAS PaaS). Knowledge of scheduling tools - Airflow Exposure to SAS Migration Factory Delivery Models. All profiles will be reviewed against the required skills and experience. Due to the high number of applications ...

root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte DBT Apache Spark Grafana ...

Hybrid) | Digital Transformation Consultancy Location : Manchester (Hybrid - 3 days a week) Package : £60k-£70k + Benefits Python | Cloud (AWS/Azure/GCP) | Kafka | Airflow | PostgreSQL | Observability This client builds mission‐critical digital platforms that make the UK smarter, safer, greener and healthier. They are a growing digital transformation … Design and implement scalable ETL/ELT pipelines and data models for enterprise platforms Build and operate event‐driven architectures (Kafka) and orchestrate workflows (Airflow) Implement data quality, testing and validation as first‐class concerns across pipelines Deliver monitoring and observability (Prometheus, Grafana or equivalent) and runbook automation Work ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding … management Ability to work in cross functional, agile environments Preferred Qualifications Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding ...

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group ...

Platforms Itential Automation Platform Cisco NSO – Service development and lifecycle Apache Airflow Hasi Corp Vault Openshift Automation development Python Fast API Rest API Netconf Yang modelling XML/Json Jinja/TextFSM Pytest Unit testing Database MongoDB DevOps Docker Git CI/CD Kubernetes Networking Ciena 517x/ ...

SaaS company in their search for a Data Analyst to join their team. The team runs the end-to-end data stack - pipelines in Airflow (Cloud Composer), warehouse modelling in BigQuery/dbt, and analytics through Looker and embedded GoodData - enabling teams and customers to make better data-driven ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

SaaS company in their search for a Data Analyst to join their team. The team runs the end-to-end data stack - pipelines in Airflow (Cloud Composer), warehouse modelling in BigQuery/dbt, and analytics through Looker and embedded GoodData - enabling teams and customers to make better data-driven ...

Azure) Solid understanding of environment management, deployments & testing lifecycle Exposure to CI/CD pipelines (GitLab), automation, or IaC Nice to have: Experience with Airflow or scheduling tools Broader DevOps/platform engineering mindset If you are interested in this role, please feel free to submit your CV. ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

closely with founders and customers to shape the product direction Tech Stack Frontend: React, React Native, TypeScript Backend: Python, FastAPI, PostgreSQL Infrastructure: GCP, Terraform, Airflow AI: LLM integrations and AI-driven automation What They're Looking For Experience as a Full-Stack Engineer building production systems Strong engineering fundamentals ...

high-growth B2B environment Strong technical depth across: Backend: Node.js, Typescript Frontend: React.js, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure ...

high-growth B2B environment Strong technical depth across: Backend: Node.js, Typescript Frontend: React.js, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure ...

performance reviews, and career development pathways. What We're Looking For Backend: Node.js, TypeScript Frontend: React.js, TypeScript Database: MySQL Infrastructure & Tools: AWS, ECS, Kubernetes, Airflow, Kafka, Serverless 10+ years' experience building and managing distributed engineering teams across multiple regions Proven experience leading global engineering organisations , managing regional leads rather ...

these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex, large-scale … complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...

these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex, large-scale … complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...

Group) I'm hiring a Mid-Level Data Engineer (3+ years’ experience) to help scale and optimise a robust data platform built on Python, Airflow, dbt and Redshift. 🔧 What you’ll be doing: • Scaling and optimising ELT pipelines (Python + Airflow) • Enhancing the data warehouse (performance, cost, complexity … looking for: • 3+ years in Data Engineering (FinTech/startup/scale-up ideal) • Strong Python + SQL expertise • Production-grade workflow orchestration (Airflow/Dagster/Prefect) • Deep understanding of data warehousing + ELT principles • Interest in Open Banking & payments This is a pivotal role at a high ...

Design strategies for data discoverability, lineage tracking, and metadata management. What They’re Looking For Extensive experience building production-grade data platforms using dbt, Airflow, Spark, and Snowflake. Practical knowledge of data mesh principles and federated data architectures. Solid understanding of AWS cloud infrastructure, including networking, IAM, and compute. … drive alignment across teams without formal authority. Strong prioritisation instincts, balancing deep technical work with organizational needs. Nice to Have Familiarity with the Apache Iceberg table format. Knowledge of data contract frameworks and schema validation tooling. Why Join? You will join a high-performance team where engineering quality ...

security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented … engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product ...

Data Lead Central London | Hybrid Up to £120k dbt, Python, Airflow, Looker, SQL We’re partnered with a high-growth fintech company looking to hire a Data Lead to take ownership of a critical data platform that powers commercial performance and incentive models across Europe. These systems distribute tens … Data Engineering roles Leadership and mentoring experience Strong SQL and modern data stack experience (dbt preferred) Experience with Python and orchestration tools such as Airflow Experience building scalable data pipelines and data products Experience working closely with business stakeholders Drop me a message or email emy@burnssheehan.co.uk ...

value and accelerate data maturity.• Manage delivery across engineering, data science, and external vendors, ensuring deadlines and quality standards are met.• Oversee ingestion pipelines (Airflow, DBT, Glue) into AWS S3 and Redshift, ensuring reliability, scalability, and compliance.• Enable Insights, Marketing, and Commercial teams through dashboards, APIs, and curated datasets. … Manager or Data Product Owner within analytics, data platforms, or customer data domains.• Hands-on familiarity with AWS technologies (S3, Redshift) and orchestration tools (Airflow, DBT, Glue).• Strong understanding of data modelling, identity resolution, and data activation use cases.• Ability to translate business needs into clear technical requirements ...

Data Engineer (Snowflake & Airflow) London/Edinburgh 6 Month Contract Via Umbrella Our UK leading banking client are looking for a Data Engineer to join their team on an initial 6-month contract. Key Skills: Snowflake Agile methodology and working within small multiskilled feature teams. Comfortable with … version control. Knowledge of older coding standards and practices. AWS Airflow, Python nice to have. If you find this opportunity intriguing and aligning with your skill set, we welcome the submission of your CV without Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business ...

quality solutions. Responsibilities: Build and optimise Azure data pipelines Maintain Databricks data platforms for analytics and reporting Implement transformations using dbt Orchestrate workflows with Airflow Support platform migrations and modernisation Apply engineering best practices, version control, and CI/CD Document solutions and contribute to technical discussions Collaborate with … client teams on scalable solutions Essential Experience: Hands-on Azure data platform experience Proficiency in Databricks DBT experience in enterprise environments Airflow workflow orchestration Exposure to a mix of industry backgrounds Desirable Experience: Consultancy or multi-client delivery experience Input into platform design and architecture Experience in regulated ...