76 to 100 of 114 Apache Airflow Jobs in England

build the queries and processes required to migrate it into a new environment. As migration work concludes, the role will transition into leveraging Airflow and other tooling to automate operational and financial processes. This position requires a highly collaborative individual, as you will work closely with engineers and stakeholders … Work with solution architects to design migration-day data processes for partner onboarding. Build and maintain ETL pipelines and workflow automation using Snowflake and Apache Airflow. Document processes, learnings, and development work using version control best practices. Implement robust data quality checks and reconciliation processes throughout pipelines. Collaborate with ...

they build. What You’ll Do Build and own data pipelines that connect product, analytics, and operations Design scalable architectures using tools like dbt , Airflow , and Snowflake/BigQuery Work with engineers and product teams to make data easily accessible and actionable Help evolve their data warehouse and ensure … decisions across the stack — they love new ideas What You Bring Hands-on experience in Python and SQL Experience with modern data tools (dbt, Airflow, Prefect, Dagster, etc.) Knowledge of cloud platforms like AWS , GCP , or Azure An understanding of data modelling and ETL best practices Curiosity, creativity ...

technical and non-technical audiences Experience gathering requirements through workshops, interviews and documentation analysis Ability to thrive in fast-paced delivery environments Bonus Skills : Apache AirFlow, BigQuery, Cloud Platform certificates, Data Governance Frameworks Salary: £50,000-£55,000 Benefits: Bonus, 25 Days Holiday, Health & Dental Cover, Income Protection ...

essential) Experience with Lightdash or Looker (or similar BI tools) Solid analytical mindset with attention to detail Desirable: Experience with Python and/or Airflow Familiarity with data modelling and pipeline orchestration The client is looking to move quickly for this. If you are interested in going forward, please ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

client or similar public sector environments. Familiarity with DevOps practices and cloud-hosted platforms (AWS, Azure, SAS PaaS). Knowledge of scheduling tools - Airflow Exposure to SAS Migration Factory Delivery Models. All profiles will be reviewed against the required skills and experience. Due to the high number of applications ...

client or similar public sector environments. Familiarity with DevOps practices and cloud-hosted platforms (AWS, Azure, SAS PaaS). Knowledge of scheduling tools - Airflow Exposure to SAS Migration Factory Delivery Models. All profiles will be reviewed against the required skills and experience. Due to the high number of applications ...

root cause analysis, managing SLAs, and improving resiliency across business-critical data feeds. Requirements: SQL Python/Bash ETL/ELT support Workflow orchestration (Airflow or Dagster) AWS data services (Athena, S3, MWAA, Iceberg) Data quality monitoring & incident management Nice to Have: Airbyte DBT Apache Spark Grafana ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

scalable data solutions Your Profile Essential Skills/Knowledge/Experience Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding … management Ability to work in cross functional, agile environments Preferred Qualifications Technical Skills Strong experience with ETL/ELT tools (e.g., Informatica, Talend, DBT, Airflow, ADF) Proficiency in SQL, data modeling, and performance tuning Hands on with cloud platforms (Azure/AWS/GCP) and data services Understanding ...

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group ...

Platforms Itential Automation Platform Cisco NSO – Service development and lifecycle Apache Airflow Hasi Corp Vault Openshift Automation development Python Fast API Rest API Netconf Yang modelling XML/Json Jinja/TextFSM Pytest Unit testing Database MongoDB DevOps Docker Git CI/CD Kubernetes Networking Ciena 517x/ ...

Azure) Solid understanding of environment management, deployments & testing lifecycle Exposure to CI/CD pipelines (GitLab), automation, or IaC Nice to have: Experience with Airflow or scheduling tools Broader DevOps/platform engineering mindset If you are interested in this role, please feel free to submit your CV. ...

including managing dependencies and build pipelines without internet access Proven background building APIs for data enrichment services Orchestration & data pipeline experience with Prefect or Airflow, and K8s or Swarm Configuration and automation of business workflow tooling (e.g., Jira) Hands-on experience with a range of databases and storage technologies ...

closely with founders and customers to shape the product direction Tech Stack Frontend: React, React Native, TypeScript Backend: Python, FastAPI, PostgreSQL Infrastructure: GCP, Terraform, Airflow AI: LLM integrations and AI-driven automation What They're Looking For Experience as a Full-Stack Engineer building production systems Strong engineering fundamentals ...

high-growth B2B environment Strong technical depth across: Backend: Node.js, Typescript Frontend: React.js, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure ...

high-growth B2B environment Strong technical depth across: Backend: Node.js, Typescript Frontend: React.js, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure ...

performance reviews, and career development pathways. What We're Looking For Backend: Node.js, TypeScript Frontend: React.js, TypeScript Database: MySQL Infrastructure & Tools: AWS, ECS, Kubernetes, Airflow, Kafka, Serverless 10+ years' experience building and managing distributed engineering teams across multiple regions Proven experience leading global engineering organisations , managing regional leads rather ...

Hybrid) | Digital Transformation Consultancy Location : Manchester (Hybrid - 3 days a week) Package : £60k-£70k + Benefits Python | Cloud (AWS/Azure/GCP) | Kafka | Airflow | PostgreSQL | Observability This client builds mission‐critical digital platforms that make the UK smarter, safer, greener and healthier. They are a growing digital transformation … Design and implement scalable ETL/ELT pipelines and data models for enterprise platforms Build and operate event‐driven architectures (Kafka) and orchestrate workflows (Airflow) Implement data quality, testing and validation as first‐class concerns across pipelines Deliver monitoring and observability (Prometheus, Grafana or equivalent) and runbook automation Work ...

Microsoft SQL Server Experience working with NoSQL technologies such as DynamoDB, MongoDB or similar Hands-on Kafka (or equivalent streaming) and workflow orchestration (Airflow) experience Strong understanding of data architecture patterns including data lakes, warehouses and event-driven architectures Experience of consulting across Agile delivery environments, implementing data quality … deploy ETL/ELT pipelines to ingest, transform and optimise large-scale datasets Build and operate event-driven architectures (Kafka) and orchestrate workflows (Airflow) Apply strong data architecture principles across data lakes, warehouses and event-driven solutions Develop and maintain streaming pipelines using technologies such as Kafka Implement monitoring ...

help other members of the team. · Experience provisioning and managing AWS services using infrastructure as code such as AWS CloudFormation or Terraform. · Understanding of Apache Spark, Apache Trino or other big data and machine learning systems. · Knowledge of Serverless technologies, framework and best practices. · Experience provisioning and managing … Apache Airflow. · Exposure to using AI tools to enhance productivity and quality. Why Join RealityMine? At RealityMine, we believe our people are at the heart of everything we do. That’s why we go the extra mile to support every team member to unlock their full potential. Whether ...

these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex, large-scale … complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...

Design and implement high-throughput, fault-tolerant ingestion pipelines for both batch and streaming data into BigQuery. Architect data ingestion solutions using GCS, Dataflow (Apache Beam), Pub/Sub, Dataproc, Cloud Composer (Airflow), and BigQuery Storage Write API . Define data loading frameworks , schema evolution strategies, mapping rules … data ingestion and integration frameworks Advanced SQL and BigQuery optimization skills (partitioning, clustering, cost optimization) Hands-on experience with ETL/ELT tools (Airflow, Dataflow, dbt, etc.) Proficiency in Python and/or Java for pipeline devel ...

Group) I'm hiring a Mid-Level Data Engineer (3+ years’ experience) to help scale and optimise a robust data platform built on Python, Airflow, dbt and Redshift. 🔧 What you’ll be doing: • Scaling and optimising ELT pipelines (Python + Airflow) • Enhancing the data warehouse (performance, cost, complexity … looking for: • 3+ years in Data Engineering (FinTech/startup/scale-up ideal) • Strong Python + SQL expertise • Production-grade workflow orchestration (Airflow/Dagster/Prefect) • Deep understanding of data warehousing + ELT principles • Interest in Open Banking & payments This is a pivotal role at a high ...