376 to 400 of 549 Apache Airflow Jobs in England

delivering enterprise-grade SaaS applications in a high-growth B2B environment Strong technical depth across: Backend: Node.js, Typescript Frontend: React.js, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally, exposure to cybersecurity platforms More ❯

execution. Ability to work under pressure and manage competing priorities. Desirable Qualifications: Familiarity with DevOps practices and cloud-hosted platforms (AWS, Azure, SAS PaaS). Knowledge of scheduling tools - Airflow Exposure to SAS Migration Factory Delivery Models. The successful candidate will also need to be SC Vetted. All profiles will be reviewed against the required skills and experience. Due More ❯

Job Title: Airflow/AWS Data Engineer Location: Manchester Area (3 days per week in the office) Rate: Up to £400 per day inside IR35 Start Date: 03/11/2025 Contract Length: Until 31st December 2025 Job Type: Contract Company Introduction: An exciting opportunity has become available with one of our sector-leading financial services clients. They … to join their growing data engineering function. This role will play a key part in designing, deploying, and maintaining modern cloud infrastructure and data pipelines, with a focus on Airflow, AWS, and data platform automation. Key Responsibilities: Deploy and manage cloud infrastructure across Astronomer Airflow and AccelData environments. Facilitate integration between vendor products and core systems, including data … Establish and enforce best practices for cloud security, scalability, and performance. Configure and maintain vendor product deployments, ensuring reliability and optimized performance. Ensure high availability and fault tolerance for Airflow clusters. Implement and manage monitoring, alerting, and logging solutions for Airflow and related components. Perform upgrades, patches, and version management for platform components. Oversee capacity planning and resource More ❯

in AWS. Strong expertise with AWS services, including Glue, Redshift, Data Catalog, and large-scale data storage solutions such as data lakes. Proficiency in ETL/ELT tools (e.g. Apache Spark, Airflow, dbt). Skilled in data processing languages such as Python, Java, and SQL. Strong knowledge of data warehousing, data lakes, and data lakehouse architectures. Excellent analytical More ❯

in AWS. Strong expertise with AWS services, including Glue, Redshift, Data Catalog, and large-scale data storage solutions such as data lakes. Proficiency in ETL/ELT tools (e.g. Apache Spark, Airflow, dbt). Skilled in data processing languages such as Python, Java, and SQL. Strong knowledge of data warehousing, data lakes, and data lakehouse architectures. Excellent analytical More ❯

at scale Champion clean code, observability, and continuous delivery Mentor and inspire other engineers Tech you’ll use: C#, Go, Kubernetes, GCP, SQL Server, MongoDB, GitOps (Argo CD), BigQuery, Airflow You’ll join a collaborative, forward-thinking team where experimentation and autonomy are encouraged — and where your impact will be felt across millions of users worldwide. More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

At Kwalee, we foster an environment where creativity and collaboration come together. Specialising in both the development and publishing of casual and hybrid casual games, we also bring our creative touch to publishing PC & Console titles, ensuring a diverse and More ❯

At Kwalee, we foster an environment where creativity and collaboration come together. Specialising in both the development and publishing of casual and hybrid casual games, we also bring our creative touch to publishing PC & Console titles, ensuring a diverse and More ❯

Lead Data Engineer Python, DBT, Airflow, Terraform, GCP/AWS London (Hybrid 1-2 Days) £120K-£140K OB is partnered with an exciting Unicorn FinTech that are on a mission to transform lending with a central focus on data. As a Lead Engineer, you will set the technical direction for our data platform and shape how data enables every … you Have 7+ years in data or backend engineering, including 2+ years in a lead or technical decision-making role. Are fluent in the modern data stack: DBT, BigQuery, Airflow, Terraform, GCP or AWS. Bring strong software engineering skills: Python, SQL, CI/CD, DevOps mindset. Understand data warehousing, ETL/ELT, orchestration, and streaming pipelines. Thrive in cross … functional product squads and collaborative work. If you are interested in this role, please send your CV to Lead Data Engineer Python, DBT, Airflow, Terraform, GCP/AWS London (Hybrid 1-2 Days) £120K-£140K More ❯

Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K OB is partnered with an exciting Unicorn FinTech that are on a mission to transform lending with a central focus on data. As a Lead Engineer, you will set the technical direction for our data platform and shape how data enables every … you Have 7+ years in data or backend engineering, including 2+ years in a lead or technical decision-making role. Are fluent in the modern data stack: DBT, BigQuery, Airflow, Terraform, GCP or AWS. Bring strong software engineering skills: Python, SQL, CI/CD, DevOps mindset. Understand data warehousing, ETL/ELT, orchestration, and streaming pipelines. Thrive in cross … functional product squads and collaborative work. If you are interested in this role, please send your CV to jonah.brookes@oliverbernard.com Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K More ❯

Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K OB is partnered with an exciting Unicorn FinTech that are on a mission to transform lending with a central focus on data. As a Lead Engineer, you will set the technical direction for our data platform and shape how data enables every … you Have 7+ years in data or backend engineering, including 2+ years in a lead or technical decision-making role. Are fluent in the modern data stack: DBT, BigQuery, Airflow, Terraform, GCP or AWS. Bring strong software engineering skills: Python, SQL, CI/CD, DevOps mindset. Understand data warehousing, ETL/ELT, orchestration, and streaming pipelines. Thrive in cross … functional product squads and collaborative work. If you are interested in this role, please send your CV to jonah.brookes@oliverbernard.com Lead Data Engineer | Python, DBT, Airflow, Terraform, GCP/AWS | London (Hybrid 1-2 Days) | £120K-£140K More ❯

ELT pipelines to support analytics, ML models, and business intelligence Develop scalable batch and streaming data pipelines to process millions of events and transactions daily Implement workflow orchestration using Airflow, Dagster, or similar tools Build data validation and quality monitoring frameworks to ensure data accuracy and reliability Collaborate cross-functionally with Software, ML, and Analytics teams to deliver production … Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed systems, batch and streaming data (Kafka, Kinesis) Knowledge of IaC (Terraform, CloudFormation) and containerisation (Docker, Kubernetes) Nice to have: Experience with dbt, feature stores More ❯

ELT pipelines to support analytics, ML models, and business intelligence Develop scalable batch and streaming data pipelines to process millions of events and transactions daily Implement workflow orchestration using Airflow, Dagster, or similar tools Build data validation and quality monitoring frameworks to ensure data accuracy and reliability Collaborate cross-functionally with Software, ML, and Analytics teams to deliver production … Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed systems, batch and streaming data (Kafka, Kinesis) Knowledge of IaC (Terraform, CloudFormation) and containerisation (Docker, Kubernetes) Nice to have: Experience with dbt, feature stores More ❯

ELT pipelines to support analytics, ML models, and business intelligence Develop scalable batch and streaming data pipelines to process millions of events and transactions daily Implement workflow orchestration using Airflow, Dagster, or similar tools Build data validation and quality monitoring frameworks to ensure data accuracy and reliability Collaborate cross-functionally with Software, ML, and Analytics teams to deliver production … Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed systems, batch and streaming data (Kafka, Kinesis) Knowledge of IaC (Terraform, CloudFormation) and containerisation (Docker, Kubernetes) Nice to have: Experience with dbt, feature stores More ❯

ELT pipelines to support analytics, ML models, and business intelligence Develop scalable batch and streaming data pipelines to process millions of events and transactions daily Implement workflow orchestration using Airflow, Dagster, or similar tools Build data validation and quality monitoring frameworks to ensure data accuracy and reliability Collaborate cross-functionally with Software, ML, and Analytics teams to deliver production … Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed systems, batch and streaming data (Kafka, Kinesis) Knowledge of IaC (Terraform, CloudFormation) and containerisation (Docker, Kubernetes) Nice to have: Experience with dbt, feature stores More ❯

ELT pipelines to support analytics, ML models, and business intelligence Develop scalable batch and streaming data pipelines to process millions of events and transactions daily Implement workflow orchestration using Airflow, Dagster, or similar tools Build data validation and quality monitoring frameworks to ensure data accuracy and reliability Collaborate cross-functionally with Software, ML, and Analytics teams to deliver production … Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed systems, batch and streaming data (Kafka, Kinesis) Knowledge of IaC (Terraform, CloudFormation) and containerisation (Docker, Kubernetes) Nice to have: Experience with dbt, feature stores More ❯

ELT pipelines to support analytics, ML models, and business intelligence Develop scalable batch and streaming data pipelines to process millions of events and transactions daily Implement workflow orchestration using Airflow, Dagster, or similar tools Build data validation and quality monitoring frameworks to ensure data accuracy and reliability Collaborate cross-functionally with Software, ML, and Analytics teams to deliver production … Python and SQL skills (Pandas, PySpark, query optimisation) Cloud experience (AWS preferred) including S3, Redshift, Glue, Lambda Familiarity with data warehousing (Redshift, Snowflake, BigQuery) Experience with workflow orchestration tools (Airflow, Dagster, Prefect) Understanding of distributed systems, batch and streaming data (Kafka, Kinesis) Knowledge of IaC (Terraform, CloudFormation) and containerisation (Docker, Kubernetes) Nice to have: Experience with dbt, feature stores More ❯

efficient storage and retrieval, streaming, and ETL/ELT, with a focus on Top down/bottom up data modelling methodologies. Orchestrate complex data workflows using modern tools like Airflow and dbt. Champion best practices for DevOps, DataOps , including testing, CI/CD, orchestration, and monitoring. Keeping systems observable and healthy , monitoring for data drift, model degradation, and service … for AWS or GCP . Expertise in data engineering: pipelines , modeling, batch vs. event streaming, and ETL/ELT. Demonstrated experience with modern data orchestration and transformation tools, including Airflow and dbt. Proven knowledge of data warehouse design and data lake architecture , with specific expertise in data modeling methodologies like Kimball or Inmon . At JET, this is on More ❯

structure, and transform data to maintain high quality, consistency, and efficiency across analytical and operational systems. Develop, test, and deploy automated data workflows and orchestration using tools such as Airflow, DBT, or similar frameworks. Build, maintain, and enhance data models and semantic layers to support BI, analytics, and AI initiatives. Collaborate with analysts and business teams to develop and … data platforms, ideally Google Cloud Platform (BigQuery, Cloud Storage, Cloud Functions) or equivalents such as AWS Redshift or Azure Synapse. Practical experience using modern data tooling such as DBT, Airflow, or Prefect for orchestration, transformation, and workflow automation. Experience designing and maintaining data models and schemas to support reporting, analytics, and machine learning workloads. Familiarity with data integration from More ❯

semi-structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data workflows using technologies such as Apache Kafka Monitor and ensure data quality, reliability, and security across the stack Contribute to the evolution of data engineering practices, tooling, and automation Collaborate with analytics, product, and data … patterns Experience with version control (Git), testing, and code review practices Familiarity with cloud-based data environments (e.g. AWS, GCP, or Azure) Exposure to modern data tools such as Airflow, dbt, or Snowflake Experience or strong interest in streaming technologies like Apache Kafka Interest in MLOps and modern data engineering best practices Why join: You’ll be part More ❯