76 to 95 of 95 Apache Airflow Jobs in England

load balancers, VMware vSphere, HashiCorp Vault, Keycloak, ArgoCD, Helm Charts, SonarQube, Snyk. Implement object storage platforms using S3-compatible storage and MinIO. Setting up Apache Airflow, Cisco NSO, Itential at platform level. Develop, test and maintain backup and disaster recovery strategies. DevOps, CI/CD development and DevSecOps ...

warehousing concepts Familiarity with version control systems, particularly Git Desirable Skills: Experience with infrastructure as code tools such as Terraform or CloudFormation Exposure to Apache Spark for distributed data processing Familiarity with workflow orchestration tools such as Airflow or AWS Step Functions Understanding of containerisation using Docker Experience ...

downstream consumption Required Skills & Experience Strong commercial experience working with Azure Databricks as a core data processing platform Deep expertise in: PySpark/Apache Spark for distributed data processing Delta Lake (ACID transactions, optimisation, data versioning) Spark SQL and advanced SQL techniques Python for data engineering and pipeline development … based Databricks environments Solid understanding of data modelling, ETL/ELT design, and performance optimisation Familiarity with orchestration tools such as Azure Data Factory, Airflow, or Databricks Jobs Experience working in production environments with both project delivery and BAU responsibilities Desirable Experience Exposure to Unity Catalog, data governance ...

downstream consumption Required Skills & Experience Strong commercial experience working with Azure Databricks as a core data processing platform Deep expertise in: PySpark/Apache Spark for distributed data processing Delta Lake (ACID transactions, optimisation, data versioning) Spark SQL and advanced SQL techniques Python for data engineering and pipeline development … based Databricks environments Solid understanding of data modelling, ETL/ELT design, and performance optimisation Familiarity with orchestration tools such as Azure Data Factory, Airflow, or Databricks Jobs Experience working in production environments with both project delivery and BAU responsibilities Desirable Experience Exposure to Unity Catalog, data governance ...

moving away from legacy systems towards a scalable, cloud-native stack. What you'll be working on: Building and maintaining scalable data pipelines using Airflow and dbt Working across AWS cloud infrastructure Collaborating with analysts and data scientists to deliver reliable, clean data for downstream reporting and business decision … governance, and best practices across the team What they're looking for: Proven data engineering experience with strong Python and SQL Hands-on with Airflow and/or dbt Solid AWS experience Experience with ETL pipeline development at scale Comfortable working in Agile/Scrum environments Full right ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

grade Python services, batch and streaming pipelines, and scheduled workflows Build production-grade data pipelines – develop idempotent, observable, and cost-efficient pipelines using BigQuery, Airflow, Google Workflows, and Cloud Run Implement CI/CD for ML workloads – automated validation, monitoring, rollback strategies, and model lifecycle management Establish reliability … productionizing ML models in batch and/or real-time environments Hands-on experience with analytical data warehouses (BigQuery or equivalent) and workflow orchestration (Airflow or similar) Experience deploying ML systems on GCP, including Cloud Run, GCS, and IAM Infrastructure-as-Code experience (Terraform or equivalent) Experience with feature ...

data and analytics programmes, ensuring alignment with business goals, timelines, and quality standards. Planning, tracking, and managing complex technical dependencies across Snowflake, dbt, Airflow, and GitHub‐based development workflows. Collaborating closely with data engineering and analytics teams to support Snowflake architecture, performance optimisation, and cost management. Overseeing dbt project …/experience: Proven experience in a Technical Program Manager, Technical Project Manager, or similar role. Strong hands‐on understanding of Snowflake, dbt, GitHub, and Airflow in a production environment. Demonstrable experience delivering data engineering or analytics platform programmes. Solid understanding of modern data stacks, ETL pipelines, and cloud‐based ...

growing environments Engineering-first mindset, ideally with a backend or software engineering background Desirable: Experience with Snowflake Orchestration tools such as Dagster or Airflow dbt for data transformation and modelling Apache Iceberg or modern table formats Background in high-growth, consumer-facing products SALARY AND BENEFITS Base salary ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

EXPERIENCE: You will bring strong capability in: Python and advanced SQL Building and maintaining production-grade data pipelines Modern data orchestration tools (e.g. Dagster, Airflow, Prefect) Data modelling methodologies (Kimball, Data Vault, etc.) Engineering best practices including testing, version control and clean code AWS experience THE BENEFITS: You will ...

across the business Taking ownership of delivery from concept through to production Tech environment Python GCP BigQuery Cloud Functions/Cloud Run/Dataflow Airflow/Composer SQL dbt/Dataform CI/CD What they’re looking for Strong hands on Python experience within data engineering environments Experience … building cloud based data pipelines Strong SQL skills Exposure to orchestration tooling such as Airflow or Composer Someone comfortable working autonomously and owning delivery Strong communication and stakeholder skills Experience with AWS is also welcomed if you have worked in similar modern cloud environments. Why join? Large scale data ...

these Experience building data pipelines or data applications Strong skills in Python and/or SQL Familiarity with tools like Spark, Databricks, or Airflow Experience with AWS, Azure, or GCP Strong problem-solving and communication skills What We Offer Competitive salary + progression opportunities Exposure to complex, large-scale … complex data challenges in a high-performance environment, we’d love to hear from you. Data Engineering, Data Pipelines, ETL, Python, SQL, Spark, Databricks, Airflow, AWS, Azure, GCP, Cloud Technologies, Data Processing, Data Transformation, Data Quality, Scalable Systems, Data Applications, Data-Intensive Systems, Data Engineer, Engineering Consultant, High-Impact ...

Backend: Scala, Java (Python desirable) Frontend: HTML, CSS, JavaScript Frameworks: Play, Spark Data: Postgres, MongoDB, Hudi Cloud: AWS (S3, ECS, Aurora, Lambda) DevOps: Jenkins, Airflow, Terraform Monitoring: Kibana, Grafana Ways of working: Agile (Scrum/Kanban), CI/CD, 'you build it, you run it' What We're Looking … modern DevOps practices Experience working in Agile, multidisciplinary teams Strong analytical and problem-solving skills Clear communicator and collaborative team player Desirable Python, Docker, Airflow Big data tools (e.g. Spark, EMR) Experience with data platforms or risk/fraud systems How You'll Work Deliver value iteratively and early ...

We're looking for an experienced Analytics Engineer to help shape our data foundations and deliver high quality, trusted insights across the business. You'll design and maintain scalable analytics models, ensure data quality, and ...

involved in getting data from source through to something clean and usable for reporting and analysis. Tech stack: GCP BigQuery Python SQL Airflow Looker Studio What’s in it for you? Salary up to 80K Bonus Scheme 25 days holiday + BH Birthday off Pension Medical insurance + death … business to understand data requirements and translate these into solution Supporting data projects from initial brief through to delivery, working with GCP services like Airflow, Cloud Functions and Cloud Run Improving data quality, reliability and performance through monitoring, validation and optimisation within the data warehouse environment ...

Description Data Engineer (Snowflake & Airflow) London/Edinburgh 6 Month Contract Via Umbrella Our UK leading banking client are looking for a Data Engineer to join their team on an initial 6-month contract. Key Skills: Snowflake Agile methodology and working within small multiskilled feature teams. Comfortable with … version control. Knowledge of older coding standards and practices. AWS Airflow, Python nice to have. If you find this opportunity intriguing and aligning with your skill set, we welcome the submission of your CV without Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business ...

Data Engineer (Snowflake & Airflow) London/Edinburgh 6 Month Contract Via Umbrella Our UK leading banking client are looking for a Data Engineer to join their team on an initial 6-month contract. Key Skills: Snowflake Agile methodology and working within small multiskilled feature teams. Comfortable with … version control. Knowledge of older coding standards and practices. AWS Airflow, Python nice to have. If you find this opportunity intriguing and aligning with your skill set, we welcome the submission of your CV without Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business ...