26 to 50 of 94 Apache Airflow Jobs in England

EXPERIENCE The successful Lead Data Engineer will have the following skills and experience: Strong Python and SQL skills AWS or GCP Orchestration, ideally with Airflow or Dagsta but open to others Data warehousing - Snowflake, Redshift, BigQuery (NOT Databricks) Terraform or Palumi BENEFITS The successful Lead Data Engineer will receive ...

Familiarity with cloud-based data tools and modern data ecosystems. Understanding of data modeling, warehousing concepts, and best practices Nice-to-Have Experience with Airflow, dbt, or similar orchestration/modeling tools. Experience with BI tools Knowledge of GCP services (Cloud Storage, Dataflow, Pub/Sub, etc.). Social ...

technical expertise with mentoring, guidance, and collaboration across teams. Core technologies include: Google Cloud Platform (BigQuery, Dataflow, Dataproc, Data Fusion, Data Streams, Cloud Functions, Airflow/Composer), SQL, Python, CI/CD tooling About you You'll have 10+ years experience in Data Engineering Experience operating in a Lead ...

Time-series data experience (market data, telemetry, pricing, events) Streaming exposure (Kafka/Event Hubs/Kinesis) Experience with Temporal (or similar orchestrators like Airflow/Dagster/Prefect) Any exposure to AI agents/automation tooling 👉 Apply ...

working in fast-paced environments and able to contribute quickly without extensive onboarding. Nice to Have Experience with modern data stack tools (e.g., dbt, Airflow, etc.). Understanding of CI/CD pipelines and data infrastructure automation. Familiarity with data governance, security, and best practices in a cloud environment. ...

share knowledge with team members. Required Qualifications Proven experience in designing and building data pipelines (ETL/ELT) using modern technologies (Python, SQL, Spark, Airflow, etc.). Strong analytical skills with the ability to interpret complex data and deliver business value. Experience integrating data from multiple sources and systems. ...

Data Engineer in a consultancy or complex delivery environment Deep, hands-on expertise with Snowflake Experience with the modern data stack, including dbt, Airflow (or similar) and Python Solid experience with AWS and/or Azure Strong SQL skills and performance optimisation experience Familiarity with CI/CD, DevOps ...

technologies . You will be utilising and playing with tools across the entire data ecosystem. 🚀Essential tech skills include proficiency in Python, Spark, and Airflow , alongside experience with major data platforms such as Snowflake, Databricks, and BigQuery . 🚀Familiarity with data transformation and infrastructure as code tools like ...

growth, including Agentic development. Technology/Skills requirements SQL ELT/ETL Data Modelling dbt models Version control (Git) Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services: GCP (preferred) or AWS Agentic development frameworks Automations About You 4 years+ experience ...

tasks, working with the Snowflake Data Marketplace, Performance Tuning and Knowledge of ETL/ELT pipelines and data integration tools (e.g., Informatica, Matillion, DBT, Airflow). Experience with APIs, stored procedures, and automation scripts is a plus. Strong analytical and problem-solving mindset. Clear communicator, able to work across ...

locally-hosted solutions. Technical Requirements Languages Expert-level Python and advanced SQL . Data Engineering Experience with ETL/ELT and orchestration tools like Apache Airflow or NiFi . On-Prem Tech Proficiency with Hadoop/HDFS , Spark , and containerization via Docker/Kubernetes (K3s/OpenShift) . ...

Oracle, SQL Server, PostgreSQL, MySQL). Knowledge of data warehouse and lakehouse architectures. Familiarity with ETL/ELT and orchestration tools (e.g., Informatica, Talend, Apache Airflow). Experience establishing and maintaining data governance frameworks. Experience complying with data security requirements. Experience designing data models. Excellent problem-solving, communication ...

data modelling experience e.g. dbt Ideally AWS/GCP background Data warehousing experience - e.g. Snowflake, BigQuery, Redshift IAC e.g. Terraform Orchestration experience e.g. dagster, airflow THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £120,000 On top of the salary there are some ...

data modelling experience e.g. dbt Ideally AWS/GCP background Data warehousing experience - e.g. Snowflake, BigQuery, Redshift IAC e.g. Terraform Orchestration experience e.g. dagster, airflow THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £120,000 On top of the salary there are some ...

data structures, performance, and optimisation strategies Familiarity with GCP and ecosystem knowledge: BigQuery, Composer, Dataproc, Cloud Run, Dataplex Hands-on experience with orchestration (like Airflow, Dagster, Databricks Workflows) and distributed processing in a cloud environment Experience with analytical data modelling (star and snowflake schemas), DWH, ETL/ELT patterns ...

grade data pipelines for multiple internal teams. Develops and optimises central data models supporting analytics, ML, and operational workloads. Works with Databricks, AWS, dbt, Airflow, and Looker as part of a modern data stack. Leads complex technical initiatives and improves efficiency through CI/CD, observability, and tooling. Ensures ...

analytical skills. Strong communication, and collaboration abilities. Preferred Qualifications Experience with columnar DB engines like Clikchouse, KDB/Q or similar Experience with Airflow, Dagster or similar tools. Exposure to container technologies: Docker, Podman etc Knowledge of 'big data' technologies (Hadoop, Spark, Parquet) Experience with TAQ data, and exchange ...

Testing). Familiarity with C++ or Go is a significant plus. Tooling & Orchestration: Deep experience with containerization (Docker, Kubernetes) and orchestration tools like Kubeflow, Airflow, or Metaflow. Cloud Architecture: Expertise in deploying ML workloads on AWS, GCP, or Azure, utilizing managed services like SageMaker or Vertex AI. Data Foundations ...

position will require 2 days per week in Leeds city centre. The key skills required for this Data Engineer position are: Python AWS DBT Airflow If you do have the relevant experience for this Data Engineer position, please do apply. ...

position will require 2 days per week in Leeds city centre. The key skills required for this Data Engineer position are: Python AWS DBT Airflow If you do have the relevant experience for this Data Engineer position, please do apply click apply for full job details ...

Technical expertise in designing, building, and maintaining data pipelines and warehouses Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive) Knowledge of programming languages (e.g., Python, SQL) Hands-on experience with SQL/NoSQL database design Degree in a STEM field; a master ...

Technical expertise in designing, building, and maintaining data pipelines and warehouses Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive) Knowledge of programming languages (e.g., Python, SQL) Hands-on experience with SQL/NoSQL database design Degree in a STEM field; a master ...

Proven Data Engineering experience in operational or live service environments Strong competency with ETL/ELT tools, such as: Azure Data Factory Informatica SSIS Airflow Strong SQL proficiency Experience using monitoring tools, including: Application Insights Splunk Grafana CloudWatch Experience with scheduling systems such as Cron, Autosys, or Control ...

platforms in a cloud-native environment (AWS, GCP, or Azure). Deep understanding of modern data stacks (e.g. Snowflake/BigQuery/Redshift, dbt, Airflow, BI tools. Comfort operating at both strategic and hands-on levels. Track record of partnering with non-technical stakeholders and influencing at exec level. ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...