1 to 25 of 113 Apache Airflow Jobs in London

maintain scalable, cloud-based data pipelines and architectures to support advanced analytics and machine learning initiatives. Develop robust ELT workflows using tools like dbt, Airflow, and SQL (PostgreSQL, MySQL) to transform raw data into high-quality, analytics-ready datasets. Collaborate with data scientists, analysts, and software engineers to ensure … however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

maintain scalable, cloud-based data pipelines and architectures to support advanced analytics and machine learning initiatives. Develop robust ELT workflows using tools like dbt, Airflow, and SQL (PostgreSQL, MySQL) to transform raw data into high-quality, analytics-ready datasets. Collaborate with data scientists, analysts, and software engineers to ensure … however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

data workflows. Familiarity with third-party APIs. Experience with modern data stack tools (e.g., dbt, Snowflake, Databricks). Experience with orchestration tools (e.g., Airflow). Experience building REST or GraphQL APIs. Why Work Here? Meaningful mission in the healthtech sector Opportunities for ownership, growth, and increased responsibility Values-driven ...

data workflows. Familiarity with third-party APIs. Experience with modern data stack tools (e.g., dbt, Snowflake, Databricks). Experience with orchestration tools (e.g., Airflow). Experience building REST or GraphQL APIs. Why Work Here? Meaningful mission in the healthtech sector Opportunities for ownership, growth, and increased responsibility Values-driven ...

Azure, or GCP). Proficiency in Python and SQL for data manipulation and transformation. Experience with ETL/ELT development and orchestration tools (e.g., Apache Airflow, dbt, Prefect). Knowledge of data modelling, data warehousing, and lakehouse architectures. Familiarity with DevOps practices, CI/CD pipelines, and infrastructure ...

Azure, or GCP). Proficiency in Python and SQL for data manipulation and transformation. Experience with ETL/ELT development and orchestration tools (e.g., Apache Airflow, dbt, Prefect). Knowledge of data modelling, data warehousing, and lakehouse architectures. Familiarity with DevOps practices, CI/CD pipelines, and infrastructure ...

platforms Working with Python, SQL and cloud platforms (AWS preferred, GCP/Azure welcome) Delivering data solutions using tools like Snowflake, Databricks, dbt and Airflow Partnering closely with clients and internal teams to shape outcomes What makes Vivanti different A genuinely collaborative, social and learning-led culture — think Training ...

platforms Working with Python, SQL and cloud platforms (AWS preferred, GCP/Azure welcome) Delivering data solutions using tools like Snowflake, Databricks, dbt and Airflow Partnering closely with clients and internal teams to shape outcomes What makes Vivanti different A genuinely collaborative, social and learning-led culture — think Training ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

solving capabilities. · Excellent communication and documentation skills. · Ability to work independently and lead cross-functional teams. · Adaptability to rapidly evolving technological environments PREFERRED SKILLS · Airflow, dbt, Spark, Kafka, RabbitMQ, Redis. · Git, CI/CD pipelines. · Experience with data warehousing solutions such as Snowflake, Redshift, BigQuery, or Synapse. · Exposure ...

data platforms (AWS, Azure, or GCP). Proficiency in Python for data transformation and automation. Experience with ELT development and orchestration tools (e.g. dbt, Airflow, Prefect ). Knowledge of data modelling , data warehousing , and modern analytics architectures . Familiarity with DevOps practices , CI/CD pipelines, and infrastructure ...

data platforms (AWS, Azure, or GCP). Proficiency in Python for data transformation and automation. Experience with ELT development and orchestration tools (e.g. dbt, Airflow, Prefect ). Knowledge of data modelling , data warehousing , and modern analytics architectures . Familiarity with DevOps practices , CI/CD pipelines, and infrastructure ...

using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both technical ...

TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL, and data modeling. Familiarity with cloud platforms (AWS, Azure, GCP) for deploying ...

TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL, and data modeling. Familiarity with cloud platforms (AWS, Azure, GCP) for deploying ...

Snowflake Production experience with dbt (mandatory) Strong SQL and Python programming skills Experience with Git-based workflows and DevOps practices Familiarity with orchestration tools (Airflow, Prefect) and ETL/ELT patterns Knowledge of cloud platforms (AWS, Azure) and security best practices ...

Snowflake Production experience with dbt (mandatory) Strong SQL and Python programming skills Experience with Git-based workflows and DevOps practices Familiarity with orchestration tools (Airflow, Prefect) and ETL/ELT patterns Knowledge of cloud platforms (AWS, Azure) and security best practices ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

intensive experience as a Data Engineer or in a similar role, with a demonstrable track record of leading large-scale projects. Familiarity with Airflow, Dagster or similar data orchestration frameworks Strong understanding of RESTful APIs as well as experience working with both synchronous and asynchronous endpoints Experience with Snowflake ...

intensive experience as a Data Engineer or in a similar role, with a demonstrable track record of leading large-scale projects. Familiarity with Airflow, Dagster or similar data orchestration frameworks Strong understanding of RESTful APIs as well as experience working with both synchronous and asynchronous endpoints Experience with Snowflake ...

metrics Cloud experience with AWS, GCP, or Snowflake Proficiency in Python, SQL, Git, and DBT Knowledge of MMM/MTA and deployment tools like Airflow or Docker Details Salary: £60-75k per annual Duration: 12-month fixed-term contract Location: Hybrid, with 2-3 days/week ...

metrics Cloud experience with AWS, GCP, or Snowflake Proficiency in Python, SQL, Git, and DBT Knowledge of MMM/MTA and deployment tools like Airflow or Docker Details Salary: £60-75k per annual Duration: 12-month fixed-term contract Location: Hybrid, with 2-3 days/week ...

MLflow), model registry, CI/CD for ML. Serving and orchestration: AWS SageMaker, EKS, batch & real-time inference. Data pipelines: Spark/SQL, orchestration (Airflow), monitoring for drift/perf. Nice to Have Cost/performance optimisation on AWS; GPU scheduling; quantisation/distillation. Experience working within Financial Services ...

days/week from Central London office Strong problem-solving skills, attention to detail, and ability to work independently Experience with workflow orchestration (Prefect, Airflow, Dagster), cloud data warehouses (BigQuery, Snowflake), or backend Python frameworks (Django, FastAPI) is a plus Benefits 25 days annual leave plus bank holidays Meaningful ...