1 to 25 of 58 Apache Airflow Jobs in Central London

maintain scalable, cloud-based data pipelines and architectures to support advanced analytics and machine learning initiatives. Develop robust ELT workflows using tools like dbt, Airflow, and SQL (PostgreSQL, MySQL) to transform raw data into high-quality, analytics-ready datasets. Collaborate with data scientists, analysts, and software engineers to ensure … however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

data workflows. Familiarity with third-party APIs. Experience with modern data stack tools (e.g., dbt, Snowflake, Databricks). Experience with orchestration tools (e.g., Airflow). Experience building REST or GraphQL APIs. Why Work Here? Meaningful mission in the healthtech sector Opportunities for ownership, growth, and increased responsibility Values-driven ...

Azure, or GCP). Proficiency in Python and SQL for data manipulation and transformation. Experience with ETL/ELT development and orchestration tools (e.g., Apache Airflow, dbt, Prefect). Knowledge of data modelling, data warehousing, and lakehouse architectures. Familiarity with DevOps practices, CI/CD pipelines, and infrastructure ...

data platforms (AWS, Azure, or GCP). Proficiency in Python for data transformation and automation. Experience with ELT development and orchestration tools (e.g. dbt, Airflow, Prefect ). Knowledge of data modelling , data warehousing , and modern analytics architectures . Familiarity with DevOps practices , CI/CD pipelines, and infrastructure ...

TensorFlow, PyTorch, or Scikit-learn for ML, and Pandas, PySpark, or similar for data processing. Experience designing and orchestrating data pipelines with tools like Apache Airflow, Spark, or Kafka. Strong understanding of SQL, NoSQL, and data modeling. Familiarity with cloud platforms (AWS, Azure, GCP) for deploying ...

intensive experience as a Data Engineer or in a similar role, with a demonstrable track record of leading large-scale projects. Familiarity with Airflow, Dagster or similar data orchestration frameworks Strong understanding of RESTful APIs as well as experience working with both synchronous and asynchronous endpoints Experience with Snowflake ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving ...

metrics Cloud experience with AWS, GCP, or Snowflake Proficiency in Python, SQL, Git, and DBT Knowledge of MMM/MTA and deployment tools like Airflow or Docker Details Salary: £60-75k per annual Duration: 12-month fixed-term contract Location: Hybrid, with 2-3 days/week ...

MLflow), model registry, CI/CD for ML. Serving and orchestration: AWS SageMaker, EKS, batch & Real Time inference. Data pipelines: Spark/SQL, orchestration (Airflow), monitoring for drift/perf. Nice to Have Cost/performance optimisation on AWS; GPU scheduling; quantisation/distillation. Experience working within Financial Services ...

example — fostering collaboration, accountability, and agile delivery in every sprint. 🧠 What You Bring Expertise in AWS : Hands-on experience with Python, Glue, S3, Airflow, DBT, Redshift, and RDS. Proven success in end-to-end data engineering — from ingestion to insight. Strong leadership and communication skills, with a collaborative, solution ...

days/week from Central London office Strong problem-solving skills, attention to detail, and ability to work independently Experience with workflow orchestration (Prefect, Airflow, Dagster), cloud data warehouses (BigQuery, Snowflake), or backend Python frameworks (Django, FastAPI) is a plus Benefits 25 days annual leave plus bank holidays Meaningful ...

Work across industries and global clients, gaining diverse experience • Hands-on with modern tech: Databricks, Snowflake, Azure, GCP, AWS, Python, Spark, Airflow • Mentoring, guilds, hackathons and paid certifications to accelerate your growth • Clear career progression with 360° feedback and recognition programs • Collaborative culture with socials, team building, and innovation ...

similar) and how they consume data Experience working with cloud environments (AWS, GCP) Familiarity with basic data quality testing and workflow orchestration concepts (e.g., Airflow) Experience working in Agile, cross-functional teams Python experience for automation or scripting would be advantageous ...

also considered). Excellent programming skills in Python . Proven background in API development and integration. Experience building and maintaining modern data pipelines using Airflow and Kafka . Solid understanding of Snowflake or similar cloud data warehouses. Experience with Kubernetes for container orchestration. Proficiency with Terraform or other ...

technologies . You will be utilising and playing with tools across the entire data ecosystem. 🚀Essential tech skills include proficiency in Python, Spark, and Airflow , alongside experience with major data platforms such as Snowflake, Databricks, and BigQuery . 🚀Familiarity with data transformation and infrastructure as code tools like ...

investment professionals, and who thrives in fast-paced financial environments... Key Responsibilities Help users adopt and make effective use of AWS, Kubernetes, Terraform, Airflow, Jenkins, Coder, and other cloud/platform technologies Streamline operational workflows by automating routine tasks, enhancing documentation, and building out knowledge bases Work with engineering ...

another language e.g. Python ELT/ETL CI/CD Data Modelling Data Architecture Data Frameworks dbt Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services: GCP (preferred) or AWS Agentic development frameworks Automations About You 6 years+ experience as a Data Engineer ...

Translate business needs into actionable data models and insights that empower decision-making 🧠 What You’ll Bring Proven expertise in Python, SQL, Snowflake, DBT, Airflow, Data Modelling, and Data Vault Strong understanding of data warehousing concepts and modern data architecture Hands-on experience with cloud platforms (Azure ...

within AWS environments. Hands-on experience with services such as S3, Redshift , and other AWS data ecosystem tools. Familiarity with modern data stack tools: Airflow, dbt, Airbyte (or similar). Proficient in building automated pipelines, CI/CD, and applying software development best practices to data engineering. Strong performance ...

modelling) ETL/ELT pipeline design, build, and orchestration Docker and containerisation Cloud environments (Azure, AWS, or GCP) Version control (Git) Bonus points for: Airflow, Prefect, dbt, or cloud-native orchestration CI/CD and deployment automation Data warehousing fundamentals (star schema, staging patterns) Plus: Ability to explain complex ...

Technical experience will be with Python, dealing with huge volumes of data at scale across both bathc and stream processes. Orchestration tools such as Apache Airflow, Datawarehouse is Snowflake whilst having microservices experience within a cloud environment, ideally AWS. A solid all rounder who can still roll their ...

engineer who has hands-on experience in AWS to conduct end-to-end data analysis and data pipeline build-out using Python, Glue, S3, Airflow, DBT, Redshift, RDS, etc. Extensive Python API design experience, preferably Fast API Strong SQL knowledge Nice to have skills Pyspark Databricks ETL design ...

flexible systems. Influence Opinion and decision-making across AI and ML Skills Python SQL/Pandas/Snowflake/Elasticsearch Docker/Kubernetes Airflow/Spark Familiarity with GenAI models/libraries Requirements 3+ years of relevant software engineering experience post-graduation A degree (ideally a Master ...

services such as S3, Redshift and Lambda is ideal, but open to cloud agnostic and Azure backgrounds with lakehouse expertise • Hands on experience with Airflow, dbt and Kafka • Strong understanding of software engineering principles, automation and CI and CD • Experience working on data migrations or modernising legacy systems • Ability ...

Data Engineering (framework design, not just pipelines) DevOps MLOps/LLMOps Technologies you’ll often work with: Cloud Platforms: Azure, AWS, GCP Data Tools: Airflow, dbt, Databricks, Snowflake Developer Tooling & CI/CD: GitHub, Azure DevOps, Terraform (or other Infrastructure-as-Code tools) MLOps/LLMOps Frameworks: MLflow, AzureML ...