26 to 50 of 52 Apache Airflow Jobs in London

research use cases Advanced SQL skills and experience with modern cloud data warehouses Experience designing and operating data pipelines using tools such as dbt, Airflow, or similar frameworks Strong experience with Git based workflows, CI CD, automated testing, and operating long lived systems Proven ability to make sound architectural ...

data modeling skills. Hands-on experience with cloud data warehouses (Snowflake, BigQuery, Databricks). Proficiency with ELT tools (dbt, Fivetran, Matillion) and orchestration frameworks (Airflow, Prefect). ...

data modeling skills. Hands-on experience with cloud data warehouses (Snowflake, BigQuery, Databricks). Proficiency with ELT tools (dbt, Fivetran, Matillion) and orchestration frameworks (Airflow, Prefect). ...

Azure) Nice to Have Experience with fraud, risk, credit, AML, pricing, or customer analytics use cases Familiarity with MLOps tools (MLflow, Kubeflow, Airflow, etc.) Docker and Kubernetes experience Exposure to model governance, explainability, or regulatory frameworks Contract Details £650–£750 per day (Outside IR35) Initial 6-month contract, with ...

data pipelines using Python and SQL to ensure clean, reliable, and well-structured data. You'll design and optimise workflows using tools such as Airflow and dbt to support scalable, high-quality analytics layers. You'll help architect and evolve cloud-based data platforms across technologies like BigQuery, Redshift ...

tech firm Strong hands-on expertise in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred ...

Stack: Python, SQL, PySpark, strong data engineering principles. Bonus Skills: Graph technologies (RDF, OWL, SPARQL), cloud platforms (AWS/Azure/GCP), integration tools (Airflow, Kafka, Elasticsearch). Previous leadership experience in data-focused teams. Although a practice lead role this is still a hands on role ...

growth, including Agentic development. Technology/Skills requirements SQL ELT/ETL Data Modelling dbt models Version control (Git) Data processing and orchestration using Airflow or similar Google BigQuery or Redshift Cloud based services: GCP (preferred) or AWS Agentic development frameworks Automations About You 4 years+ experience ...

improving data literacy across the business Acting as an SQL subject matter expert (Postgres, Cloud SQL, BigQuery, Redshift) Using orchestration tools such as Airflow to deliver reliable, automated pipelines Contributing to IaC and CI/CD pipelines via GitHub Collaborating across engineering, analytics, data science, and product teams Experience ...

designing and owning data and analytics platforms in cloud environments. Dealing with huge volumes of data in a modern stacks (e.g. Snowflake, dbt, Airflow) and CI/CD practices. Whilst having microservices experience within a cloud environment, ideally AWS. If you have domain experience, great ...

collaborate closely with client stakeholders to translate ambiguous requirements into clean, maintainable solutions that drive real impact. Familiarity with tools such as Airflow, DBT, Databricks, dashboarding frameworks, and Typescript is a strong plus as you help deliver end-to-end production-ready systems. Interview Process Teams conversation (introductory chat ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark, or PyTorch Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI) Experience with CI/CD pipelines and automation tools ...

programming skills in Python; experience with ML libraries such as Snowpark, PySpark or PyTorch. Experience with containerization tools like Docker and orchestration tools like Airflow or Astronomer. Familiarity with cloud platforms (AWS, Azure) and ML services (e.g., SageMaker, Vertex AI). Experience with CI/CD pipelines and automation ...

with analytics, architecture, and delivery stakeholders. Balance operational leadership with longer-term planning and strategy. YOUR SKILLS & EXPERIENCE Essential: Strong experience with Snowflake, AWS, Airflow, and dbt. Proven background leading data engineers in production environments. Experience supporting data platform migrations or major transformations. Confident making technical trade-offs ...

cases are developed in a scalable and sustainable way Communicate complex technical decisions clearly to non-technical stakeholders Technical Environment Strong experience required: Snowflake Airflow dbt Nice to have: AWS (lower priority) Ideal Background Senior or Lead Data Engineer who has progressed into a management/technical leadership role ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally ...

high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

Desired Skills (Bonus Points) Experience with MLOps tooling (MLflow, Kubeflow, Weights & Biases, or similar) Building data pipelines (real-time or batch) using tools like Apache Spark, Kafka, Airflow, or dbt Familiarity with recommender systems, transformers, or graph neural networks Exposure to model optimisation techniques (quantisation, distillation, efficient inference ...

Build and optimise scalable data pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality data validation Translate business needs into technical solutions with full ownership What You Need … engineering/analytics/software Strong Python + SQL 2+ years ETL, APIs, CI/CD, Docker, AWS Ideally but not essential experience with Airflow/Prefect/Dagster Background in Financial Services, FinTech, Insurance, PE/VC, or Banking Package & Benefits High performance bonus 25 days holiday Pension ...

digital products used at scale. What you'll do: Build and maintain ETL/ELT pipelines using Python and SQL Orchestrate workflows with Airflow Work with cloud data platforms (AWS/GCP, BigQuery/Redshift) Improve data quality, monitoring, and reliability Collaborate with analysts and engineers to deliver trusted … data What we're looking for: 3+ years' experience in data engineering Strong SQL and Python skills Experience with Airflow or similar orchestration tools Cloud data experience (AWS or GCP) Solid understanding of modern data engineering best practices Nice to have: dbt, Terraform, or Docker experience Exposure ...

models for ML, insights, and search pipelines Design production-ready data pipelines delivering high-quality datasets to partner teams Work with Databricks, AWS, dbt, Airflow, and Looker to implement robust solutions Lead technically complex initiatives and contribute to the team's roadmap Improve engineering efficiency through internal tooling … Requirements Proven track record delivering production-ready data engineering projects end-to-end Strong SQL and Python skills, with experience on platforms like Databricks, Airflow, dbt, and Looker Experience in data modelling, data warehousing, and performance/cost optimisation Skilled in stakeholder management, documentation, and project planning Experience developing ...

objects (databases, schemas, tables, views, tasks, streams, resource monitors). ETL/ELT Pipelines: Develop and maintain robust data pipelines using tools like dbt, Airflow, Azure Data Factory, or similar. Data Modelling: Implement dimensional models (star/snowflake schemas), handle SCDs, and design efficient structures for analytics. Performance Tuning … Degree in IT Strong SQL skills (complex queries, performance tuning) and proficiency in Python for data processing. Experience with ETL/ELT tools (dbt, Airflow, ADF, Informatica, Matillion). Solid understanding of data warehousing concepts (Kimball, Data Vault, normalization). Familiarity with cloud platforms (Azure preferred; AWS/ ...

tools and frameworks for data governance, privacy, and quality monitoring, ensuring full compliance with data protection standards. Create resilient data workflows and automation within Airflow, Databricks, and other modern big data ecosystems. Implement and manage data observability and cataloguing tools (e.g., Monte Carlo, Atlan, DataHub) to enhance visibility … data platforms and backend systems. Familiarity with data governance frameworks, privacy compliance, and automated data quality checks. Hands-on experience with big data tools (Airflow, Databricks) and data observability platforms. Collaborative mindset and experience working with cross-functional teams including ML and analytics specialists. Curiosity and enthusiasm for continuous ...