1 to 25 of 33 Permanent Apache Airflow Jobs in London

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

solving capabilities. · Excellent communication and documentation skills. · Ability to work independently and lead cross-functional teams. · Adaptability to rapidly evolving technological environments PREFERRED SKILLS · Airflow, dbt, Spark, Kafka, RabbitMQ, Redis. · Git, CI/CD pipelines. · Experience with data warehousing solutions such as Snowflake, Redshift, BigQuery, or Synapse. · Exposure ...

using concepts, ETL/ELT pipelines and dimensional modelling Proficiency in advanced programming languages (Python/PySpark, SQL) Experience in data pipeline orchestration (e.g. Airflow, Data Factory) Familiarity with DevOps and CI/CD practices (Git, Azure DevOps etc) Ability to communicate technical concepts to both technical ...

Snowflake Production experience with dbt (mandatory) Strong SQL and Python programming skills Experience with Git-based workflows and DevOps practices Familiarity with orchestration tools (Airflow, Prefect) and ETL/ELT patterns Knowledge of cloud platforms (AWS, Azure) and security best practices ...

Snowflake Production experience with dbt (mandatory) Strong SQL and Python programming skills Experience with Git-based workflows and DevOps practices Familiarity with orchestration tools (Airflow, Prefect) and ETL/ELT patterns Knowledge of cloud platforms (AWS, Azure) and security best practices ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

/or Azure (Data Lake, Synapse). Programming & Scripting:Proficiency in Python, SQL, PySpark etc. ETL/ELT & Streaming:Expertise in technologies like Apache Airflow, Glue, Kafka, Informatica, EventBridge etc. Industrial Data Integration:Familiarity with OT data schema originating from OSIsoft PI, SCADA, MES, and Historian systems. Information ...

complex or secure environments Strong understanding of data modelling, data integration and data management principles Proficiency in SQL, Python and pipeline tools (e.g., Airflow, Spark) Experience with cloud platforms such as AWS, Azure or GCP Awareness of modern data architectures, analytics and visualisation tooling Strong analytical skills and ability ...

have indepth technical knowledge of Python for data workflows, SQL and Data Modelling, DBT, Cloud platforms (AWS, GCP or Azure), Workflow Orchestration tools (e.g. Airflow, Dagster, Prefect, DBT Cloud), CI/CD (GitHub Actions, GitLab CI, CircleCI) You have experience of leading technical deployments, running customer projects, diagnosing issues ...

cloud services and Databricks . Advanced proficiency in Python and SQL for data engineering. Experience with ETL/ELT tools and orchestration frameworks (e.g., Airflow, dbt). Strong knowledge of data warehousing and cloud-based data architectures. Understanding of BI tools such as Power BI or Tableau. Strong problem ...

data pipelines using Python and SQL to ensure clean, reliable, and well-structured data. You'll design and optimise workflows using tools such as Airflow and dbt to support scalable, high-quality analytics layers. You'll help architect and evolve cloud-based data platforms across technologies like BigQuery, Redshift ...

models that support analytics, machine learning, and operational use cases. The role involves working with modern data stack technologies such as Databricks, AWS, dbt, Airflow, and Looker. They lead complex technical initiatives, improve engineering efficiency through better CI/CD, observability, and tooling, and ensure data reliability at scale. ...

Factory (ADF) and Python . Ensure high-quality raw datasets to enable accurate analytics and data modeling. Deploy and maintain data tools on Kubernetes (Airflow, Superset, RStudio Connect). Support Data Analytics initiatives through DBT , DevOps , and deployment governance. You will work closely with a small, focused team, contributing ...

environments Strong Python for automation workflows and data pipelines Proficiency in SQL, data warehousing, and cloud platforms (GCP/Azure preferred) Experience with dbt, Airflow, or similar data modeling tools Understanding of digital marketing data (GA4, ad servers, programmatic platforms) Team management/mentoring experience with collaborative leadership style ...

working in high-growth or scale-up environments. Exposure to BI tools such as Looker, Tableau, or Power BI. Familiarity with orchestration tools (e.g. Airflow, Dagster). Interest in data quality, governance, and metrics standardisation. Experience working in logistics, supply chain, marketplace, transportation, or operationally complex environments is highly ...

models, agents, and GenAI applications. Deploy LLMs and orchestrate multi-agent systems (LangChain, LangGraph, or custom). Create and maintain data pipelines (Airflow, dbt, Step Functions). Implement monitoring, observability, and automated retraining (CloudWatch, Prometheus, Grafana, MLflow). Embed strong security, compliance, and guardrail practices across all ML workflows. ...

collaborate closely with client stakeholders to translate ambiguous requirements into clean, maintainable solutions that drive real impact. Familiarity with tools such as Airflow, DBT, Databricks, dashboarding frameworks, and Typescript is a strong plus as you help deliver end-to-end production-ready systems. Interview Process Teams conversation (introductory chat ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

operate effectively in a fast-paced, scaling organisation. Excellent communication skills and a collaborative approach. Desirable Skills Experience with analytics engineering tools (e.g., dbt, Airflow). Familiarity with experimentation frameworks and A/B testing platforms. Exposure to cloud-based data environments (e.g., Google Cloud Platform). Experience within ...

Adobe Analytics, GTM and Adobe Dynamic Tag Manager) changes. Integrate data sources via web and REST APIs. Data pipping and modelling using SQL, DBT, Airflow, ETL, Data Warehousing, Redshift and Python. Transfer knowledge of the business processes and requirements to the development teams. Collaborate with Product, Marketing and Development ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

cybersecurity, threat intelligence, or offensive security tools). Deep technical expertise across: Cloud: AWS, Azure IaC: Terraform, Ansible Platforms: Kubernetes (EKS), ECS, Docker, Lambda, Airflow Observability: EFK, Prometheus, Grafana, Jaeger/OpenTelemetry Persistence: MySQL, PostgreSQL, MongoDB, Redis, Elasticsearch, Kafka Pipelines: GitHub Actions, AWS CodeBuild Runtimes: Python, Node.js, Golang Strong ...