13 of 13 Permanent Apache Airflow Jobs in Central London

data models and map various data sources to support downstream analytics. Pipeline Engineering: Build scalable ETL pipelines and data quality solutions using tools like Airflow, Luigi, or Azkaban. Codification: Translate intricate business logic into high-quality code using Python, Scala, or Java. Innovation: Evaluate and implement new technologies across ...

Experienced building real pipelines — not just notebooks Curious about how financial systems actually work Bonus points for: Exposure to ML workflows Familiarity with dbt, Airflow, Docker Experience handling financial or semi-structured data Interest in LLM infrastructure and vector databases Finance background is not required. Intellectual horsepower and ownership ...

models are always running, always accurate, and always improving. Key Responsibilities ML Pipeline Orchestration & Automation Own and extend Circadia’s ML pipeline orchestration using Apache Airflow, including training, evaluation, and deployment workflows. Build and maintain automated pipelines for model retraining, validation, and promotion across development, staging, and production … closely related infrastructure role. Strong proficiency in Python for ML pipeline development, tooling, and automation. Hands-on experience with ML pipeline orchestration tools, particularly Apache Airflow. Experience with model registries and experiment tracking platforms (MLflow preferred). Experience deploying and operating ML workloads on AWS (Batch ...

experience Time-series experience (market data, telemetry, pricing, events) Streaming exposure (Kafka/Event Hubs/Kinesis) Experience with Temporal (or similar orchestrators like Airflow/Dagster/Prefect) Any exposure to AI agents/automation tooling 👉 Apply ...

technologies . You will be utilising and playing with tools across the entire data ecosystem. 🚀Essential tech skills include proficiency in Python, Spark, and Airflow , alongside experience with major data platforms such as Snowflake, Databricks, and BigQuery . 🚀Familiarity with data transformation and infrastructure as code tools like ...

Architect). Snowflake certifications. Experience in leading agile teams or projects using Scrum/Kanban methodologies. Familiarity with modern data stack tools (e.g., dbt, Airflow, Fivetran) is a plus. Why Join Us? Be part of a high-impact team shaping the next generation of data capabilities in the cloud. ...

Tech Stack Language: Expert-level Python and advanced SQL . Cloud: Extensive experience with GCP (BigQuery, Cloud Storage, Dataflow/PubSub, Cloud Composer/Airflow). Tools: Experience with data orchestration tools and version control (Git). Environment: Proficiency in building production-grade pipelines. What We’re Looking ...

platforms in a cloud-native environment (AWS, GCP, or Azure). Deep understanding of modern data stacks (e.g. Snowflake/BigQuery/Redshift, dbt, Airflow, BI tools. Comfort operating at both strategic and hands-on levels. Track record of partnering with non-technical stakeholders and influencing at exec level. ...

mindset, with openness to feedback and diverse perspectives. Bonus points if you have the following. Experience building and maintaining production-grade data pipelines (e.g. Airflow, Dagster) or integrating data from APIs, web scraping, or third-party providers. Familiarity with cloud environments such as Google Cloud or AWS, and deploying ...

Have Development & Infrastructure Experience with Docker and containerised deployments Familiarity with AWS services (S3, EC2, ECR, Cognito) Experience working with JupyterHub, JupyterLab or Airflow APIs Experience building developer platforms or internal tooling Knowledge of SQL and/or NoSQL databases AI/Machine Learning Exposure to ML/ ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented … engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product ...

Head of Analytics Engineering Central London | Hybrid Up to £120k dbt, Python, Airflow, Looker, SQL We’re partnered with a high-growth fintech company looking to hire a Head of Analytics Engineering to take ownership of a critical data platform that powers commercial performance and incentive models across Europe. … Data Engineering roles Leadership and mentoring experience Strong SQL and modern data stack experience (dbt preferred) Experience with Python and orchestration tools such as Airflow Experience building scalable data pipelines and data products Experience working closely with business stakeholders Drop me a message or email emy@burnssheehan.co.uk ...