26 to 50 of 65 Apache Airflow Jobs in the City of London

background at a leading finance or big tech firm Strong hands-on expertise in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

background at a leading finance or big tech firm Strong hands-on expertise in Python and modern ETL frameworks Experience designing and maintaining cloud-based data pipelines (e.g. AWS, Airflow, Snowflake) Deep understanding of data modelling, validation, and pipeline resilience Familiarity with financial or alternative datasets preferred More ❯

TypeScript Backend : Python (FastAPI, Flask, or Django), ideally with geospatial data processing Cloud : AWS (Lambda, ECS, RDS, S3, API Gateway, etc.) DevOps : Docker, CI/CD pipelines, Git Orchestration : Airflow or similar tools Eligo Recruitment is acting as an Employment Business in relation to this vacancy. Eligo is proud to be an equal opportunity employer dedicated to fostering diversity More ❯

S3 and Redshift, particularly around storage, computation and security. Familiarity with modern BI tools such as Power BI or AWS QuickSight. Experience with open-source data stack tools like Airflow, DBT, Airbyte or similar. Strong grasp of software development best practices and CI/CD processes. Skilled in performance tuning, testing, and automation within data engineering environments. Excellent communication More ❯

S3 and Redshift, particularly around storage, computation and security. Familiarity with modern BI tools such as Power BI or AWS QuickSight. Experience with open-source data stack tools like Airflow, DBT, Airbyte or similar. Strong grasp of software development best practices and CI/CD processes. Skilled in performance tuning, testing, and automation within data engineering environments. Excellent communication More ❯

focused, and able to contribute quickly in a fast-moving environment. Nice to Have Experience with Power BI or other data visualisation tools. Familiarity with orchestration tools such as Airflow, Prefect, or Dagster. Understanding of CI/CD practices in data and analytics engineering. Knowledge of data governance, observability, and security best practices in cloud environments. More ❯

with a passion for new technologies Experience in startups or top-tier consultancies is a plus Nice to Have: Familiarity with dashboarding tools, Typescript, and API development Exposure to Airflow, DBT, Databricks Experience with ERP (e.g. SAP, Oracle) and CRM systems What's On Offer: Salary: £50,000-£75,000 + share options Hybrid working: 2-3 days per More ❯

proactive, curious mindset and a willingness to take initiative. Desirable Experience with dashboarding/BI tools (Power BI, Tableau, Streamlit). Familiarity with Linux scripting or workflow orchestration tools (Airflow, Prefect). Exposure to financial markets , asset management, or consulting environments. This role would suit someone who is technically strong, logical, and ambitious, with the maturity to take ownership More ❯

passion for new technologies Experience in startups or top-tier consultancies is a plus Nice to Have (not essential): Familiarity with dashboarding tools, Typescript, and API development Exposure to Airflow, DBT, Databricks Experience with ERP (e.g. SAP, Oracle) and CRM systems What's On Offer: Salary: £50,000-£75,000 + share options Hybrid working: 2-3 days per More ❯

proactive, curious mindset and a willingness to take initiative. Desirable Experience with dashboarding/BI tools (Power BI, Tableau, Streamlit). Familiarity with Linux scripting or workflow orchestration tools (Airflow, Prefect). Exposure to financial markets , asset management, or consulting environments. This role would suit someone who is technically strong, logical, and ambitious, with the maturity to take ownership More ❯

PyTorch). Solid knowledge of SQL and data warehousing concepts. Demonstrated experience with cloud platforms ( GCP & Azure preferred). Strong understanding of data modelling, transformation, and orchestration (e.g. dbt, Airflow, Azure Data Factory). Familiarity with digital marketing data flows (e.g. GA4, ad servers, programmatic platforms, CRMs). Proven ability to manage or mentor junior team members, providing technical More ❯

PyTorch). Solid knowledge of SQL and data warehousing concepts. Demonstrated experience with cloud platforms ( GCP & Azure preferred). Strong understanding of data modelling, transformation, and orchestration (e.g. dbt, Airflow, Azure Data Factory). Familiarity with digital marketing data flows (e.g. GA4, ad servers, programmatic platforms, CRMs). Proven ability to manage or mentor junior team members, providing technical More ❯

NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion and Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport More ❯

. Advanced SQL and dimensional data modelling skills (fact/dimension design, hierarchies, SCDs). Proven experience building ETL/ELT pipelines using tools such as SSIS , dbt , or Airflow . Solid understanding of database administration , tuning, and performance optimisation across MSSQL and PostgreSQL . Key Responsibilities: Design and maintain data models that meet business requirements, ensuring scalability, consistency More ❯

Proven experience in developing and deploying machine learning models in production. Solid understanding of data structures, algorithms, and software engineering principles. Experience with ML pipelines and orchestration tools (e.g., Airflow, Kubeflow, MLflow). Proficiency in working with cloud services (AWS, GCP, or Azure). Strong understanding of CI/CD, containerisation (Docker), and orchestration (Kubernetes). Excellent problem-solving More ❯

Proven experience in developing and deploying machine learning models in production. Solid understanding of data structures, algorithms, and software engineering principles. Experience with ML pipelines and orchestration tools (e.g., Airflow, Kubeflow, MLflow). Proficiency in working with cloud services (AWS, GCP, or Azure). Strong understanding of CI/CD, containerisation (Docker), and orchestration (Kubernetes). Excellent problem-solving More ❯

with a passion for new technologies Experience in startups or top-tier consultancies is a plus Nice to Have: Familiarity with dashboarding tools, Typescript, and API development Exposure to Airflow, DBT, Databricks Experience with ERP (e.g. SAP, Oracle) and CRM systems What's On Offer: Salary: £50,000-£75,000 + share options Hybrid working: 2-3 days per More ❯

on development/engineering background Machine Learning or Data Background Technical Experience: PySpark, Python, SQL, Jupiter Cloud: AWS, Azure (Cloud Environment) - Moving towards Azure Nice to Have: Astro/Airflow, Notebook Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people More ❯

research, staging, and production environments. Design and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure as code More ❯

research, staging, and production environments. Design and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system health. Manage infrastructure as code More ❯

critical client outcomes. Analytics Engineering Leaders: Architect and optimise data pipelines, ELT workflows, and cloud warehouse platforms (Snowflake, BigQuery, Redshift). Lead teams working with dbt, SQL, Python, and Airflow to drive data transformation at scale. Ensure data governance, quality, and modelling standards are upheld across solutions. Work closely with data scientists and stakeholders to turn clean data into … engineering. Have led engineering teams and mentored technical talent in high-performance environments. Are proficient in either modern software stacks (Python, React, cloud-native) or analytics tooling (SQL, dbt, Airflow, cloud warehouses) . Bring a strategic mindset , with the ability to connect technical execution to business value. Are committed to innovation, collaboration, and data-driven transformation. Meet eligibility requirements More ❯

critical client outcomes. Analytics Engineering Leaders: Architect and optimise data pipelines, ELT workflows, and cloud warehouse platforms (Snowflake, BigQuery, Redshift). Lead teams working with dbt, SQL, Python, and Airflow to drive data transformation at scale. Ensure data governance, quality, and modelling standards are upheld across solutions. Work closely with data scientists and stakeholders to turn clean data into … engineering. Have led engineering teams and mentored technical talent in high-performance environments. Are proficient in either modern software stacks (Python, React, cloud-native) or analytics tooling (SQL, dbt, Airflow, cloud warehouses) . Bring a strategic mindset , with the ability to connect technical execution to business value. Are committed to innovation, collaboration, and data-driven transformation. Meet eligibility requirements More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

with researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader … Strong programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering More ❯