276 to 300 of 339 Apache Airflow Jobs in England

Technology Due Diligence Lead (M&A and SaaS Platforms)

Location
Greater London, England, United Kingdom
Review the architecture, code, cloud set up and data pipelines of modern data platforms, such as those built on Google Cloud, BigQuery, dbt, Airflow and Looker. Run code and open source licence scans, and turn the results into clear findings. Interview founders and technical leads, request evidence and review ...

Lead Product Analyst - Business Squad

Location
Greater London, England, United Kingdom
clear, performant, and reliable queries to transform large complex datasets) You have experience building and owning automated data pipelines with tools like DBT/Airflow Experimentation & Statistics: Experience running A/B tests and analysing the results to drive product decisions Ownership: You enjoy working independently in a fast ...

Lead Product Analyst - Business Squad

Hiring Organisation
Wise
Location
Greater London, United Kingdom
Employment Type
Full Time
Salary
75000 to 115000 GBP Annually
clear, performant, and reliable queries to transform large complex datasets) You have experience building and owning automated data pipelines with tools like DBT/Airflow Experimentation & Statistics: Experience running A/B tests and analysing the results to drive product decisions Ownership: You enjoy working independently in a fast ...

Full Stack Developer

Location
City Of London, England, United Kingdom
economy. Familiarity with Supabase specifically, or with similar BaaS platforms. BigQuery experience. Familiarity with n8n. Equivalent experience with code‐first orchestrators such as Temporal, Airflow or Prefect is welcome. Design sensibility. You care how things look and feel, not just how they function. Experience replacing legacy or external vendor ...

Python Software Engineer - Data Infrastructure

Location
City Of London, England, United Kingdom
petabyte scale estate, processing billions of datapoints daily from thousands of data sources. Our stack combines Java and Python, with foundations of Kafka, ArcticDB, Airflow, Spark, and more. This is an opportunity to tackle complex distributed systems challenges at an exceptional scale across thousands of unique datasets. AI agents ...

Python Software Engineer - Data Infrastructure New London

Location
Greater London, England, United Kingdom
petabyte scale estate, processing billions of datapoints daily from thousands of data sources. Our stack combines Java and Python, with foundations of Kafka, ArcticDB, Airflow, Spark, and more. This is an opportunity to tackle complex distributed systems challenges at an exceptional scale across thousands of unique datasets. AI agents ...

Principal Data Scientist (NLP + Applied AI)

Location
Greater London, England, United Kingdom
other data scientists can extend. Collaborate with a team of data engineers to orchestrate work in data pipeline and data build tools like Airflow and Dagster. Design idempotent, retryable, evaluable pipeline stages that stay reliable when a run fails at scale. Contribute to agentic AI application work: tool‐using ...

Senior Software Engineer, System Orchestration

Location
Oxford, England, United Kingdom
machines, timeouts, leases, retries, and the failure modes that only show up under load. Experience with a scheduler, workflow engine or job queue - Temporal, Airflow, Celery, Slurm, or one you built - or with event-driven systems that react to changes in state. A habit of settling design questions ...

Data Engineer

Location
Greater London, England, United Kingdom
into actionable insights, and power high-impact trading and AI decisions. Ideal Candidate: 5+ years of experience in data engineering with MPP databases or Apache Spark Strong skills in Python and SQL, with solid data modeling experience Extensive knowledge of AWS/cloud services (ECS, EKS, Lambda, Kinesis, DynamoDB … Athena) Hands-on experience with orchestration and workflow tools (Docker, Kubernetes, Airflow, Prefect, Dagster) Familiar with CI/CD pipelines, infrastructure as code, and DBT Able to explain complex data concepts clearly to non-technical stakeholders Why This Role Matters: Deliver lightning fast data pipelines handling billions of rows ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
Experience designing data products across source-aligned, aggregate and consumer-aligned patterns. Proven ability to architect and scale modern cloud data platforms using Snowflake, Apache Iceberg, Amazon Redshift, and S3. Hands-on expertise in developing robust data transformation pipelines and orchestrating complex workflows using dbt and Apache Airflow. ...

Senior Data & AI Product Engineer

Location
Greater London, England, United Kingdom
product lifecycle. Hands‐on experience with large‐scale data processing and machine learning in production environments. Strong expertise in distributed computing frameworks such as Apache Spark or similar technologies. Solid understanding of machine learning workflows, including model development, deployment, and inference. Strong knowledge of modern data architectures, including data … design and enterprise integration patterns. Experience with MLOps and model monitoring tools such as MLflow. Experience with orchestration and data quality tools such as Airflow and Great Expectations. Industry experience in financial services or another data‐intensive sector. What We Offer We offer a competitive compensation and benefits package ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
wherever your expertise can have the greatest impact. Our application data lives primarily in CockroachDB, with a modern data platform built around BigQuery, dbt, Airflow and pub/sub. Data flows both ways: into analytics and modelling, and back into the products our customers use. That culture translates into … comfortable working beyond a narrowly defined specialism when that is what the problem requires. Experience that will set you apart Experience with BigQuery, Airflow and dbt, or equivalent modern data technologies. Experience with CockroachDB, Postgres or other distributed/relational databases, including CDC or event-driven data pipelines. Knowledge ...

Senior Analytics Engineer

Location
Greater London, England, United Kingdom
About Us Perk (formerly TravelPerk) is the intelligent platform for travel and spend management. Built to tackle the time‐consuming, manual work that gets in the way of real work, our tools automate everything from ...

GCP Data Platform Lead: ETL, Airflow & Scalable Pipelines

Location
Greater London, England, United Kingdom
Capgemini is seeking a Google Cloud Platform Data Engineer to lead the engineering delivery and technical direction for a scalable multitenant data integration platform on Google Cloud Platform. The role emphasizes guiding the team in ...

Production ML Engineer for Mobile Trading App (Hybrid)

Location
Greater London, England, United Kingdom
operate, and monitor models, and build data pipelines the models rely on. You will deploy models as low-latency services, orchestrate data flows with Airflow, and integrate external feeds into a scalable data warehouse. This role emphasizes reliability, observability, and handover-ready documentation. #J-18808-Ljbffr ...

Data Platform Engineer — Cloud Data Lake & Analytics

Location
Greater London, England, United Kingdom
hybrid work model. You will manage a Data Lake, ensure secure, scalable environments, and drive performance with AWS tools such as S3, EKS, Glue, Airflow, Trino and Parquet. The role emphasizes delivering high-performance queries and building robust data infrastructure. #J-18808-Ljbffr ...

Python Data Platform Engineer — Flexible Work

Location
Greater London, England, United Kingdom
architect our multi-petabyte data estate, processing billions of datapoints daily from thousands of sources. The stack includes Java and Python, with Kafka, ArcticDB, Airflow and Spark, tackling complex distributed systems at scale. You will collaborate with quants and traders to translate requirements into robust platform solutions, while improving ...

DV Cleared Python Developer – Onsite London

Location
City Of London, England, United Kingdom
maintain and deploy Python applications, build APIs and microservices, and work with Docker/Kubernetes in air-gapped environments. Experience with data pipelines (Prefect, Airflow) and Jira is desirable. #J-18808-Ljbffr ...

ML Engineer - Python & LLM Pipelines + Equity Options

Location
Greater London, England, United Kingdom
seeking a Machine Learning Engineer in London to take models from experimentation to production. You'll craft production-grade ML pipelines, leverage Python, Airflow, and AWS infra, and collaborate closely with the founder and engineering team to shape system design and deployment. Join a role focused ...

Lead Software Engineer - Quant Research Technology

Location
Greater London, England, United Kingdom
apply strong Java/(Python across the full SDLC. You’ll work on microservices on AWS ECS, develop event‐driven services with AWS Lambda, Airflow for complex batch processing, leverage Amazon S3, Cassandra for scalable, low‐latency data storage— to turn data and analytics into production‐grade capabilities that ...

Staff Software Engineer, System Orchestration

Location
Oxford, England, United Kingdom
reach for determinism when chasing a timing or interleaving bug, rather than for more logging. Depth in the scheduling and workflow landscape - Temporal, Hatchet, Airflow, Slurm, Postgres-backed queues - and the judgement to borrow from it rather than reinvent. A track record of pinning down failures that others could ...

Senior Software Engineer II - Data Onboarding & Reporting

Location
Greater London, England, United Kingdom
technical design reviews. Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/… Avro). Robust ETL/ELT Orchestration: Expert proficiency in data transformation engines (such as dbt) and scheduling tools (such as Airflow). Stream/Message Queues: Solid understanding of event-driven architectures and streaming processing via Apache Kafka. Strong Programming Foundations: Proficiency in Python ...

Business Analytics Manager

Location
Bridgwater, England, United Kingdom
translate needs into scalable data products. Collaborate with the central Travis Perkins data engineering team (managing core infrastructure: BigQuery, GCS) and our third-party Airflow partner to coordinate data pipeline development and maintenance. Drive consistent naming conventions, data definitions, and documentation to support data governance and discoverability. Contribute … warehouse (ideally BigQuery). Proficiency with Dataform or similar (dbt) for modular, tested, and documented data modelling. Experience with data pipeline orchestration tools (e.g., Airflow). Experience working with modern data stacks, including Git version control and CI/CD principles. Comfortable analysing and validating large datasets, with ...

Business Analytics Manager

Location
Northampton, England, United Kingdom
translate needs into scalable data products. Collaborate with the central Travis Perkins data engineering team (managing core infrastructure: BigQuery, GCS) and our third-party Airflow partner to coordinate data pipeline development and maintenance. Drive consistent naming conventions, data definitions, and documentation to support data governance and discoverability. Contribute … warehouse (ideally BigQuery). Proficiency with Dataform or similar (dbt) for modular, tested, and documented data modelling. Experience with data pipeline orchestration tools (e.g., Airflow). Experience working with modern data stacks, including Git version control and CI/CD principles. Comfortable analysing and validating large datasets, with ...

Knowledge Engineering Senior Manager

Location
Greater London, England, United Kingdom
with cloud platforms (AWS, Azure, GCP) Well-versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have external ...