51 to 75 of 100 Apache Airflow Jobs in Central London

empowered to design solutions using the most appropriate technologies, deploying final implementations on AWS. You’ll bring hands-on depth and knowledge in: Languages: Python, PySpark, SQL Technologies: Spark, Airflow Cloud: AWS (API Gateway, Lambda, Redshift, Glue, CloudWatch, etc.) Data Pipelines: Designing and building modern, cloud-native pipelines using AWS services In addition, you will require strong leadership skills More ❯

and visualisation across the organisation What They’re Looking For Proven experience designing and maintaining data pipelines in production environments Strong Python and SQL skills; familiarity with frameworks like Airflow, Spark, or similar Solid understanding of data modelling, architecture, and warehousing best practices Comfort working with cloud platforms (AWS, Azure) and infrastructure tools (e.g. Terraform, SageMaker) Willingness to gain More ❯

and visualisation across the organisation What They’re Looking For Proven experience designing and maintaining data pipelines in production environments Strong Python and SQL skills; familiarity with frameworks like Airflow, Spark, or similar Solid understanding of data modelling, architecture, and warehousing best practices Comfort working with cloud platforms (AWS, Azure) and infrastructure tools (e.g. Terraform, SageMaker) Willingness to gain More ❯

sports. Based in London and available to work on-site in Marylebone. Nice to have Basic SQL for reporting and checks; experience with job schedulers or workflow tools (e.g., Airflow, Cron). Familiarity with CI/CD and version control (Git) and incident/post-mortem practices. What we offer Competitive salary with clear progression as the role scales More ❯

sports. Based in London and available to work on-site in Marylebone. Nice to have Basic SQL for reporting and checks; experience with job schedulers or workflow tools (e.g., Airflow, Cron). Familiarity with CI/CD and version control (Git) and incident/post-mortem practices. What we offer Competitive salary with clear progression as the role scales More ❯

on development/engineering background Machine Learning or Data Background Technical Experience: PySpark, Python, SQL, Jupiter Cloud: AWS, Azure (Cloud Environment) - Moving towards Azure Nice to Have: Astro/Airflow, Notebook Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people More ❯

the right solutions What experience will you have? 5 to 8 years’ in developing AI/ML solutions API development with FastAPI or Flask Orchestration and automation, for example Airflow or asyncio Developed applications using latest LLMs (Anthropic, META, Google, Mistral etc) Experience with multi agent orchestration frameworks (LangGraph, LangChain, MCP, CrewAI etc) Experience in end2end development and deployment More ❯

the right solutions What experience will you have? 5 to 8 years’ in developing AI/ML solutions API development with FastAPI or Flask Orchestration and automation, for example Airflow or asyncio Developed applications using latest LLMs (Anthropic, META, Google, Mistral etc) Experience with multi agent orchestration frameworks (LangGraph, LangChain, MCP, CrewAI etc) Experience in end2end development and deployment More ❯

performance data What You’ll Need 5+ years’ experience in data analytics, ideally with a marketing or growth focus Strong SQL skills and experience building robust data pipelines (DBT, Airflow) Confident using tools like Looker, Amplitude, GA, and Optimizely A/B testing expertise and deep understanding of marketing KPIs and attribution models Great communication skills — able to turn More ❯

performance data What You’ll Need 5+ years’ experience in data analytics, ideally with a marketing or growth focus Strong SQL skills and experience building robust data pipelines (DBT, Airflow) Confident using tools like Looker, Amplitude, GA, and Optimizely A/B testing expertise and deep understanding of marketing KPIs and attribution models Great communication skills — able to turn More ❯

driving clarity from data What We’re Looking For 5+ years of analytics experience, ideally in digital or performance marketing Advanced SQL and experience with tools like DBT or Airflow Hands-on experience with marketing analytics tools (GA, Amplitude, Optimizely, etc.) Confident running A/B tests , building attribution models, and defining marketing KPIs Skilled with visualisation platforms (Looker More ❯

driving clarity from data What We’re Looking For 5+ years of analytics experience, ideally in digital or performance marketing Advanced SQL and experience with tools like DBT or Airflow Hands-on experience with marketing analytics tools (GA, Amplitude, Optimizely, etc.) Confident running A/B tests , building attribution models, and defining marketing KPIs Skilled with visualisation platforms (Looker More ❯

machine learning. Proven experience delivering production-grade AI/ML applications, including LLMs and anomaly detection models. Familiarity with cloud infrastructure (AWS preferred), container orchestration (Kubernetes), and workflow tools (Airflow, Argo). Experience with observability tools (e.g., Grafana, CloudWatch) and RESTful API development. More ❯

machine learning. Proven experience delivering production-grade AI/ML applications, including LLMs and anomaly detection models. Familiarity with cloud infrastructure (AWS preferred), container orchestration (Kubernetes), and workflow tools (Airflow, Argo). Experience with observability tools (e.g., Grafana, CloudWatch) and RESTful API development. More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

and consumption layers Design and implement secure, performant Snowflake environments including RBAC, data masking, and policies/entitlement understanding Build and optimise ELT pipelines (using tools such as dbt, Airflow, Fivetran, or native Snowflake tasks) to support batch and real-time use cases Collaborate with Kubrick and client stakeholders to inform delivery planning, data strategy, and architecture decisions Promote … language (Python preferred) for automation. Experience with cloud platforms (AWS, Azure, or GCP), including security, IAM, and storage services Experience deploying and maintaining production pipelines using tools such as Airflow or Dagster Understanding of CI/CD principles, version control (Git) and software development lifecycle. Strong communication and stakeholder-management skills with the ability to influence technical and business More ❯

semi-structured, and streaming data Design and improve data models to support analytics and machine learning use cases Develop and support real-time data workflows using technologies such as Apache Kafka Monitor and ensure data quality, reliability, and security across the stack Contribute to the evolution of data engineering practices, tooling, and automation Collaborate with analytics, product, and data … patterns Experience with version control (Git), testing, and code review practices Familiarity with cloud-based data environments (e.g. AWS, GCP, or Azure) Exposure to modern data tools such as Airflow, dbt, or Snowflake Experience or strong interest in streaming technologies like Apache Kafka Interest in MLOps and modern data engineering best practices Why join: You’ll be part More ❯

with researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader … Strong programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering More ❯

with researchers, technologists, and analysts to enhance the quality, timeliness, and accessibility of data. Contribute to the evolution of modern cloud-based data infrastructure , working with tools such as Airflow, Kafka, Spark, and AWS . Monitor and troubleshoot data workflows, ensuring continuous delivery of high-quality, analysis-ready datasets. Play a visible role in enhancing the firm’s broader … Strong programming ability in Python (including libraries such as pandas and NumPy ) and proficiency with SQL . Confident working with ETL frameworks , data modelling principles, and modern data tools (Airflow, Kafka, Spark, AWS). Experience working with large, complex datasets from structured, high-quality environments — e.g. consulting, finance, or enterprise tech. STEM degree in Mathematics, Physics, Computer Science, Engineering More ❯

data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships in support of Retrieval Augmented Generation (RAG) and agentic architectures. Contribute to text retrieval pipelines involving vector embeddings and knowledge graphs, for … workflows. Proficiency with cloud platforms such as Azure, AWS, or GCP and their managed data services. Desirable: Experience with asynchronous python programming Experience with graph technologies (e.g., Kuzu, Neo4j, Apache AGE). Familiarity with embedding models (hosted or local): OpenAI, Cohere etc or HuggingFace models/sentence-transformers. Solid understanding of data modeling, warehousing, and performance optimization. Experience with … messaging middleware + streaming (e.g. NATS Jetstream, Redis Streams, Apache Kafka or Pulsar etc.) Hands-on experience with data lakes, lakehouses, or components of the modern data stack. Exposure to MLOps tools and best practices. Exposure to workflow orchestration frameworks (e.g. Metaflow, Airflow, Dagster) Exposure to Kubernetes Experience working with unstructured data (e.g., logs, documents, images). Awareness More ❯

data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships in support of Retrieval Augmented Generation (RAG) and agentic architectures. Contribute to text retrieval pipelines involving vector embeddings and knowledge graphs, for … workflows. Proficiency with cloud platforms such as Azure, AWS, or GCP and their managed data services. Desirable: Experience with asynchronous python programming Experience with graph technologies (e.g., Kuzu, Neo4j, Apache AGE). Familiarity with embedding models (hosted or local): OpenAI, Cohere etc or HuggingFace models/sentence-transformers. Solid understanding of data modeling, warehousing, and performance optimization. Experience with … messaging middleware + streaming (e.g. NATS Jetstream, Redis Streams, Apache Kafka or Pulsar etc.) Hands-on experience with data lakes, lakehouses, or components of the modern data stack. Exposure to MLOps tools and best practices. Exposure to workflow orchestration frameworks (e.g. Metaflow, Airflow, Dagster) Exposure to Kubernetes Experience working with unstructured data (e.g., logs, documents, images). Awareness More ❯

Data Engineer (leading a team of 4). Salary: £100,000 – £130,000 + benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT, Python The Company: Immersum have engaged with a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting … Implement redundancy, backups, and DB triggers to ensure reliability and data integrity. Work with Python to build scalable data solutions. Introduce and adopt new technologies such as Kafka, Docker, Airflow, and AWS . Define and enforce data hygiene practices (ontology, storage, artifacts, version control). Reduce engineering load per person through automation and efficient design. Collaborate closely with a More ❯

Data Engineer (leading a team of 4). Salary: £100,000 – £130,000 + benefits Location: West London - Hybrid (3 days p/w in-office) Tech: AWS, Snowflake, Airflow, DBT, Python The Company: Immersum have engaged with a leading PropTech company on a mission to revolutionise how the property sector understands people, places, and data. By combining cutting … Implement redundancy, backups, and DB triggers to ensure reliability and data integrity. Work with Python to build scalable data solutions. Introduce and adopt new technologies such as Kafka, Docker, Airflow, and AWS . Define and enforce data hygiene practices (ontology, storage, artifacts, version control). Reduce engineering load per person through automation and efficient design. Collaborate closely with a More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯

management to analyze and improve our business processes Conduct workload and complexity assessments Design, plan and implement new efficient software solutions in Python and Go Maintain and enhance our Airflow data pipelines Improve observability and scalability to support our constantly growing client base Continuously adapt to changing requirements in a business driven environment Build and extend knowledge of financial … innate curiosity to learn new things Preferred qualifications Background in traditional finance or digital assets, ideally in trading domain Hands-on experience with Python libraries and frameworks (NumPy, Pandas, Airflow, FastAPI, Flask, SQLAlchemy) Highly proficient in asynchronous, event driven distributed systems Working knowledge of cloud-native architectures, GCP preferred Experience in Go and working with real-time data streams More ❯