101 to 125 of 150 Apache Airflow Jobs in London

Data Engineer - GCP/Python/DBT - OutsideIR35 - £500 per day Role: Contract Data Engineer Tech: GCP/Python/DBT/Airbyte/Airflow Rate: £500 per day Determination: Outside IR35 Duration: 3-6 months A start-up client of ours are on the hunt for a Contract ...

their customers, informing business strategy and decision making. Help and lead the development of automation solutions and workflow integrations, using platforms such as Databricks, Airflow, Power Apps, Power Automat. Help define the right data flow architecture that delivers tangible results quickly. Lead and develop a small team of Analysts. ...

infrastructure as code exposure Familiarity with Docker, Terraform, Kubernetes, and modern cloud services Working knowledge of MLOps concepts and tooling (for example MLflow, Airflow) Comfortable enabling others: documentation, training, workshops, and hands on support Desirable LLMops exposure (plus) Experience using AI agent tools in real engineering workflows (for example ...

infrastructure as code exposure Familiarity with Docker, Terraform, Kubernetes, and modern cloud services Working knowledge of MLOps concepts and tooling (for example MLflow, Airflow) Comfortable enabling others: documentation, training, workshops, and hands on support Desirable LLMops exposure (plus) Experience using AI agent tools in real engineering workflows (for example ...

start-ups or high-growth scale-ups • Strong technical grounding across Node.js, Typescript, React, MySQL and cloud-native architectures (AWS, ECS/K8s, Kafka, Airflow) • Comfortable driving Agile and DevOps culture, and setting high standards for clean, testable, secure code in fast-moving environments If you want ...

start-ups or high-growth scale-ups • Strong technical grounding across Node.js, Typescript, React, MySQL and cloud-native architectures (AWS, ECS/K8s, Kafka, Airflow) • Comfortable driving Agile and DevOps culture, and setting high standards for clean, testable, secure code in fast-moving environments If you want ...

start-ups or high-growth scale-ups • Strong technical grounding across Node.js, Typescript, React, MySQL and cloud-native architectures (AWS, ECS/K8s, Kafka, Airflow) • Comfortable driving Agile and DevOps culture, and setting high standards for clean, testable, secure code in fast-moving environments If you want ...

start-ups or high-growth scale-ups • Strong technical grounding across Node.js, Typescript, React, MySQL and cloud-native architectures (AWS, ECS/K8s, Kafka, Airflow) • Comfortable driving Agile and DevOps culture, and setting high standards for clean, testable, secure code in fast-moving environments If you want ...

start-ups or high-growth scale-ups • Strong technical grounding across Node.js, Typescript, React, MySQL and cloud-native architectures (AWS, ECS/K8s, Kafka, Airflow) • Comfortable driving Agile and DevOps culture, and setting high standards for clean, testable, secure code in fast-moving environments If you want ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

resilience and data residency Confidence working with senior stakeholders to make pragmatic, commercial platform decisions Tech environment includes: AWS, Azure, Kubernetes (EKS), ECS, Terraform, Airflow, EFK/Prometheus/Grafana, MySQL/PostgreSQL/Redis/Elasticsearch/Kafka, GitHub Actions, plus services written in Python, Node.js and Go. ...

testable systems Solid background in microservices architecture Proficiency with Postgres & MongoDB (relational + non-relational) Experience with event-driven architectures and asynchronous workflows (Kafka, Airflow, etc.) Solid coding practices (clean, testable, automated) The mindset of a builder: thrives in fast-paced startup environments, takes ownership, solves complex challenges Bonus ...

Design and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system ...

Design and implement model registries, versioning systems, and experiment tracking to ensure full reproducibility of all model releases. Deploy ML workflows using tools like Airflow or similar, managing dependencies from data ingestion through model deployment and serving. Instrument comprehensive monitoring for model performance, data drift, prediction quality, and system ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

Linux environment. - Experience in building automation tools and managing system configurations. - Knowledge of C++, KDB/q, and experience with technologies like Slurm, Airflow, Kafka, or AMPS. - Background in enhancing system stability, scalability, and performance while conducting root cause analyses to resolve incidents efficiently. - Observability skillset, monitoring and analysis ...

cybersecurity, threat intelligence, or offensive security tools). Deep technical expertise across: Cloud: AWS, Azure IaC: Terraform, Ansible Platforms: Kubernetes (EKS), ECS, Docker, Lambda, Airflow Observability: EFK, Prometheus, Grafana, Jaeger/OpenTelemetry Persistence: MySQL, PostgreSQL, MongoDB, Redis, Elasticsearch, Kafka Pipelines: GitHub Actions, AWS CodeBuild Runtimes: Python, Node.js, Golang Strong ...

third-party data from APIs into scalable storage layers • Developing dbt transformations and ELT workflows for analytics and machine learning • Orchestrating workloads using Airflow and modern CI/CD practices • Supporting model execution environments, including Azure ML Studio (experience not required) What you’ll be doing • Designing and building … scalable data pipelines in a modern Azure environment • Developing modular, production-grade ELT workflows (dbt, Airflow, SQL, Python) • Modelling data for analytics, BI, forecasting, and machine learning use cases • Optimising data architectures for performance, cost, and reliability • Working closely with data scientists, software engineers, and investment teams • Troubleshooting ...

third-party data from APIs into scalable storage layers • Developing dbt transformations and ELT workflows for analytics and machine learning • Orchestrating workloads using Airflow and modern CI/CD practices • Supporting model execution environments, including Azure ML Studio (experience not required) What you’ll be doing • Designing and building … scalable data pipelines in a modern Azure environment • Developing modular, production-grade ELT workflows (dbt, Airflow, SQL, Python) • Modelling data for analytics, BI, forecasting, and machine learning use cases • Optimising data architectures for performance, cost, and reliability • Working closely with data scientists, software engineers, and investment teams • Troubleshooting ...

e.g. AWS, GCP, Azure), infrastructure-as-code, and scalable architecture patterns Hands-on experience with SQL, Python, and modern data integration frameworks such as Apache Kafka, airflow or dbt Proven ability to deliver enterprise-grade customer data solutions, including customer data platforms and or API based integration Excellent ...