51 to 75 of 76 Apache Airflow Jobs in London

peer to peer feedback and evolving healthy, curious and humble teams. Tech Stack Python, Javascript/Typescript, React/React Native, AWS, GraphQL, Snowflake, Airflow, DDD. This is an incredible opportunity for a Senior Software Engineer to join a unique company as they embark on a period of significant ...

integration patterns and data pipeline design Desirable Exposure to data governance frameworks and tooling (e.g. Collibra) Experience with orchestration platforms such as Astronomer/Airflow Knowledge of enterprise data architecture practices, including metadata management and lineage Education Bachelors or Masters in Information Technology, Computer Science or relevant field. Work ...

driving engineering best practices. Ability to influence technical direction and architectural decisions. Comfortable remaining hands-on while operating in a leadership capacity. Desirable Skills Airflow Databricks AI-focused development experience Semantic layer experience Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse ...

platform engineer and presenting a business case to a C‐minus‐1. Preferred, not required Experience with the modern data stack: Snowflake, Databricks, dbt, Airflow, BigQuery, Spark, or similar. Data observability, data quality, or AI observability experience is a strong plus. Familiarity with MEDDPICC, Command of the Message ...

Service Meshes etc.) Experience with configuration management tools (Ansible/Puppet/Kapitan/Terraform) Experience with distributed data platforms (Kafka/Flink/Airflow) Comfortable using cloud native and containerisation technologies (Kubernetes/Docker) Good Linux systems knowledge (experience with RHEL desirable) Broad knowledge across network technologies, server ...

including model deployment, monitoring, evaluation, and lifecycle management Strong hands‐on understanding of modern data and AI tooling, ideally including SQL, Python, Snowflake, dbt, Airflow, Metabase, Tableau, and AWS‐based data services Experience with data ingestion, streaming, and change data capture tooling, such as Fivetran, Estuary, or similar platforms … standards, and enablement for analytics engineers Ability to oversee API‐based and batch data extraction processes, particularly those built in Python and orchestrated using Airflow Understanding of machine learning tooling and lifecycle management, ideally including DVC, MLflow, Evidently AI, or equivalent platforms for experiment tracking, versioning, monitoring, and evaluation ...

multiple teams. In this contract role, expect to define standards, build reusable data movement frameworks and drive best practices with AWS Glue, Spark and Airflow in a regulated environment. London-based with on-site presence three days a week. #J-18808-Ljbffr ...

than one-off scripts or analysis tooling. Strong Python development skills, with experience building performant, maintainable applications. Experience with workflow orchestration tools such as Airflow, Dagster, or Prefect. Understanding of retries, dependency management, idempotency, backfills, and operational recovery. Experience with analytical or columnar databases such as ClickHouse or similar ...

building and leading a team of engineers working in a related system. Experience with build, release and deployment infrastructure technologies such as Spinnaker, Jenkins, Airflow, Docker, Kubernetes, Terraform, Bazel, etc. Ability to attract, hire, and coach engineers who meet the Databricks hiring standards – can up‐level existing team ...

building and leading a team of engineers working in a related system. Experience with build, release and deployment infrastructure technologies such as Spinnaker, Jenkins, Airflow, Docker, Kubernetes, Terraform, Bazel, etc. Ability to attract, hire, and coach engineers who meet the Databricks hiring standards – can up‐level existing team ...

advanced proficiency in Python with extensive experience building production applications and services Experience with modern cluster compute technologies (e.g., Kubernetes, Spark, Hadoop Yarn, Ray, Airflow) Experience leading work in a formal software development environment in collaboration with other engineers Strong experience building platforms on the Linux operating system Self ...

Advanced proficiency in Python, with extensive professional experience in building production applications and services Experience of modern cluster compute - Kubernetes, Spark, Hadoop Yarn, Ray, Airflow are some of the technologies we use Experience leading work in a formal software development environment alongside other engineers in a collaborative manner Strong ...

This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud Platform, etc; You will own engineering efforts to provide partner teams within the organisation with data sources that build … opportunity for the role to go permanent. What You'll Do: Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow; Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality ...

mechanics (order books vs AMMs, fee structures, market manipulation/anti-manipulation signals). Proficiency with SQL; experience with streaming systems (Kafka), workflow orchestration (Airflow), and cloud (AWS/GCP/Azure). Experience with Bayesian methods, probabilistic programming (Stan/PyMC), or ensemble methods. Familiarity with rigorous experimentation … online/offline evaluation, data leakage prevention, and model governance. Tech Stack Python, SQL, pandas/numpy/scipy, PyTorch/sklearn Airflow/dbt, Kafka (or equivalents), Postgres/BigQuery Docker, Kubernetes (optional), CI/CD (GitHub Actions) Observability: Prometheus/Grafana, OpenTelemetry (or equivalents) Locations and Right ...

recommendations, ranking and personalization across Bumble products. You will build production-grade models with PyTorch, craft end-to-end ML pipelines using Spark and Airflow, and deploy AI Agents based on Large Language Models, mentoring senior contributors and shaping responsible AI practices. #J-18808-Ljbffr ...

deliver scalable, production-grade Python services and APIs for research and operations. The role emphasizes modern cluster compute technologies (Kubernetes, Spark, Hadoop Yarn, Ray, Airflow) and strong proficiency in Python. A background in mathematics or computing is advantageous. #J-18808-Ljbffr ...

engineers across the firm. Ideal candidates have deep Python expertise, hands-on experience with modern cluster compute technologies (Kubernetes, Spark, Hadoop/Yarn, Ray, Airflow) and a track record of delivering scalable infrastructure in a multi-user #J-18808-Ljbffr ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

manage data models, schema structures and data reconciliation processes across multiple source systems. Build, maintain and improve orchestration frameworks using tools such as Airflow and dbt. Develop APIs from scratch to support data access, integration and product functionality. Work closely with AI engineers, machine learning specialists and software developers … schema management principles. Experience creating and maintaining APIs from the ground up, rather than simply integrating with existing APIs. Hands-on experience using Airflow, dbt or similar orchestration and transformation tools. Experience working with large, complex and varied datasets. Not the Right Fit If Your background is heavily focused ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

production‐ready systems that scientists can trust and use daily. You’ll manage and extend a GCP‐first platform, working with tools like BigQuery, Airflow, dbt, and Terraform. You’ll also help build internal applications using Python, FastAPI, and React, giving teams easy ways to trigger workflows and access … Python skills, including building backend services and working with data workflows Experience with GCP, including BigQuery and cloud‐native tools Hands‐on experience with Airflow, dbt, and modern data pipelines Infrastructure as code experience, ideally using Terraform Experience building or contributing to internal tools or applications Strong ...

foundational Large Language Models (LLMs), along with sub‐agents, tools, and MCP integrations Architect end‐to‐end ML pipelines, integrating data processing (e.g., Spark, Airflow) with model training, evaluation, and deployment workflows Drive experimentation frameworks, including A/B testing and offline evaluation, to continuously improve model performance … fine‐tuning Large Language Models (LLMs) and building production AI Agents. Proven experience designing scalable data and ML pipelines using tools such as Spark, Airflow, or similar distributed systems. Demonstrated ability to operate as a senior individual contributor, influencing technical strategy and decision‐making without direct authority. Experience partnering ...