76 to 100 of 104 Apache Airflow Jobs in England

integration patterns and data pipeline design Desirable Exposure to data governance frameworks and tooling (e.g. Collibra) Experience with orchestration platforms such as Astronomer/Airflow Knowledge of enterprise data architecture practices, including metadata management and lineage Education Bachelors or Masters in Information Technology, Computer Science or relevant field. Work ...

infrastructure: AWS and/or GCP, Kubernetes APIs and services: REST, gRPC Distributed systems: event-driven architectures, including Kafka Orchestration Frameworks: LangGraph, LangChain, AirFlow, etc Activities Integration of commercial and open-source LLMs into agentic workflows Agent and orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or CrewAI Model ...

driving engineering best practices. Ability to influence technical direction and architectural decisions. Comfortable remaining hands-on while operating in a leadership capacity. Desirable Skills Airflow Databricks AI-focused development experience Semantic layer experience Reasonable Adjustments: Respect and equality are core values to us. We are proud of the diverse ...

platform engineer and presenting a business case to a C‐minus‐1. Preferred, not required Experience with the modern data stack: Snowflake, Databricks, dbt, Airflow, BigQuery, Spark, or similar. Data observability, data quality, or AI observability experience is a strong plus. Familiarity with MEDDPICC, Command of the Message ...

large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills ...

Service Meshes etc.) Experience with configuration management tools (Ansible/Puppet/Kapitan/Terraform) Experience with distributed data platforms (Kafka/Flink/Airflow) Comfortable using cloud native and containerisation technologies (Kubernetes/Docker) Good Linux systems knowledge (experience with RHEL desirable) Broad knowledge across network technologies, server ...

including model deployment, monitoring, evaluation, and lifecycle management Strong hands‐on understanding of modern data and AI tooling, ideally including SQL, Python, Snowflake, dbt, Airflow, Metabase, Tableau, and AWS‐based data services Experience with data ingestion, streaming, and change data capture tooling, such as Fivetran, Estuary, or similar platforms … standards, and enablement for analytics engineers Ability to oversee API‐based and batch data extraction processes, particularly those built in Python and orchestrated using Airflow Understanding of machine learning tooling and lifecycle management, ideally including DVC, MLflow, Evidently AI, or equivalent platforms for experiment tracking, versioning, monitoring, and evaluation ...

multiple teams. In this contract role, expect to define standards, build reusable data movement frameworks and drive best practices with AWS Glue, Spark and Airflow in a regulated environment. London-based with on-site presence three days a week. #J-18808-Ljbffr ...

than one-off scripts or analysis tooling. Strong Python development skills, with experience building performant, maintainable applications. Experience with workflow orchestration tools such as Airflow, Dagster, or Prefect. Understanding of retries, dependency management, idempotency, backfills, and operational recovery. Experience with analytical or columnar databases such as ClickHouse or similar ...

building and leading a team of engineers working in a related system. Experience with build, release and deployment infrastructure technologies such as Spinnaker, Jenkins, Airflow, Docker, Kubernetes, Terraform, Bazel, etc. Ability to attract, hire, and coach engineers who meet the Databricks hiring standards – can up‐level existing team ...

building and leading a team of engineers working in a related system. Experience with build, release and deployment infrastructure technologies such as Spinnaker, Jenkins, Airflow, Docker, Kubernetes, Terraform, Bazel, etc. Ability to attract, hire, and coach engineers who meet the Databricks hiring standards – can up‐level existing team ...

advanced proficiency in Python with extensive experience building production applications and services Experience with modern cluster compute technologies (e.g., Kubernetes, Spark, Hadoop Yarn, Ray, Airflow) Experience leading work in a formal software development environment in collaboration with other engineers Strong experience building platforms on the Linux operating system Self ...

This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud Platform, etc; You will own engineering efforts to provide partner teams within the organisation with data sources that build … opportunity for the role to go permanent. What You'll Do: Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow; Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality ...

mechanics (order books vs AMMs, fee structures, market manipulation/anti-manipulation signals). Proficiency with SQL; experience with streaming systems (Kafka), workflow orchestration (Airflow), and cloud (AWS/GCP/Azure). Experience with Bayesian methods, probabilistic programming (Stan/PyMC), or ensemble methods. Familiarity with rigorous experimentation … online/offline evaluation, data leakage prevention, and model governance. Tech Stack Python, SQL, pandas/numpy/scipy, PyTorch/sklearn Airflow/dbt, Kafka (or equivalents), Postgres/BigQuery Docker, Kubernetes (optional), CI/CD (GitHub Actions) Observability: Prometheus/Grafana, OpenTelemetry (or equivalents) Locations and Right ...

recommendations, ranking and personalization across Bumble products. You will build production-grade models with PyTorch, craft end-to-end ML pipelines using Spark and Airflow, and deploy AI Agents based on Large Language Models, mentoring senior contributors and shaping responsible AI practices. #J-18808-Ljbffr ...

deliver scalable, production-grade Python services and APIs for research and operations. The role emphasizes modern cluster compute technologies (Kubernetes, Spark, Hadoop Yarn, Ray, Airflow) and strong proficiency in Python. A background in mathematics or computing is advantageous. #J-18808-Ljbffr ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

with cloud platforms (AWS, Azure, GCP). Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

manage data models, schema structures and data reconciliation processes across multiple source systems. Build, maintain and improve orchestration frameworks using tools such as Airflow and dbt. Develop APIs from scratch to support data access, integration and product functionality. Work closely with AI engineers, machine learning specialists and software developers … schema management principles. Experience creating and maintaining APIs from the ground up, rather than simply integrating with existing APIs. Hands-on experience using Airflow, dbt or similar orchestration and transformation tools. Experience working with large, complex and varied datasets. Not the Right Fit If Your background is heavily focused ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

account management, so your focus stays exactly where it belongs, on hunting and closing. You will sell a respected range of air containment, airflow and efficiency solutions that help data centres cut costs, improve performance and reduce their carbon footprint, backed by a technical team that knows the detail. ...

involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data pipelines using Apache Airflow. Design and optimise SQL-based data solutions. Build and enhance Power BI reports and dashboards. Work closely with stakeholders to gather requirements and deliver insights. … Support ongoing improvements to the data platform and reporting environment. Contribute to the organisation's future migration to Microsoft Fabric. Required Skills Experience with Apache Airflow. Strong Azure SQL skills. Power BI development and data modelling experience. Good understanding of ETL/ELT processes and data warehousing concepts. Strong ...

production‐ready systems that scientists can trust and use daily. You’ll manage and extend a GCP‐first platform, working with tools like BigQuery, Airflow, dbt, and Terraform. You’ll also help build internal applications using Python, FastAPI, and React, giving teams easy ways to trigger workflows and access … Python skills, including building backend services and working with data workflows Experience with GCP, including BigQuery and cloud‐native tools Hands‐on experience with Airflow, dbt, and modern data pipelines Infrastructure as code experience, ideally using Terraform Experience building or contributing to internal tools or applications Strong ...