201 to 225 of 240 Apache Airflow Jobs in the UK

topologies. Exposure to MLOps tooling and AI platform layers: experiment tracking (MLflow, W'B), model serving frameworks (Triton, vLLM), and pipeline orchestration (Kubeflow, Airflow). Familiarity with InfiniBand and high-performance networking as it relates to distributed training performance — sufficient to engage credibly with network and infrastructure teams ...

evaluation harness in production. Familiarity with retrieval/IR systems and the engineering of large-context pipelines. Distributed‐systems background — workflow engines (Temporal/Airflow/Prefect), queues, and observability stacks (OpenTelemetry, Datadog, Honeycomb). Open‐source contributions to agentic frameworks, eval tooling, or workflow orchestration. Why Join ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

cloud platforms (AWS, Azure, GCP). Well‐versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g., Apache NiFi, Airflow). Strong collaboration skills with the ability to work across engineering, research, and product teams across multiple time zones. You have ...

Solutions Architect to join our field team and deliver world-class technical solutions. You will work with customers to implement Astronomer products, focusing on Apache Airflow, and guide complex deployments at scale. In this hands-on role, you will collaborate with Sales and Product, solve intricate architecture challenges ...

help strengthen pre- and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals ...

help strengthen pre and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals ...

developers, and stakeholders to build APIs and frameworks that scale our investment workflows. You will drive innovative compute solutions, stay current with Kubernetes, Spark, Airflow, and related tools, and help deliver scalable infrastructure across the firm. #J-18808-Ljbffr ...

Concurrency, Preemption, Stress testing frameworks Testbench Architecture and Implementation GFX API Exposure : Vulkan/DX11/DX12 Exposure Scripting and automation skills (Python, Make, Airflow etc) Embedded FW Development and Debugging Benchmarking and Performance Analysis Windows and/or Linux OS Kernel Architecture C/C++, GNU Toolchain, Visual ...

elevate our current data pipelines and streaming architectures. Establish best practices for monitoring, reliability, and scale across our data ecosystem (using Python, dbt, Airflow, Kafka, and Trino/Iceberg). Build the Unified Customer View: Productionize PoCs into scalable Airflow/dbt data workflows to lay the groundwork … Python and proven experience architecting, deploying, and maintaining Big Data and streaming/batch pipelines (e.g., Kafka Streams, Event Streaming, Trino, Iceberg). dbt & Airflow Proficiency: Hands-on experience using dbt for scalable data transformations and Airflow for workflow orchestration. Data Architecture Mastery: A strong background in designing ...

integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time … robust, production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

This job is with Wise, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Wise is a global technology company ...

Scope Akkodis is launching a new technical delivery team to drive a UK national program in collaboration with key partners, designed to transform and future-proof the central government’s workforce. By leveraging cutting-edge ...

with cloud platforms (AWS, Azure, GCP) Well versed in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise-scale applications. You have team lead ...

data scientists. How to make an Impact Architect and Implement : Own the technical roadmap for our Spark‐based data processes to ensure our Airflow pipelines are performant, cost‐effective, and scalable. You will enhance our existing services through hands‐on development and solve any complex performance bottlenecks, concurrency issues … deployment. Expert‐level Python and its data ecosystem (Numpy, Pandas), including designing frameworks for data tasks. Deep understanding of distributed data processing engines like Apache Spark. Ability to reason about the full data lifecycle from ingestion through to real‐time serving - your system designs will need to meet downstream ...

production‐ready systems that scientists can trust and use daily. You’ll manage and extend a GCP‐first platform, working with tools like BigQuery, Airflow, dbt, and Terraform. You’ll also help build internal applications using Python, FastAPI, and React, giving teams easy ways to trigger workflows and access … Python skills, including building backend services and working with data workflows Experience with GCP, including BigQuery and cloud‐native tools Hands‐on experience with Airflow, dbt, and modern data pipelines Infrastructure as code experience, ideally using Terraform Experience building or contributing to internal tools or applications Strong ...

Data Engineer | Belfast | Hybrid At a Glance Mid to senior level Data Engineer Core stack: Python, SQL, Airflow/dbt, cloud data warehousing (Snowflake, BigQuery or similar) Hybrid working... 3 days on-site in Belfast city centre Competitive salary Exclusive role... you will not find this advertised anywhere else … Hands-on experience with Python for data processing Strong SQL skills and experience with relational databases Experience with orchestration and transformation tools such as Airflow or dbt Comfortable manipulating and modelling complex datasets Based within commuting distance of Belfast city centre (3 days on-site required) Desirable: Experience working ...

account management, so your focus stays exactly where it belongs, on hunting and closing. You will sell a respected range of air containment, airflow and efficiency solutions that help data centres cut costs, improve performance and reduce their carbon footprint, backed by a technical team that knows the detail. ...

account management, so your focus stays exactly where it belongs, on hunting and closing. You will sell a respected range of air containment, airflow and efficiency solutions that help data centres cut costs, improve performance and reduce their carbon footprint, backed by a technical team that knows the detail. ...

account management, so your focus stays exactly where it belongs, on hunting and closing. You will sell a respected range of air containment, airflow and efficiency solutions that help data centres cut costs, improve performance and reduce their carbon footprint, backed by a technical team that knows the detail. ...

involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data pipelines using Apache Airflow. Design and optimise SQL-based data solutions. Build and enhance Power BI reports and dashboards. Work closely with stakeholders to gather requirements and deliver insights. … Support ongoing improvements to the data platform and reporting environment. Contribute to the organisation's future migration to Microsoft Fabric. Required Skills Experience with Apache Airflow. Strong Azure SQL skills. Power BI development and data modelling experience. Good understanding of ETL/ELT processes and data warehousing concepts. Strong ...

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As ...

What will you be working on? Data Engineering → Build and Optimise Pipelines: Develop, optimise, and maintain data pipelines using Python, REST APIs, DBT, and Airflow to ensure seamless data flow for compliance and risk management. Understanding Control Requirements & Continuous Monitoring: Partner closely with control owners across security domains (such … organisation. Qualifications Technical Expectations: Proficient in Python, with experience in automation and building data pipelines. Strong expertise in working with tools like DBT and Airflow for ETL processes. Skilled in using REST APIs to develop and manage data integrations. Proficient in SQL and familiar with data visualization tools such ...