126 to 141 of 141 Apache Airflow Jobs in London

integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time … robust, production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

This job is with Wise, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Wise is a global technology company ...

experience with cloud platforms (AWS, Azure, GCP) Experience in Python, with experience in frameworks like Tensorflow, PyTorch, and tools for building ETL pipelines (e.g. Apache NiFi, Airflow) Practical experience with NLP and/or Search techniques Prompt engineering, and LLMs for enterprise‐scale applications. You have team lead ...

data scientists. How to make an Impact Architect and Implement : Own the technical roadmap for our Spark‐based data processes to ensure our Airflow pipelines are performant, cost‐effective, and scalable. You will enhance our existing services through hands‐on development and solve any complex performance bottlenecks, concurrency issues … deployment. Expert‐level Python and its data ecosystem (Numpy, Pandas), including designing frameworks for data tasks. Deep understanding of distributed data processing engines like Apache Spark. Ability to reason about the full data lifecycle from ingestion through to real‐time serving - your system designs will need to meet downstream ...

production‐ready systems that scientists can trust and use daily. You’ll manage and extend a GCP‐first platform, working with tools like BigQuery, Airflow, dbt, and Terraform. You’ll also help build internal applications using Python, FastAPI, and React, giving teams easy ways to trigger workflows and access … Python skills, including building backend services and working with data workflows Experience with GCP, including BigQuery and cloud‐native tools Hands‐on experience with Airflow, dbt, and modern data pipelines Infrastructure as code experience, ideally using Terraform Experience building or contributing to internal tools or applications Strong ...

manage data models, schema structures and data reconciliation processes across multiple source systems. Build, maintain and improve orchestration frameworks using tools such as Airflow and dbt. Develop APIs from scratch to support data access, integration and product functionality. Work closely with AI engineers, machine learning specialists and software developers … schema management principles. Experience creating and maintaining APIs from the ground up, rather than simply integrating with existing APIs. Hands-on experience using Airflow, dbt or similar orchestration and transformation tools. Experience working with large, complex and varied datasets. Not the Right Fit If Your background is heavily focused ...

account management, so your focus stays exactly where it belongs, on hunting and closing. You will sell a respected range of air containment, airflow and efficiency solutions that help data centres cut costs, improve performance and reduce their carbon footprint, backed by a technical team that knows the detail. ...

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As ...

What will you be working on? Data Engineering → Build and Optimise Pipelines: Develop, optimise, and maintain data pipelines using Python, REST APIs, DBT, and Airflow to ensure seamless data flow for compliance and risk management. Understanding Control Requirements & Continuous Monitoring: Partner closely with control owners across security domains (such … organisation. Qualifications Technical Expectations: Proficient in Python, with experience in automation and building data pipelines. Strong expertise in working with tools like DBT and Airflow for ETL processes. Skilled in using REST APIs to develop and manage data integrations. Proficient in SQL and familiar with data visualization tools such ...

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn't just the Best Place to Play - it's also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As ...

Why Sony Interactive Entertainment? Sony Interactive Entertainment isn’t just the Best Place to Play — it’s also the Best Place to Work. Sony Interactive Entertainment (SIE) is the company behind the PlayStation brand. As ...

Fluency: A strong conceptual mastery of modern data platforms. You do not code, but you understand the architectural implications of AWS (S3), Databricks, dbt, Apache Iceberg, and legacy mainframe/SAS ecosystems well enough to guide technical decision‐making. Stakeholder Influence: Proven ability to manage C-suite and senior … migrate ~11,000 tables, 4,400 SAS scripts, and 500 BTEQ scripts, ensuring full alignment with the programme's "Lakehouse" architecture (AWS, Databricks, Apache Iceberg). Strategic Stakeholder Management: Act as the primary liaison between GlobalLogic's delivery units and senior Barclays stakeholders. Provide transparent reporting on programme health ...

This job is with Wise, an inclusive employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Wise is a global technology company ...

foundational Large Language Models (LLMs), along with sub‐agents, tools, and MCP integrations Architect end‐to‐end ML pipelines, integrating data processing (e.g., Spark, Airflow) with model training, evaluation, and deployment workflows Drive experimentation frameworks, including A/B testing and offline evaluation, to continuously improve model performance … fine‐tuning Large Language Models (LLMs) and building production AI Agents. Proven experience designing scalable data and ML pipelines using tools such as Spark, Airflow, or similar distributed systems. Demonstrated ability to operate as a senior individual contributor, influencing technical strategy and decision‐making without direct authority. Experience partnering ...

ADLIB is seeking a Senior Data Platform Engineer to take ownership of their growing platform and help scale it globally. You will work closely with scientists, analysts, and engineers to create scalable systems from complex ...