51 to 75 of 77 Apache Airflow Jobs in the UK excluding London

mentor teammates through code reviews and documentation. A bachelor’s degree or equivalent experience is required, with master’s a plus; AWS, Snowflake, Airflow, and Python experience preferred. #J-18808-Ljbffr ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

stakeholder communication skills Desirable: Experience overseeing or supporting data ingestion pipelines, including APIs and event driven data sources Familiarity with orchestration tools such as Airflow and modern ELT architectures Experience governing or implementing data CI/CD pipelines (e.g. dbt tests, deployment pipelines, automated checks). We currently … design input, reviews, and mentoring Influence how analytics data is built, trusted, and operated at scale Work with a modern stack: AWS, Snowflake, dbt, Airflow, SQL, and Python Join us as we redefine travel experiences and create memories for millions of passengers. At Jet2.com and Jet2holidays , your potential ...

building and optimising Semantic Layers for BI, reporting and analytics consumption Expert Level Data Modelling Strong hands-on experience with: Snowflake AWS dbt Databricks Airflow Ability to work in a fast-paced delivery environment and remain close to the technical implementation Desirable -Customer Loyalty, Rewards or Membership Programme experience ...

ideally within a large‐scale or regulated environment. AWS Experience: Strong working knowledge of AWS and cloud‐first data pipeline orchestration tools such as Airflow, Glue, or EMR. A Security Mindset: Understanding of compliance and security when managing sensitive data pipelines. Strong Automation Skills: Comfortable using Python and Shell ...

large‐scale or regulated environment. AWS Experience: You have a strong working knowledge of AWS and cloud‐first data pipeline orchestration tools (like Airflow, Glue, or EMR). A Security Mindset: You understand the importance of compliance and security when managing sensitive data pipelines. Strong Automation Skills ...

data flow, including supporting delivery in air-gapped and other restricted environments. Delivering data applications in an automated and continuous fashion. Utilising tools like Airflow for orchestration and automating data pipeline deployments using DevOps tools and techniques (Docker, Containers, Terraform, Kubernetes) Building data pipelines using both cloud-native … experience as a DataOps Engineer delivering DataOps solutions in public sector or similarly regulated environments. Developing, orchestrating and maintaining data pipelines using tools like Airflow, Prefect, or Dagster. Containerising data applications using Docker and deploying them to Container Platforms (EKS, AKS and Kubernetes). Implementing CI/CD pipelines ...

infrastructure: AWS and/or GCP, Kubernetes APIs and services: REST, gRPC Distributed systems: event-driven architectures, including Kafka Orchestration Frameworks: LangGraph, LangChain, AirFlow, etc Activities Integration of commercial and open-source LLMs into agentic workflows Agent and orchestration frameworks such as LangChain, LlamaIndex, Semantic Kernel, or CrewAI Model ...

continuous improvement and automation. Desirable Experience Experience within Financial Services or other highly regulated environments. VMware virtualisation platforms. F5 Load Balancers. Infoblox DNS. Apache Airflow. Prometheus, Grafana and Loki. Infrastructure-as-Code methodologies. Enterprise patching programmes and operating system lifecycle management. Platform modernisation or automation initiatives. What ...

preferred Mastery of Python, SQL, and Spark – and strong opinions on how they should be used in production data pipelines Deep experience with dbt, Airflow, or equivalent orchestration – including how to build pipelines that are testable, observable, and operationally sound Strong understanding of data quality engineering – not just validation … leadership responsibility Primary cloud AWS – Glue, Lambda, Athena, S3, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, MWAA Streaming Languages Python, SQL, Spark dbt, Airflow/AWS MWAA, AWS Glue Platforms Databricks, Snowflake, Amazon Redshift Great Expectations, dbt tests, reconciliation frameworks, data observability tooling IaC/DevOps Terraform ...

preferred Mastery of Python, SQL, and Spark – and strong opinions on how they should be used in production data pipelines Deep experience with dbt, Airflow, or equivalent orchestration – including how to build pipelines that are testable, observable, and operationally sound Strong understanding of data quality engineering – not just validation … leadership responsibility Primary cloud AWS – Glue, Lambda, Athena, S3, Redshift, RDS, Kinesis, MSK, Lake Formation, Step Functions, MWAA Streaming Languages Python, SQL, Spark dbt, Airflow/AWS MWAA, AWS Glue Platforms Databricks, Snowflake, Amazon Redshift Great Expectations, dbt tests, reconciliation frameworks, data observability tooling IaC/DevOps Terraform ...

/ML, data engineering) Experience in large-scale data processing, microservices, API design, Kafka, Redis, MemCached, observability tools (Dynatrace, Splunk, Grafana), and orchestration frameworks (Airflow, Temporal) Advanced working knowledge of relational and NoSQL databases, vector stores, data lake architectures, and data governance Practical cloud-native experience (AWS, Azure … hands-on experience with Spark/PySpark and other big data processing technologies Expertise in open-source table formats and catalog services such as Apache Iceberg Experience with LLM orchestration frameworks and model serving infrastructure or managed endpoints (AWS Bedrock, Azure OpenAI) Familiarity with AI evaluation and observability practices ...

Title: Analytics Engineer Location: Manchester (Hybrid, 2-3 days per week in the office) Salary: £60,000 - £80,000 DOE Industry: Financial Services The Opportunity I'm currently working with a growing financial services organisation ...

improve go-to-market pricing and revenue management, collaborating with pricing, monetization, and engineering teams. The role offers exposure to Vertex AI, BigQuery, and Airflow, plus generous benefits and a culture built on trust and inclusion. #J-18808-Ljbffr ...

help strengthen pre- and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals ...

help strengthen pre and post-change validation, enhance observability, and support the continuous improvement of automation capabilities. Technology Stack Linux/UNIX Python Ansible Apache Airflow Prometheus Grafana Loki VMware F5 What We're Looking For We're looking for engineers with: Strong Linux/UNIX administration fundamentals ...

Concurrency, Preemption, Stress testing frameworks Testbench Architecture and Implementation GFX API Exposure : Vulkan/DX11/DX12 Exposure Scripting and automation skills (Python, Make, Airflow etc) Embedded FW Development and Debugging Benchmarking and Performance Analysis Windows and/or Linux OS Kernel Architecture C/C++, GNU Toolchain, Visual ...

integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time … robust, production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

Scope Akkodis is launching a new technical delivery team to drive a UK national program in collaboration with key partners, designed to transform and future-proof the central government’s workforce. By leveraging cutting-edge ...

Data Engineer | Belfast | Hybrid At a Glance Mid to senior level Data Engineer Core stack: Python, SQL, Airflow/dbt, cloud data warehousing (Snowflake, BigQuery or similar) Hybrid working... 3 days on-site in Belfast city centre Competitive salary Exclusive role... you will not find this advertised anywhere else … Hands-on experience with Python for data processing Strong SQL skills and experience with relational databases Experience with orchestration and transformation tools such as Airflow or dbt Comfortable manipulating and modelling complex datasets Based within commuting distance of Belfast city centre (3 days on-site required) Desirable: Experience working ...

account management, so your focus stays exactly where it belongs, on hunting and closing. You will sell a respected range of air containment, airflow and efficiency solutions that help data centres cut costs, improve performance and reduce their carbon footprint, backed by a technical team that knows the detail. ...

involved in a modern data transformation programme, including a planned migration to Microsoft Fabric. Key Responsibilities Develop and maintain data pipelines using Apache Airflow. Design and optimise SQL-based data solutions. Build and enhance Power BI reports and dashboards. Work closely with stakeholders to gather requirements and deliver insights. … Support ongoing improvements to the data platform and reporting environment. Contribute to the organisation's future migration to Microsoft Fabric. Required Skills Experience with Apache Airflow. Strong Azure SQL skills. Power BI development and data modelling experience. Good understanding of ETL/ELT processes and data warehousing concepts. Strong ...

Months contract 2 Days a month onsite - Expenses to Newcastle depends on their hub. Start 3 from offer Experience required AWS Services Terraform Apache Spark Python Airflow Docker Nice to haves Gitlab Security Scanning Agents (eg Trivy, Trend Micro, Wiz etc) Jupyter Notebooks Integration with DWP Integration Team ...

Large-scale Linux operating system upgrades. Kernel patching across extensive server estates. Automation of infrastructure operations and maintenance activities. Development of orchestration workflows using Apache Airflow. Building automation tooling using Python and Ansible. Enhancing observability, monitoring and operational controls. Supporting the introduction of live-patching technologies. The role requires … excellence. Automation Engineering Design, develop and maintain infrastructure automation solutions. Develop tooling and integrations using Python and Ansible. Build and enhance orchestration workflows within Apache Airflow. Create automated pre-change validation and post-change verification processes. Improve efficiency and reduce manual intervention through automation. Platform Observability Implement monitoring ...