26 to 50 of 51 Apache Airflow Jobs in the UK

/SD/PP etc.) required for December cutover. Build scalable ingestion pipelines using Delta Lake/Parquet and modern orchestration tools (ADF, dbx, Airflow, etc.). Collaborate with SAP functional teams to validate business logic, deltas, and data quality. Implement CI/CD and DevOps practices for data ...

preferred) or similar platforms: Snowflake, BigQuery, Redshift, Synapse, or equivalent Strong proficiency with: SQL (advanced level) Spark/PySpark Data pipeline orchestration tools (e.g., Airflow, ADF, etc.) Data Modelling Extensive experience designing: Fact and dimension tables Star and snowflake schemas Aggregation layers and semantic models Data Migration & Mapping Demonstrated ...

creating. You'll have experience with: AWS and cloud-native technologies Snowflake or similar cloud data platforms Data orchestration tools such as Airflow, Prefect or similar Amazon S3 and modern data architectures Postgres and semi-structured data models Designing and building event-driven architectures and scalable systems Building ...

organisation Deep understanding & hands-on leverage of Modern, Cloud scale Data Technologies, with specific expertise in Distributed Data Processing architectures (Spark, PySpark, Python, Airflow), ELT data processing underpinning Data LakeHouses and Data Products for scaled use within ML & AI Expertise in Streaming Data, Event Driven Design, Data Governance ...

data modelling Experience integrating messy external APIs and bulk datasets Strong Postgres Experience with a transformation framework ( dbt or SQLMesh ) and an orchestrator ( Dagster , Airflow, Prefect, or similar). Modern Python data tooling; DuckDB for analytical compute. Financial Services/Wealth domain would be ideal but not essential ...

platforms and pipelines (batch and real-time ingestion). Hands-on familiarity with: Snowflake (or equivalent cloud data warehouse), Looker (or other BI tools), Airflow, Pub/Sub, or similar orchestration and ingestion frameworks. Experience with data infrastructure monitoring and optimization. Strong communication skills. Ability to translate business goals ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

Data Engineer - FinTech - Newcastle (Tech stack: Data Engineer, SQL, Python, AWS, Git, Airflow, Data Pipelines, Data Platforms, Programmer, Developer, Architect, Data Engineer) Our client is a trailblazer in the FinTech space, known for delivering innovative technology solutions to global financial markets. They are expanding their engineering capability in Newcastle ...

following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 at a top tier university Excellent training ...

following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 from a top tier university. Excellent training ...

with AWS/Azure and Kubernetes Proven delivery of large-scale migration programmes Desirable: CI/CD and DevOps experience Integration with tools like Airflow, Snowflake, Databricks Experience in regulated/public sector environments What you need to do now If you're interested in this role, click 'apply ...

data and performance insights What We're Looking For Strong background in data analytics Advanced SQL skills and experience building data pipelines (e.g. DBT, Airflow) Experience with marketing analytics tools (e.g. Google Analytics, GTM, Braze, Appsflyer, Firebase) Proven experience running A/B tests and defining KPIs and attribution ...

commercial experience in analytics within a marketing or digital environment Advanced SQL skills and experience building data pipelines with tools such as DBT or Airflow Experience with marketing analytics platforms such as Google Analytics, GTM, Braze, Appsflyer, or Firebase Strong understanding of experimentation, A B testing, and attribution modelling ...

Comfortable acting as a technical authority - advising on approach and best practice and communicating clearly with non-technical stakeholders Experience with Azure, SQL, Dagster, Airflow or similar tools acceptable Experience with Python scripting, React-based applications, FactSet and third-party web APIs Desirable: Understanding of financial data experience with ...

your initiative and get on with resolving it! From a tech perspective, it would be most excellent if you've come from an AWS, Apache AirFlow, Python, Spark type of environment and understand these technologies (or alternatives) and what they do. You'll still be considered ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

focus areas: Building scalable data pipelines using Apache Spark & Airflow Working within a cloud-based, containerised environment (Kubernetes) Contributing to a wider data platform modernisation programme Supporting both batch and streaming workloads Tech: Python, Java, Spark, Airflow, SQL, Cloud (AWS/Azure), Kubernetes (Kafka/streaming nice ...

account management, so your focus stays exactly where it belongs, on hunting and closing. You will sell a respected range of air containment, airflow and efficiency solutions that help data centres cut costs, improve performance and reduce their carbon footprint, backed by a technical team that knows the detail. ...

reliable, production-ready systems that scientists can trust and use daily.You’ll manage and extend a GCP-first platform, working with tools like BigQuery, Airflow, dbt, and Terraform. You’ll also help build internal applications using Python, FastAPI, and React, giving teams easy ways to trigger workflows and access … backend services and working with data workflows A few years of experience with GCP, including BigQuery and cloud-native tools Hands-on experience with Airflow, dbt, and modern data pipelines Infrastructure as code experience, ideally using Terraform Experience building or contributing to internal tools or application Strong ...

within air-gapped environments, ensuring secure deployment of ML solutions Collaborate with data scientists to operationalise ML models Utilise tools such as MLflow and Airflow for model tracking and orchestration Support cloud-based deployments across AWS and Google Cloud Platform Ensure performance, reliability, and scalability of machine learning systems … Experience building CI/CD pipelines using GitLab (YAML) Understanding of DevSecOps principles and tooling Exposure to ML lifecycle tools such as MLflow and Airflow Ability to work in highly secure or air-gapped environments Strong problem-solving and collaboration skills What you'll get in return Opportunity ...

distributed processing frameworks such as Spark or Databricks Build and optimise data workflows across cloud platforms (AWS, Azure, GCP) Implement orchestration frameworks such as Airflow Test, troubleshoot, and improve data products to ensure reliability and quality Collaborate with engineering teams to deliver robust, maintainable systems Key Requirements: Experience building … Experience working with at least some of: Distributed computing frameworks (e.g. Spark, Databricks) Cloud platforms (AWS, Azure, or GCP) Workflow orchestration tools (e.g. Airflow) Strong understanding of data system reliability, testing, and performance Experience troubleshooting and improving production data systems Strong problem-solving skills and attention to detail Ability ...