51 to 75 of 79 Apache Airflow Jobs in the UK

/CD, testing frameworks, type-hinting, code reviews); and can build scalable, maintainable solutions Nice-to-have skills: Experience with DevOps tools (Airflow, Kubernetes, Terraform, GCP), data integration/ETL and pipeline optimization, or reinforcement learning algorithms Customer collaborator: Comfortable working directly with clients and cross-functional teams, aligning ...

Expert-level dbt Core/Cloud proficiency, including advanced Jinja, macro development, and incremental materialization strategies. Deep experience with Databricks (Unity Catalog, SparkSQL) and Apache Iceberg on AWS S3. Ability to reverse-engineer Legacy Teradata/BTEQ and write highly optimized SQL for Databricks. Hands-on experience with Apache Airflow (ideally Astronomer) for managing complex dependency trees. Strong mastery of Git workflows, CI/CD for data, and Infrastructure as Code (IaC) principles. Job responsibilities Design a scalable, DRY dbt project structure and materialization strategy tailored for a regulated enterprise migration. Lead the technical conversion of 500+ ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

Looking For Strong experience designing and building scalable data pipelines Proficiency in SQL, Python, Databricks or AWS Experience with tools such as Git and Airflow Proven ability to test, troubleshoot and improve data platforms Experience delivering high-quality, reliable data solutions Strong communication skills and ability to work ...

experience designing and building automated, scalable data pipelines. Advanced Python and SQL development skills. Hands-on experience with Google Cloud Platform technologies, including BigQuery, Airflow/Cloud Composer, Cloud Run, Dataform and Dataplex. Experience delivering complex technical projects in fast-paced environments. A passion for mentoring others and developing ...

environments and know how to bring out the best in people. Technically strong: You're comfortable with modern data stacks like Databricks, Spark, Airflow, SQL and Python - and you can go deep when needed. Cloud-savvy: You understand distributed systems and cloud platforms, and how to make them work ...

restricted/high‐side environments Python for automation and data processing Data platform and pipeline engineering experience Familiarity with orchestration tooling such as Airflow Understanding of MLOps practices and ML delivery workflows Additional Responsibilities Provide technical assurance, design review, and architecture support Define practical engineering standards and ways ...

creating. You'll have experience with: AWS and cloud-native technologies Snowflake or similar cloud data platforms Data orchestration tools such as Airflow, Prefect or similar Amazon S3 and modern data architectures Postgres and semi-structured data models Event-driven architectures and scalable systems You'll understand how data ...

following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 at a top tier university Excellent training ...

following: Distributed computing frameworks such as Spark or Databricks Cloud platforms such as AWS, Azure or GCP Orchestration tools such as Airflow Test, troubleshoot and improve data products, ensuring reliability and quality You will have an academic record of achievement, minimum 2.1 from a top tier university. Excellent training ...

with AWS/Azure and Kubernetes Proven delivery of large-scale migration programmes Desirable: CI/CD and DevOps experience Integration with tools like Airflow, Snowflake, Databricks Experience in regulated/public sector environments What you need to do now If you're interested in this role, click 'apply ...

GenAI or advanced NLP projects such as NER, table extraction, OCR integrations, or GNN solutions. Familiarity with orchestration and deployment tools: Airflow, Redis, Flask/Django/FastAPI, SQL, R‐Shiny/Dash/Streamlit. Openness to evaluate and adopt emerging technologies and programming languages as needed. Public contributions ...

commercial experience in analytics within a marketing or digital environment Advanced SQL skills and experience building data pipelines with tools such as DBT or Airflow Experience with marketing analytics platforms such as Google Analytics, GTM, Braze, Appsflyer, or Firebase Strong understanding of experimentation, A B testing, and attribution modelling ...

Comfortable acting as a technical authority - advising on approach and best practice and communicating clearly with non-technical stakeholders Experience with Azure, SQL, Dagster, Airflow or similar tools acceptable Experience with Python scripting, React-based applications, FactSet and third-party web APIs Desirable: Understanding of financial data experience with ...

Prepare and manage data across multiple platforms with a focus on accuracy Build and maintain BI dashboards using tools such as QuickSight, DBT, and Airflow Support audit, due diligence, and financial reporting requirements Your Skills and Experience Strong commercial experience in reporting, analytics, and financial analysis Advanced SQL capability ...

influence stakeholders across multiple regions. Technical Environment Experience across some of the following technologies is advantageous: AIops and enterprise automation frameworks Workflow orchestration platforms (Airflow, Argo, Prefect) Configuration and automation tools (Ansible, Salt, Puppet) ITSM and ITOM platforms Event-driven automation and runbook-as-code approaches Messaging technologies such ...

your initiative and get on with resolving it! From a tech perspective, it would be most excellent if you've come from an AWS, Apache AirFlow, Python, Spark type of environment and understand these technologies (or alternatives) and what they do. You'll still be considered ...

Develop batch and ELT/ETL data workflows for ingesting and processing large datasets Work with technologies such as Python, Java, Spark, SQL, and Airflow Apply good software engineering practices, including testing, documentation, and CI/CD Contribute to cloud‐based systems (AWS), focusing on reliability, monitoring, and automation … data engineering concepts such as data lakes, batch processing, and distributed systems Experience building or operating data pipelines using tools like Spark and Airflow Familiarity with cloud platforms (AWS preferred) and production monitoring Clear communication skills and a collaborative approach to problem‐solving. Why join us? Join our team ...

integration failures, data inconsistencies, and production issues Key Skills • Python & SQL (production-grade pipeline development) • REST APIs, webhooks, OAuth, event-driven architecture • Orchestration tools: Airflow, Prefect, or Dagster • Cloud platforms: AWS, GCP, or Azure • Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills • Vector databases and embedding pipelines • Real-time … robust, production-grade data pipelines from scratch. • Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. • Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). • Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

integration failures, data inconsistencies, and production issues Key Skills Python & SQL (production-grade pipeline development) REST APIs, webhooks, OAuth, event-driven architecture Orchestration tools: Airflow, Prefect, or Dagster Cloud platforms: AWS, GCP, or Azure Docker & Kubernetes Microsoft 365 & Microsoft Copilot Desirable Skills Vector databases and embedding pipelines Real-time … robust, production-grade data pipelines from scratch. Deep familiarity with integration patterns: REST APIs, webhooks, OAuth, and event-driven architectures. Experience with orchestration tools (Airflow, Prefect, or Dagster) and transformation frameworks (dbt or similar). Comfortable across cloud platforms (AWS, GCP, or Azure) and with containerisation (Docker, Kubernetes). ...

focus areas: Building scalable data pipelines using Apache Spark & Airflow Working within a cloud-based, containerised environment (Kubernetes) Contributing to a wider data platform modernisation programme Supporting both batch and streaming workloads Tech: Python, Java, Spark, Airflow, SQL, Cloud (AWS/Azure), Kubernetes (Kafka/streaming nice ...

We're looking for an experienced Analytics Engineer to help shape our data foundations and deliver high quality, trusted insights across the business. You'll design and maintain scalable analytics models, ensure data quality, and ...