51 to 75 of 104 Apache Airflow Jobs in the UK excluding London

communication and stakeholder management skills. Desirable: Experience working with large-scale retail datasets (e.g., POS, CRM, supply chain). Familiarity with tools like dbt, Airflow, or MLflow. Master's or PhD in Data Science, Statistics, Computer Science, or related field. Benefits: Competitive salary and performance bonuses Flexible working options More ❯

BigQuery or similar cloud platforms) • Proficiency in Tableau or other data visualisation tools • Understanding of data modelling (Kimball methodology preferred) • Experience with DBT/Airflow and orchestration tools • Strong communication and stakeholder management skills • Familiarity with GitHub for version control and documentation Bonus Points For: • Python skills • Knowledge of More ❯

BigQuery or similar cloud platforms) • Proficiency in Tableau or other data visualisation tools • Understanding of data modelling (Kimball methodology preferred) • Experience with DBT/Airflow and orchestration tools • Strong communication and stakeholder management skills • Familiarity with GitHub for version control and documentation Bonus Points For: • Python skills • Knowledge of More ❯

to enhance scalability and efficiency. Collaboration & Leadership : Work closely with software and AI engineering teams while mentoring junior engineers. Legacy Workflow Integration : Manage ArgoCD, Airflow, Jenkins, Bitbucket, and Bamboo pipelines. Technical Ownership : Act as a tech owner for software products, liaising with stakeholders and presenting cloud solutions. Continuous Learning More ❯

data platform (PaaS) Ensure scalable storage solutions (data lakes, data warehouses) to handle structured and unstructured data. Implement ETL/ELT pipelines using Dagster, Airflow, or similar tools. Optimize performance and scalability for large data volumes. Govern data security, compliance, and access controls. Development & DevOps: Strong programming and scripting More ❯

Databricks/Snowflake, ideally on AWS Strong Python experience, including deep knowledge of the Python data ecosystem, with hands-on expertise in Spark and Airflow Hands-on experience in all phases of data modelling from conceptualization to database optimization supported by advanced SQL skills Hands-on Experience with implementing More ❯

in data pipelines across cloud/on-premises, using Azure and other technologies. Experienced in orchestrating data workflows and Kubernetes clusters on AKS using Airflow, Kubeflow, Argo, Dagster or similar. Skilled with data ingestion tools like Airbyte, Fivetran, etc. for diverse data sources. Expert in large-scale data processing More ❯

tuning and optimisation Solid understanding of data warehousing principles, data modelling practice, Excellent knowledge of creation and maintenance of data pipelines - ETL Tools (e.g. Apache Airflow) and Streaming processing tools (e.g. Kinesis) Strong problem-solving and analytical skills, with the ability to troubleshoot and resolve complex data-related More ❯

commodities markets (e.g., oil, gas). The PM is keen to get someone from a data engineering background. Tech: Python, SQL, Pandas, AWS, ETL, Airflow Please apply if this fits. More ❯

solid SQL skills Hands-on experience with Azure services (VMs, Web Apps, Storage, Azure ML) Knowledge of DevOps tools: GitHub Actions, Terraform, Docker, Kubernetes, Airflow Understanding of software engineering best practices and cloud security Exposure to ML model lifecycle and production environments Familiarity with Linux/Windows VM management More ❯

modelling, and extracting value from large, disconnected datasets Familiarity with data warehouse design and modelling Familiarity with cloud data services (preferably Azure) Experience with Airflow 🛂 Please note : unfortunately, this role does not offer VISA sponsorship. More ❯

So they offer very flexible working arrangements through both WFH options and flexi working hours. Experience required... Expert in Snowflake Strong DBT experience Strong Airflow experience Expert knowledge and understanding of Data Warehousing Strong AWS experience More ❯

more Key Responsibilities Develop and maintain ETL/ELT data pipelines using Python and SQL. Work with enterprise-level cloud platforms, ideally GCP (BigQuery, Airflow, Cloud Functions). Integrate APIs and process data from multiple sources. Design and optimise data warehouses and reporting systems. Build reports and dashboards using More ❯

Spark, Kafka, etc. Experience with relational SQL and NoSQL databases, including Postgres and Cassandra. Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. Experience with AWS cloud services: EC2, EMR, RDS, Redshift. Experience with stream-processing systems: Storm, Spark-Streaming, etc. Experience with object-oriented/ More ❯

Data Expertise – Experience with AWS, Azure, GCP, ETL pipelines, and scalable data architectures. DevOps & CI/CD – Strong knowledge of GitOps, Kubernetes, Terraform, Jenkins, Airflow, and related tools. Strategic Thinking – Ability to drive long-term engineering strategy while delivering incremental value. Technical Debt Management – Experience identifying and remediating inefficient More ❯

Technical excellence across the Data Engineering ecosystem: We primarily work in python, go and SQL. Our code (tracked via github) deploys to GCP (Bigquery, Airflow/Composer, GKE, Cloud Run), dbt Cloud and Azure via terraform. We recognise this is a broad list; if youre not deeply familiar with More ❯

Semantic Kernel, and tools such as MS tooling, Co-Pilot Studio, ML Studio, Prompt flow, Kedro, etc. Proficiency with pipeline orchestration tools, such as Airflow, Kubeflow, and Argo. Outstanding communication skills, combining subject matter expertise with a flair for statistics. A results-driven attitude, a passion for innovation, and More ❯

single cell RNA-seq, WES, proteomics, transcriptomics, metabolomics, GWAS, mass spec, spatial omics technology. Experience with orchestration tools (nextflow, snakemake), data engineering tools (Kubernetes, Airflow, Spark, Kafka, etc.), data visualization tools (Tableau, Spotfire, PowerBI, Looker, etc.) is strongly preferred. Strong understanding of cloud technology (Google Cloud, Azure, AWS) and More ❯

async · An expert working with databases and database architecture, SQL and Stored Procedures · Proven experience with Data integration technologies such as Azure Data Factory, Apache airflow, Databricks AutoLoader · Ability to build CI/CD pipelines and infrastructure as code · Experience with event driven data flows and message aggregators … Event Hub, Apache Kafka) · Good understanding of current and emerging technologies and their potential to deliver business benefits · Hands on experience working with data matching processes would be highly desirable · Ability to translate business strategy into technical solutions and business requirements into technical design As a precondition of employment More ❯

async · An expert working with databases and database architecture, SQL and Stored Procedures · Proven experience with Data integration technologies such as Azure Data Factory, Apache airflow, Databricks AutoLoader · Ability to build CI/CD pipelines and infrastructure as code · Experience with event driven data flows and message aggregators … Event Hub, Apache Kafka) · Good understanding of current and emerging technologies and their potential to deliver business benefits · Hands on experience working with data matching processes would be highly desirable · Ability to translate business strategy into technical solutions and business requirements into technical design As a precondition of employment More ❯

sync/async methods. Expertise in databases, database architecture, SQL, and stored procedures. Strong background in data integration technologies such as Azure Data Factory, Apache Airflow, and Databricks AutoLoader. Proficiency in building CI/CD pipelines and implementing infrastructure as code. Experience with event-driven data flows and … message aggregation technologies (Event Hub, Apache Kafka). A solid understanding of current and emerging technologies and how they can deliver business value. Desirable experience with data matching processes. Strong ability to translate business strategies into technical solutions and business requirements into technical designs. If you're passionate about More ❯

knowledge of geoscience and well data (Geology, Geophysics, Petrophysics, Wells, etc.). Familiarity with data visualization tools (Power BI, Tableau) or workflow automation tools(Apache Airflow). Exposure to Azure SQL, cloud storage solutions, or geoscience data platforms. Previous internship or coursework involving data reconciliation, validation, or geoscience More ❯

ideally for a systematic trading desk) Strong knowledge of SQL and relational databases In depth knowledge of data streaming technologies like Kafka, S3 and Airflow Degree or higher in Computer Science or similar field Willingness to do support and occasional on call work as and when required More ❯

ideally for a systematic trading desk) Strong knowledge of SQL and relational databases In depth knowledge of data streaming technologies like Kafka, S3 and Airflow Degree or higher in Computer Science or similar field Willingness to do support and occasional on call work as and when required More ❯

a week in the office (1 day in Oxford and 1 day in London) 🧰 Tech you'll use: Python, SQL, Spark, Kafka, Kubernetes, Docker, Airflow, RabbitMQ, AWS, Delta Lake ✅ You’ll thrive here if you: Believe in clean code, strong documentation and a test-first mindset Enjoy mentoring and More ❯