1 to 25 of 76 Apache Airflow Jobs in the UK excluding London

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

Snowflake, Databricks, or BigQuery. Familiarity with streaming technologies (e.g., Kafka, Spark Streaming, Flink) is an advantage. Experience with orchestration and infrastructure tools such as Airflow, dbt, Prefect, CI/CD pipelines, and Terraform. What you get in return: Up to £60,000 per annum + benefits Hybrid working ...

governance, security, and regulatory compliance . Ability to work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI ...

governance, security, and regulatory compliance . Ability to work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI ...

/ELT pipeline. Proficiency with at least one scripting/programming language (e.g., Python). Familiarity with modern data engineering tools like dbt, Airflow, Prefect, or similar is a plus. Knowledge of cloud platforms (AWS/Azure/GCP). Understanding of data modelling, quality controls and best practices. ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

Data Engineer: Experience with Databricks , Kafka , or Kinesis for real-time data streaming Knowledge of containerisation (Docker, ECS) and modern orchestration tools such as Airflow Familiarity with machine learning model deployment pipelines or data lakehouse architectures Data Engineer, AWS Data Engineer ...

/ELT pipeline. Proficiency with at least one scripting/programming language (e.g., Python). Familiarity with modern data engineering tools like dbt, Airflow, Prefect, or similar is a plus. Knowledge of cloud platforms (AWS/Azure/GCP). Understanding of data modelling, quality controls and best practices. ...

communicate clearly with technical and non-technical stakeholders Nice to Have Experience with dbt or other transformation frameworks Exposure to data orchestration tools (Airflow, etc.) Understanding of data governance, lineage, and metadata management Experience supporting BI tools (Power BI, Tableau, Looker, etc.) Python experience for data tooling or automation ...

experience in cloud-based data services. Proficiency in SQL and Python for data manipulation and transformation. Experience with modern data engineering tools, including Apache Spark, Kafka, and Airflow. Strong understanding of data modelling, schema design, and data warehousing concepts. Familiarity with data governance, privacy, and compliance frameworks (e.g., GDPR ...

integration. Documentation. Your Profile Essential Skills/Knowledge/Experience Strong working and technical knowledge of GCP (GCS Buckets, BigQuery, Dataproc, Pub/Sub), Airflow, Spark, PySpark, Spark SQL, Hive. Good knowledge of Python (Pandas, NumPy, Wiresafe), SQL, Linux CLI, BigQuery. Experience with DBMS, Delta Tables, Oracle, MS Access ...

skills and experience with relational databases Python development experience and familiarity with frameworks (e.g. Flask, Django) Experience building and orchestrating ETL pipelines (e.g. Airflow, Luigi, Argo) Exposure to big data technologies (e.g. Spark, Kafka, Hadoop) Experience working in Agile environments Solid understanding of data architecture and data quality best ...

skills and experience with relational databases Python development experience and familiarity with frameworks (e.g. Flask, Django) Experience building and orchestrating ETL pipelines (e.g. Airflow, Luigi, Argo) Exposure to big data technologies (e.g. Spark, Kafka, Hadoop) Experience working in Agile environments Solid understanding of data architecture and data quality best ...

with a strong focus on ETL/ELT. • Advanced SQL and Python development skills. • Hands-on experience with DBT, GIT, Terraform, Docker, IAM, and Airflow (Composer). • Proven experience working on cloud platforms – ideally GCP (BigQuery), but Azure or AWS also considered. • Strong understanding of Data Mesh, Test Driven ...

detailed technical design. Hands-on experience configuring multi-node Hadoop clusters, including resource management, security, and performance tuning. Strong Big Data engineering background using Apache Airflow, Spark, dbt, Kafka, and Hadoop ecosystem tools. Knowledge of RDBMS systems (PostgreSQL, SQL Server) and familiarity with NoSQL/distributed databases such … MongoDB. Proven delivery of streaming pipelines and real-time data processing solutions. Improved job efficiency and reduced runtimes through Apache Spark optimisation and development. Some experience with containerisation (Docker, Kubernetes) and CI/CD pipelines. Delivered streaming pipelines and real-time data processing solutions. Experience replacing legacy ETL tools ...

turn data into trusted insight and measurable outcomes What we're looking for Advanced SQL (Snowflake & Oracle) and solid Python Experience with dbt, Airflow, ADF, Matillion or similar tools Strong Power BI skills (dataset design, DAX optimisation, deployment pipelines) Proven experience running production data platforms Confident with RBAC, masking ...

DataOps practices, including CI/CD, containerisation, and workflow orchestration Hands-on experience with ETL/ELT frameworks and big data tools (e.g. Spark, Airflow, Hive) Proficiency in programming languages such as Python, Java, and SQL Experience with SQL and NoSQL database design and optimisation Strong understanding of batch ...

share knowledge with team members. Required Qualifications Proven experience in designing and building data pipelines (ETL/ELT) using modern technologies (Python, SQL, Spark, Airflow, etc.). Strong analytical skills with the ability to interpret complex data and deliver business value. Experience integrating data from multiple sources and systems. ...

enhances their overall luxury experience. Required Skills & Qualifications: Strong SQL skills in Snowflake and Oracle, good Python ability, and experience with tools like dbt, Airflow, ADF, or Matillion, plus Git-based CI/CD. Confident with Power BI: building datasets, modelling, optimising DAX, and managing workspaces and deployments. Comfortable ...

e.g. Power BI, Tableau, Looker) Experience with cloud data platforms (e.g. Snowflake, BigQuery, Redshift) Familiarity with automation, orchestration, or analytics engineering tools (e.g. dbt, Airflow) Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity ...

Prometheus, Grafana, Alertmanager, Thanos; ELK; Jaeger; custom exporters Jenkins, GitLab, Sonatype Nexus, Terraform, Ansible, Argo CD AWS (primary), with GCP/Azure exposureDVC, MLFlow, Airflow, Dagster, CVAT, Weights &... ...

experience using dbt for the transformation layer (cleaning, testing and documenting data models). Orchestration Tools: Experience designing and scheduling workflows using tools like Airflow, Prefect or platform-native tools. Infrastructure & DevOps Infrastructure as Code: Practical experience with IaC tools to deploy cloud resources programmatically rather than manually. ...

PostgreSQL, MySQL) Strong knowledge of data warehouse, data lake, and lakehouse architectures Experience with ETL/ELT frameworks and orchestration tools (e.g. Informatica, Talend, Apache Airflow) Proven experience establishing and maintaining data governance frameworks Strong understanding of data security, access controls, and compliance requirements Excellent problem-solving, communication ...

Oracle, SQL Server, PostgreSQL, MySQL). Knowledge of data warehouse and lakehouse architectures. Familiarity with ETL/ELT and orchestration tools (e.g., Informatica, Talend, Apache Airflow). Experience establishing and maintaining data governance frameworks. Experience complying with data security requirements. Experience designing data models. Excellent problem-solving, communication ...

data modelling experience e.g. dbt Ideally AWS/GCP background Data warehousing experience - e.g. Snowflake, BigQuery, Redshift IAC e.g. Terraform Orchestration experience e.g. dagster, airflow THE BENEFITS: You will receive a salary, dependent on experience. Salary is up to £120,000 On top of the salary there are some ...