1 to 25 of 61 Permanent Apache Airflow Jobs in the South East

maintain scalable, cloud-based data pipelines and architectures to support advanced analytics and machine learning initiatives. Develop robust ELT workflows using tools like dbt, Airflow, and SQL (PostgreSQL, MySQL) to transform raw data into high-quality, analytics-ready datasets. Collaborate with data scientists, analysts, and software engineers to ensure … however Azure exposure is essential. Data Warehousing: Proven expertise with Snowflake – schema design, performance tuning, data ingestion, and security. Workflow Orchestration: Production experience with Apache Airflow (Prefect, Dagster or similar), including authoring DAGs, scheduling workloads and monitoring pipeline execution. Data Modeling: Strong skills in dbt, including writing modular ...

experience designing and building modern data platforms in AWS. ETL/Orchestration Expertise: Expertise in ETL/ELT design and data orchestration, specifically with Apache Airflow. SQL Mastery: Strong SQL skills with significant experience in query tuning and performance optimisation. Programming Proficiency: Proficiency in Python and Bash (for data ...

governance, security, and regulatory compliance . Ability to work closely with technical and business teams to deliver impactful solutions. Nice-to-Haves: Orchestration tools (Airflow, dbt, Prefect) or streaming frameworks (Kafka, Kinesis). CI/CD experience and DevOps practices for data workflows. Exposure to data visualisation platforms (PowerBI ...

/ELT pipeline. Proficiency with at least one scripting/programming language (e.g., Python). Familiarity with modern data engineering tools like dbt, Airflow, Prefect, or similar is a plus. Knowledge of cloud platforms (AWS/Azure/GCP). Understanding of data modelling, quality controls and best practices. ...

modular, reusable transformations using SQL and Python. Implement CI/CD pipelines and manage deployments via Git. Automate workflows using orchestration tools such as Airflow or dbt Cloud. Configure and optimise Snowflake warehouses for performance and cost efficiency. Required Skills & Experience 7+ years in data engineering roles. 3+ years ...

/ELT pipeline. Proficiency with at least one scripting/programming language (e.g., Python). Familiarity with modern data engineering tools like dbt, Airflow, Prefect, or similar is a plus. Knowledge of cloud platforms (AWS/Azure/GCP). Understanding of data modelling, quality controls and best practices. ...

integration. Documentation. Your Profile Essential Skills/Knowledge/Experience Strong working and technical knowledge of GCP (GCS Buckets, BigQuery, Dataproc, Pub/Sub), Airflow, Spark, PySpark, Spark SQL, Hive. Good knowledge of Python (Pandas, NumPy, Wiresafe), SQL, Linux CLI, BigQuery. Experience with DBMS, Delta Tables, Oracle, MS Access ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving ...

technologies (NoSQL, time-series databases) and deep competence in data modeling principles. Workflow Orchestration: Strong working knowledge of industry-standard data orchestration tools (e.g., Apache Airflow or Kubernetes). The Environment We are seeking a highly collaborative professional with strong problem-solving skills, capable of thriving ...

skills and experience with relational databases Python development experience and familiarity with frameworks (e.g. Flask, Django) Experience building and orchestrating ETL pipelines (e.g. Airflow, Luigi, Argo) Exposure to big data technologies (e.g. Spark, Kafka, Hadoop) Experience working in Agile environments Solid understanding of data architecture and data quality best ...

skills and experience with relational databases Python development experience and familiarity with frameworks (e.g. Flask, Django) Experience building and orchestrating ETL pipelines (e.g. Airflow, Luigi, Argo) Exposure to big data technologies (e.g. Spark, Kafka, Hadoop) Experience working in Agile environments Solid understanding of data architecture and data quality best ...

Python (and ideally C#) programming skills You have experience with data modelling, ETL pipelines and data integration You have a good knowledge of Dagster, Airflow or similar orchestration tool You're collaborative and pragmatic with great stakeholder communication skills What's in it for you: Salary to £120k Pension ...

frameworks such as React or Next.js. Experience creating and maintaining APIs, working with relational/non‐relational databases. Familiarity with data orchestration tools (e.g. Airflow) and data warehouse/lake design. Practical knowledge of AWS or Azure cloud environments. Strong understanding of Git, CI/CD, and modern deployment ...

Prometheus, Grafana, Alertmanager, Thanos; ELK; Jaeger; custom exporters Jenkins, GitLab, Sonatype Nexus, Terraform, Ansible, Argo CD AWS (primary), with GCP/Azure exposureDVC, MLFlow, Airflow, Dagster, CVAT, Weights &... ...

with hands on Snowflake experience* Proven dbt experience at scale* Strong dimensional modelling using Kimball principles* Python for data engineering tasks* Experience with Airflow or similar orchestration tools* Git based workflows* Familiarity with BI tools such as Tableau, Looker, or Power BI* Experience working in cloud environments including ...

cloud technologies. You will be utilising and playing with tools across the entire data ecosystem. Essential tech skills include proficiency in Python, Spark, and Airflow, alongside experience with major data platforms such as Snowflake, Databricks, and BigQuery. Familiarity with data transformation and infrastructure as code tools like dbt, Fivetran ...

working as a Data Engineer or in a similar data-focused engineering role Strong Python and SQL skills Experience building and orchestrating data pipelines (Airflow or similar tools) Hands-on work with cloud platforms (AWS and/or Azure) Solid understanding of databases, data warehouses, and data lakes Experience ...

e.g. Power BI, Tableau, Looker) Experience with cloud data platforms (e.g. Snowflake, BigQuery, Redshift) Familiarity with automation, orchestration, or analytics engineering tools (e.g. dbt, Airflow) Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity ...

experience using dbt for the transformation layer (cleaning, testing and documenting data models). Orchestration Tools: Experience designing and scheduling workflows using tools like Airflow, Prefect or platform-native tools. Infrastructure & DevOps Infrastructure as Code: Practical experience with IaC tools to deploy cloud resources programmatically rather than manually. ...

data modeling skills. Hands-on experience with cloud data warehouses (Snowflake, BigQuery, Databricks). Proficiency with ELT tools (dbt, Fivetran, Matillion) and orchestration frameworks (Airflow, Prefect). ...