101 to 125 of 126 Permanent Apache Airflow Jobs

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

GDPR) isn't a \"nice to have\"it's the whole game. You need to be decisive. You need to know the modern stack (Airflow, Fivetran, Python) well enough to know when someone is pulling the wool over your eyes, but you need to be senior enough to step ...

validation (e.g., schema tests, data quality checks) Manage data documentation and lineage within DBT Design and develop scalable data pipelines using Databricks and Apache Spark Build and optimize data workflows for batch and real-time processing Transform and process large datasets using PySpark, SQL, and Delta Lake Implement data … terraform enterprise , Snowflake terraform provider knowledge. Snowflake : Snow sight , Python SDK for snowflake , Stage , storage integration , Data marketplace , direct shares , listings , catalog linked database , Apache Iceberg , external tables , Catalog integrations , Snowpipe , external volume , Cortex ai ,privatelink. Airflow : Dag creation , operators , connections , deployment on Kubernetes , Astronomer. ...

cloud-agnostic environment, leveraging a mix of technologies including Databricks, Snowflake, Azure Fabric/Synapse, and a modern open-source stack such as Airflow, Kafka, and ClickHouse. Key Responsibilities Design, build, and maintain scalable data pipelines (primarily in Python) Architect and evolve a modern data platform (ingestion, lake, warehouse … consumption layers) Develop and optimise data warehousing solutions, including ClickHouse and cloud-based platforms Implement and manage data orchestration using Airflow and other open-source tools Contribute to a data mesh architecture, leveraging Kafka or similar messaging technologies Define and maintain data models and semantic layers for business consumption ...

Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration … pipelines Strong SQL and Python skills, with hands-on experience building data pipelines Experience with DBT, Terraform, and version control (Git) Exposure to Airflow (or similar orchestration tools), Docker, and CI/CD practices Cloud experience in GCP (BigQuery preferred) or Azure/AWS environments Understanding of modern data ...

Engineer (Mid Level) £45,000–£55,000 Remote (1-2 days per month London, Leeds or Preston) Tech Stack: GCP (BigQuery, Dataflow), DBT, Terraform, Airflow (Composer), Python, SQL VIQU are working with a growing, data-driven organisation they are building out a modern Data Platform following a successful migration … pipelines Strong SQL and Python skills, with hands-on experience building data pipelines Experience with DBT, Terraform, and version control (Git) Exposure to Airflow (or similar orchestration tools), Docker, and CI/CD practices Cloud experience in GCP (BigQuery preferred) or Azure/AWS environments Understanding of modern data ...

help other members of the team. · Experience provisioning and managing AWS services using infrastructure as code such as AWS CloudFormation or Terraform. · Understanding of Apache Spark, Apache Trino or other big data and machine learning systems. · Knowledge of Serverless technologies, framework and best practices. · Experience provisioning and managing … Apache Airflow. · Exposure to using AI tools to enhance productivity and quality. Why Join RealityMine? At RealityMine, we believe our people are at the heart of everything we do. That’s why we go the extra mile to support every team member to unlock their full potential. Whether ...

developing and growing sales of a range of high-quality testing and measurement instruments , used by engineers to assess building performance, air quality, airflow, temperature, pressure and environmental conditions. This role will be primarily office-based , focusing on developing client relationships, managing incoming enquiries and proactively identifying sales opportunities ...

Group) I'm hiring a Mid-Level Data Engineer (3+ years’ experience) to help scale and optimise a robust data platform built on Python, Airflow, dbt and Redshift. 🔧 What you’ll be doing: • Scaling and optimising ELT pipelines (Python + Airflow) • Enhancing the data warehouse (performance, cost, complexity … looking for: • 3+ years in Data Engineering (FinTech/startup/scale-up ideal) • Strong Python + SQL expertise • Production-grade workflow orchestration (Airflow/Dagster/Prefect) • Deep understanding of data warehousing + ELT principles • Interest in Open Banking & payments This is a pivotal role at a high ...

We're looking for an experienced Analytics Engineer to help shape our data foundations and deliver high quality, trusted insights across the business. You'll design and maintain scalable analytics models, ensure data quality, and ...

Senior Data Engineer - VC Data Intelligence Platform - Python, AWS, Airflow, FastAPI, ClickHouse Oliver Bernard have partnered with an industry leading, VC Data Intelligence Platform, who are going through a sustained period of growth, due to increased market share, and are looking to bring on a highly skilled Senior Data … powered systems, contributing to architectural decisions, and working closely with stakeholders across the business. Senior Data Engineer - VC Data Intelligence Platform - Python, AWS, Airflow, FastAPI, ClickHouse Required skills and experience: 5+ years of commercial experience in a Data Engineering role or similar Strong Python experience Knowledge of a backend ...

security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented … engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product ...

architecture using Snowflake, AWS, and modern lakehouse principles Produce high-quality Architecture Design Documents (ADDs) and technical blueprints Architect and optimise data pipelines using Airflow/MWAA and dbt Define and implement data lakehouse solutions using Apache Iceberg and S3 Lead performance tuning across Snowflake, Airflow … with engineering, DevOps, and business stakeholders Requirements Strong experience in Solution Architecture for data platforms Deep expertise in Snowflake architecture Hands-on experience with Airflow/MWAA and dbt Strong knowledge of AWS data services (S3, EMR, PySpark) Experience designing Data Lakehouse architectures (Iceberg preferred) Expertise in performance tuning ...

Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/GKE architecture is highly desired Experience with ...

quality solutions. Responsibilities: Build and optimise Azure data pipelines Maintain Databricks data platforms for analytics and reporting Implement transformations using dbt Orchestrate workflows with Airflow Support platform migrations and modernisation Apply engineering best practices, version control, and CI/CD Document solutions and contribute to technical discussions Collaborate with … client teams on scalable solutions Essential Experience: Hands-on Azure data platform experience Proficiency in Databricks DBT experience in enterprise environments Airflow workflow orchestration Exposure to a mix of industry backgrounds Desirable Experience: Consultancy or multi-client delivery experience Input into platform design and architecture Experience in regulated ...

quality solutions. Responsibilities: Build and optimise Azure data pipelines Maintain Databricks data platforms for analytics and reporting Implement transformations using dbt Orchestrate workflows with Airflow Support platform migrations and modernisation Apply engineering best practices, version control, and CI/CD Document solutions and contribute to technical discussions Collaborate with … client teams on scalable solutions Essential Experience: Hands-on Azure data platform experience Proficiency in Databricks DBT experience in enterprise environments Airflow workflow orchestration Exposure to a mix of industry backgrounds Desirable Experience: Consultancy or multi-client delivery experience Input into platform design and architecture Experience in regulated ...

quality solutions. Responsibilities: Build and optimise Azure data pipelines Maintain Databricks data platforms for analytics and reporting Implement transformations using dbt Orchestrate workflows with Airflow Support platform migrations and modernisation Apply engineering best practices, version control, and CI/CD Document solutions and contribute to technical discussions Collaborate with … client teams on scalable solutions Essential Experience: Hands-on Azure data platform experience Proficiency in Databricks DBT experience in enterprise environments Airflow workflow orchestration Exposure to a mix of industry backgrounds Desirable Experience: Consultancy or multi-client delivery experience Input into platform design and architecture Experience in regulated ...

Lead Data Engineer Tech Stack: Python | Spark | Kafka | Airflow | Vector DBs Location: London - office based Salary: Up to £140k + equity We’re partnering with a well-funded AI startup building a category-defining platform within a major UK industry undergoing rapid transformation. This is a first data hire … looking for: • 7+ years in Data/Backend Engineering • Strong Python and distributed systems experience • Hands-on with modern data tooling (Spark, Airflow, Kafka, etc.) • Experience with relational + NoSQL databases (vector DBs a big plus) • Comfortable in a fast-paced, early-stage environment 💡 High ownership, strong engineering culture ...

Senior DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience ...