26 to 50 of 165 Remote Apache Airflow Jobs

As a Senior Data Engineer you will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising formats and duplication More ❯

As a Senior Data Engineer you will take ownership of the data platform, optimising it for scalability to ensure successful client onboarding. You'll use modern tools (such as Airflow, Prefect, Dagster or AWS Step Functions) for ETL design and orchestration, work on transformation logic to clean, validate and enrich data (including handling missing values, standardising formats and duplication More ❯

e.g., S3, Glue, Lambda, Redshift, Athena, EMR). Experience building data lakes and modern data platforms from the ground up. Proficiency with Python, SQL, and orchestration tools such as Airflow or dbt. Strong understanding of data modelling, ETL/ELT processes, and distributed systems. Knowledge of data security, governance, and compliance best practices. Excellent communication skills, with the ability More ❯

practices (testing, CI/CD, automation). Proven track record of designing, building, and scaling data platforms in production environments. Hands-on experience with big data technologies such as Airflow, DBT, Databricks, and data catalogue/observability tools (e.g. Monte Carlo, Atlan, Datahub). Knowledge of cloud infrastructure (AWS or GCP) - including services such as S3, RDS, EMR, ECS More ❯

practices (testing, CI/CD, automation). Proven track record of designing, building, and scaling data platforms in production environments. Hands-on experience with big data technologies such as Airflow, DBT, Databricks, and data catalogue/observability tools (e.g. Monte Carlo, Atlan, Datahub). Knowledge of cloud infrastructure (AWS or GCP) - including services such as S3, RDS, EMR, ECS More ❯

business • Expert knowledge of modern cloud data platforms (Databricks, Snowflake, ideally AWS) • Advanced Python programming skills and fluency with the wider Python data toolkit • Strong capability with SQL, Spark, Airflow, Terraform, and workflow orchestration tools • Solid understanding of CICD practices using Git, Jenkins, or equivalent tooling • Hands-on experience building both batch and streaming data integration pipelines • Depth in More ❯

. Experience with cloud platforms (AWS, Azure, GCP) and tools like Snowflake, Databricks, or BigQuery . Familiarity with streaming technologies (Kafka, Spark Streaming, Flink) is a plus. Tools & Frameworks: Airflow, dbt, Prefect, CI/CD pipelines, Terraform. Mindset: Curious, data-obsessed, and driven to create meaningful business impact. Soft Skills: Excellent communication and collaboration — translating complex technical ideas into More ❯

or GCP native stacks) Experience with platform observability and CI/CD for data platforms Hands-on experience with modern data engineering tools such as dbt, Fivetran, Matillion or Airflow History of supporting pre-sales activities in a product or consultancy-based business What Kubrick offers: A fast moving and fast growth business which is doing something seriously innovative More ❯

or GCP native stacks) Experience with platform observability and CI/CD for data platforms Hands-on experience with modern data engineering tools such as dbt, Fivetran, Matillion or Airflow History of supporting pre-sales activities in a product or consultancy-based business What Kubrick offers: A fast moving and fast growth business which is doing something seriously innovative More ❯

or GCP native stacks) Experience with platform observability and CI/CD for data platforms Hands-on experience with modern data engineering tools such as dbt, Fivetran, Matillion or Airflow History of supporting pre-sales activities in a product or consultancy-based business What Kubrick offers: A fast moving and fast growth business which is doing something seriously innovative More ❯

or GCP native stacks) Experience with platform observability and CI/CD for data platforms Hands-on experience with modern data engineering tools such as dbt, Fivetran, Matillion or Airflow History of supporting pre-sales activities in a product or consultancy-based business What Kubrick offers: A fast moving and fast growth business which is doing something seriously innovative More ❯

or GCP native stacks) Experience with platform observability and CI/CD for data platforms Hands-on experience with modern data engineering tools such as dbt, Fivetran, Matillion or Airflow History of supporting pre-sales activities in a product or consultancy-based business What Kubrick offers: A fast moving and fast growth business which is doing something seriously innovative More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

production environments at scale Experience using Large Language Models (LLMs) to prompt engineering, fine-tune foundation models and evaluation and alignment of LLMs 3+ years of experience with Kafka, Airflow, Spark, AWS Glue/Kinesis 3+ years of experience with Databricks or Snowflake Experience using LLM Ops tooling and practices in model versioning, deployment, cost optimization and latency reduction More ❯

following skills: Extensive hands-on experience with Snowflake data platform. Proficiency in SQL and ETL/ELT processes. Strong programming skills in Python. Extended skills across AWS, Azure, dbt, Airflow etc. Could this be of interest? If so, please get in touch with Alex at iO Associates. On this occasion, we cannot accept applications from candidates outside of the More ❯