1 to 25 of 83 Remote/Hybrid Apache Airflow Jobs

Modern data platforms: Databricks, Snowflake and cloud-native data services Data architecture: Lakehouse, medallion, data mesh and domain-oriented patterns Data processing: Apache Spark, SQL and distributed processing technologies Data storage: Delta Lake, Apache Iceberg and open table formats Data pipelines: Enterprise-scale ETL/ELT, batch … streaming patterns Transformation and quality: dbt, Great Expectations and equivalent tooling Orchestration: Apache Airflow and cloud-native orchestration services Event streaming: Kafka and cloud-native event-streaming technologies Data modelling: Dimensional, analytical and domain-oriented modelling Data governance: Catalogue, metadata, lineage, quality, security, privacy and access controls Data ...

Modern data platforms: Databricks, Snowflake and cloud-native data services Data architecture: Lakehouse, medallion, data mesh and domain-oriented patterns Data processing: Apache Spark, SQL and distributed processing technologies Data storage: Delta Lake, Apache Iceberg and open table formats Data pipelines: Enterprise-scale ETL/ELT, batch … streaming patterns Transformation and quality: dbt, Great Expectations and equivalent tooling Orchestration: Apache Airflow and cloud-native orchestration services Event streaming: Kafka and cloud-native event-streaming technologies Data modelling: Dimensional, analytical and domain-oriented modelling Data governance: Catalogue, metadata, lineage, quality, security, privacy and access controls Data ...

data warehousing (Snowflake, Redshift, BigQuery or Synapse) Understanding of data modelling and CI/CD Desirable Spark, Databricks or Kafka Orchestration tools such as Airflow or dbt Infrastructure as Code (Terraform) Experience supporting ML workloads What's On Offer Competitive salary and bonus Hybrid working Pension, private healthcare, holiday ...

pipelines and warehouses. Strong SQL skills and proficiency in Python or another relevant programming language. Experience with modern data engineering tools, such as dbt, Airflow or Spark. Experience with cloud data warehouses, such as Snowflake, BigQuery or Amazon Redshift. A solid understanding of data modelling, ETL/ ...

with experience in CI/CD pipelines, monitoring, and observability tools (Grafana or equivalent). Exposure to analytics, reporting, and BI tools such as Apache Superset, Lightdash or OpenSearch Willingness to work across the stack by contributing to API development and, at times, UI components (Vue.js, Zoho, or similar ...

Python and SQL programming skills, with experience developing and maintaining data pipelines Familiarity with ETL/ELT technologies and data streaming tools such as Airflow, Azure, SSIS, Spark or Kafka Experience working with databases and data platforms such as PostgreSQL, SQL Server, Oracle, Snowflake or similar technologies Knowledge ...

workloads.Experience working with modern cloud data warehouses, ideally Google BigQuery.Practical understanding of dimensional data modelling principles.Experience using tools in our tech stack such as Airflow, Terraform, or Grafana.Previous experience working within Agile delivery teams.Benefits:We believe in supporting our people with meaningful, flexible benefits that prioritise well-being ...

with modern cloud data warehouses, ideally Google BigQuery. Practical understanding of dimensional data modelling principles. Experience using tools in our tech stack such as Airflow, Terraform, or Grafana. Previous experience working within Agile delivery teams. Benefits: We believe in supporting our people with meaningful, flexible benefits that prioritise well ...

from various structured and unstructured sources (databases, APIs, streaming platforms) into BigQuery and Cloud Storage Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows Developing SQL transformation workflows with Dataform , including version control, testing, and automated scheduling with … built-in quality assertions Creating efficient, cost-optimized BigQuery queries with proper partitioning, clustering, and denormalization strategies Orchestrating complex workflows using Cloud Composer (Apache Airflow) and Cloud Functions for event-driven data processing Implementing centralized data governance and metadata management using Dataplex with automated cataloging and lineage tracking ...

from various structured and unstructured sources (databases, APIs, streaming platforms) into BigQuery and Cloud Storage Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows Developing SQL transformation workflows with Dataform , including version control, testing, and automated scheduling with … built-in quality assertions Creating efficient, cost-optimized BigQuery queries with proper partitioning, clustering, and denormalization strategies Orchestrating complex workflows using Cloud Composer (Apache Airflow) and Cloud Functions for event-driven data processing Implementing centralized data governance and metadata management using Dataplex with automated cataloging and lineage tracking ...

from various structured and unstructured sources (databases, APIs, streaming platforms) into BigQuery and Cloud Storage Implementing data ingestion and real-time processing using Dataflow (Apache Beam) and Pub/Sub for batch and streaming workflows Developing SQL transformation workflows with Dataform , including version control, testing, and automated scheduling with … built-in quality assertions Creating efficient, cost-optimized BigQuery queries with proper partitioning, clustering, and denormalization strategies Orchestrating complex workflows using Cloud Composer (Apache Airflow) and Cloud Functions for event-driven data processing Implementing centralized data governance and metadata management using Dataplex with automated cataloging and lineage tracking ...

/on-prem environments. The ideal candidate will have: * Experience in data engineering, ideally aerospace/defence or industrial sectors. * ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). * Strong Python and SQL; C++, C#, or MATLAB a plus. * Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg ...

Service - integration model on hybrid/on-prem environments.Hard SkillsExperience in data engineering, ideally aerospace/defence or industrial sectors.ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka).Strong Python and SQL; C++, C#, or MATLAB a plus.Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB.Data Platform Capabilities ...

Service - integration model on hybrid/on-prem environments.Hard SkillsExperience in data engineering, ideally aerospace/defence or industrial sectors.ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka).Strong Python and SQL; C++, C#, or MATLAB a plus.Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB.Data Platform Capabilities ...

integration model on hybrid/on-prem environments. Hard SkillsExperience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka).Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg, TimescaleDB.Data ...

Scrum or Kanban.Strong analytical and problem-solving skills, with a focus on delivering high-quality solutions.Experience with modern data engineering tools such as Airflow, dbt, Dataform, or similar technologies.Excellent communication and stakeholder management skills, with the ability to explain technical concepts to non-technical audiences.Unfortunately we are unable ...

such as SageMaker, Vertex AI or Azure MLData engineering and MLOpsExperience with data warehouses such as Snowflake, BigQuery or RedshiftWorkflow orchestration using tools like Airflow or DagsterExperience with MLOps tools such as MLflow, Weights and Biases or similarAwareness of data and model drift, and how to monitor and respond ...

skills Experience building data pipelines and integrating data from multiple sources Exposure to technologies such as Power BI, Snowflake, SQL Server, PostgreSQL, Spark, Kafka, Airflow, Docker, and Kubernetes Experience within engineering, manufacturing, industrial, or other complex regulated environments would be advantageous Excellent stakeholder management and problem-solving abilities What ...

communication skills and experience collaborating with Product, Engineering, and Data teams.Extra awesomeExperience working in a B2B SaaS product company.Experience with orchestration tools such as Airflow or Argo Workflows.Familiarity with SQL, Spark, Snowflake, or other data processing technologies.Experience building systems that combine structured data, unstructured data, and generative AI.Experience with ...

experience collaborating with Product, Engineering, and Data teams. Extra awesomeExperience working in a B2B SaaS product company. Experience with orchestration tools such as Airflow or Argo Workflows. Familiarity with SQL, Spark, Snowflake, or other data processing technologies. Experience building systems that combine structured data, unstructured data, and generative AI.Experience ...

data modeling and data integrationSkilled in data manipulation, processing and orchestration frameworksHands-on experience with Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis, Redshift, SonarQube and PyTestProficiency with GitHub, GitHub Actions and Azure DevOpsStrong communication and collaboration skills to align technical and business stakeholdersProven ability ...

ADLS, and Azure Functions. Proven track record of designing and implementing metadata-driven data pipelines. Deep expertise in orchestration and data workflow automation e.g. Airflow, DBT. Strong understanding of CI/CD practices for data engineering. Experience with infrastructure as code (Terraform, Bicep, or ARM templates) (preferred). Solid ...

including ADF, ADLS, and Azure Functions. Proven experience designing and implementing metadata-driven data pipelines. Strong understanding of orchestration and data workflow automation, e.g. Airflow, DBT, Spark Declarative Pipelines. Strong understanding and practical application of CI/CD practices for data engineering. Experience contributing to technical design discussions ...

need both skillsets below - strength in one is enough: Hands-on: building AI/ML pipelines or prototypes; vector databases; prompt engineering; orchestration tools (Airflow/Prefect); Git Advisory: designing AI/data architectures; Agentic AI principles (LangGraph, CrewAI, AutoGen); mentoring specialists without formal authority; AI governance (security, privacy ...

pipelines Managing AWS cloud data services (Glue, DMS, Athena preferred) Setting up and managing a cloud data warehouse (Redshift preferred) Hands-on working with Airflow or an equivalent orchestrator in production (Dagster, Prefect) Solid understanding of data modelling: dimensional modelling, slowly changing dimensions, and event-sourced schemas Other Desired ...