126 to 150 of 220 Apache Airflow Jobs

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

experience with Google Cloud Platform (Big Query, Data form, Cloud Composer). Metadata management and data cataloguing (e.g., DataHub, Alation). Modern orchestration platforms (Airflow, Prefect, Dagster). Cloud-native architectures, including Kubernetes, serverless, and Infrastructure as Code. Data mesh or decentralised data architecture implementations. Model Context Protocol ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

Tech Lead Manager in a data, platform or backend environment A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar Experience owning or supporting analytics, data or reporting products Strong people leadership skills including hiring, coaching and performance management A track record ...

Tech Lead Manager in a data, platform or backend environment A background in data or backend engineering, such as AWS, Python or Scala, Spark, Airflow or similar Experience owning or supporting analytics, data or reporting products Strong people leadership skills including hiring, coaching and performance management A track record ...

/ML algorithms, and LLMs (Large Language Models) Proficiency in Python (preferred) or other general-purpose programming languages. Familiarity with orchestration tools: LangGraph, Airflow, Kubeflow, etc. Strong DevOps and CI/CD tools Proficiency in cloud-based architecture and experience with infrastructure automation (Terraform, Kubernetes). ...

keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high … monitoring. Required Skills 8 10 years ' experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift, EMR/Spark Apache Iceberg Python/SQL Experience in telecom data pipelines and handling large-scale structured/semi-structured data. Strong problem-solving, optimization, and debugging skills. ...

seeking an experienced Data Analyst to support on an initial 6 Month Contract Engagement. Data Analyst Outside IR35 Contract Remote (UK) £300 - 325pd Airflow, dbt, Redshift, Tableau, Data layers, Data modelling, GA4, GTM, excel and power queries, etc Understanding of Python If you meet the above requirements & can start ...

Data services (indexing, slots, pruning, partitioning, clustering) Expert-level Kubernetes & GKE resource tuning Hands-on experience with Dataflow job pipelines and worker optimisation Strong Airflow/Composer knowledge (DAG design, scheduling, PodOperator) Strong Dataflow processing pipelines development & schedulers knowledge Deep understanding of Cloud Logging routing, sinks, exclusion filters Experience ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

services, including indexing, slots, pruning, partitioning, and clustering. Expert-level Kubernetes & GKE resource tuning. Hands-on experience with Dataflow pipelines and worker optimisation. Strong Airflow/Composer knowledge (DAG design, scheduling, PodOperator). Deep understanding of Cloud Logging, routing, sinks, and exclusion filters. Experience with Cloud Spanner autoscaling, indexing ...