126 to 150 of 198 Permanent Apache Airflow Jobs

/ML algorithms, and LLMs (Large Language Models) Proficiency in Python (preferred) or other general-purpose programming languages. Familiarity with orchestration tools: LangGraph, Airflow, Kubeflow, etc. Strong DevOps and CI/CD tools Proficiency in cloud-based architecture and experience with infrastructure automation (Terraform, Kubernetes). ...

keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue, EMR, or Spark. Ensure high … monitoring. Required Skills 8 10 years ' experience in data engineering. Strong hands-on experience with: AWS S3, Athena, Glue, Redshift, EMR/Spark Apache Iceberg Python/SQL Experience in telecom data pipelines and handling large-scale structured/semi-structured data. Strong problem-solving, optimization, and debugging skills. ...

seeking an experienced Data Analyst to support on an initial 6 Month Contract Engagement. Data Analyst Outside IR35 Contract Remote (UK) £300 - 325pd Airflow, dbt, Redshift, Tableau, Data layers, Data modelling, GA4, GTM, excel and power queries, etc Understanding of Python If you meet the above requirements & can start ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

data platforms. Hands on experience with ETL development, data modelling and data normalization. Background in AWS environments and modern orchestration tools such as Airflow or Dagster. Confidence leading client conversations, running workshops and defining solutions Experience within the music industry is a significant advantage. BENEFITS The successful Head ...

high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally ...

high-growth B2B environment Strong technical depth across: Backend: Node js, Typescript Frontend: React, Typescript Database: MySQL Cloud/Infra: AWS, ECS, K8s, Airflow, Kafka, Serverless Solid understanding of SaaS fundamentals: onboarding, authentication, SSO, granular authorisation, multi-tenancy Familiarity with workflow orchestration, asynchronous tasks, and event-driven architecture Ideally ...

engineering and product teams to support evolving data requirements Requirements: SQL Server T-SQL DBA Skills Power BI ETL (SSIS or other, such as Airflow) MySQL would be useful but certainly not essential. Apply Now! If you have a range of experience in Data Engineering and you are looking ...

partitioning, clustering, cost control strategies, and performance tuning. Extensive experience designing and building production data pipelines using core GCP services such as Cloud Composer (Airflow), Dataflow, Pub/Sub, and Cloud Storage. Strong Python skills for data processing, scripting, and automation. Demonstrated experience using Terraform for Infrastructure as Code … deployment and management. Strong understanding of data modelling methodologies such as Kimball and Data Vault in data warehouse environments. Familiarity with frameworks such as Apache Beam and dbt. 3. Future-Focused & AI Awareness Interest in the evolution of modern data platforms and emerging technologies. Understanding of, or interest ...

clearly. Excellent problem-solving skills and the ability to translate business requirements into technical solutions. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills and Experience … platforms such as Snowflake and Azure Data Lake. Understanding of monitoring, model performance tracking and observability best practices. Familiarity with orchestration tools such as Airflow or Azure Data Factory. ...

Platforms Itential Automation Platform Cisco NSO – Service development and lifecycle Apache Airflow Hasi Corp Vault Openshift Automation development Python Fast API Rest API Netconf Yang modelling XML/Json Jinja/TextFSM Pytest Unit testing Database MongoDB DevOps Docker Git CI/CD Kubernetes Networking Ciena 517x/ ...

/Gas), who is technically well versed in systematic trading development, and analysis data-sets (time series, market-data). Stack: Python, AWS, ETL, Airflow The team has a flat structure, where developers are interfaced with PMs and traders, to ensure the software systems created are bespoke. ...

/Gas), who is technically well versed in systematic trading development, and analysis data-sets (time series, market-data). Stack: Python, AWS, ETL, Airflow The team has a flat structure, where developers are interfaced with PMs and traders, to ensure the software systems created are bespoke. ...

experience What youll be doing: Building and operating ingestion pipelines into the lakehouse Developing Spark transformation jobs and reusable pipeline patterns Orchestrating workflows in Airflow (raw > bronze > silver > gold) Implementing manifest-driven transformation using JSON configuration stored in MongoDB or CosmosDB Maintaining Delta Lake tables and trouble shoot pipeline ...

healthcare, fintech, or other regulated environments Exposure to LLM infrastructure, model serving, or agentic AI frameworks in production Familiarity with data platforms (BigQuery, Airflow, data pipelines) Experience with CI/CD pipelines (GitHub Actions, Cloud Build) and policy-as-code tools Exposure to observability stacks (OpenTelemetry, Prometheus, Cloud Monitoring ...

Senior Data Engineer (AWS, Airflow, Python) Based at client locations, working remotely, or based in our Godalming or Milton Keynes offices. Salary up to £65k plus company benefits. About Us Triad Group Plc is an award-winning digital, data, and solutions consultancy with over 35 years' experience primarily serving … maintain cloud data solutions. Maintain modular Terraform based IaC for reliable provisioning of AWS infrastructure. Develop, optimise and maintain robust data pipelines using Apache Airflow. Implement data transformation processes using Python to clean, preprocess, and enrich data for analytical use. Collaborate with data analysts, data scientists, developers, and other ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...