176 to 198 of 198 Permanent Apache Airflow Jobs

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

team to make sure our data function not only delivers but also drives strategic decision-making. Our Tech Stack Python, Docker, Dagster, dbt, Fivetran, Apache Iceberg, Snowflake, S3, Glue, ECS, and Omni. We're constantly evolving our stack and welcome input from engineering leaders on how we can improve … scaling data platforms in a high-growth or start-up environment. Strong expertise in Python and SQL, with deep experience in orchestration frameworks (Dagster, Airflow, Prefect). Advanced knowledge of data modelling and architecture (Kimball dimensional modelling, Data Vault etc). Hands-on experience with dbt, modern data warehouses ...

drive business impact through data Technical Environment Languages: Python, SQL, Bash Cloud: Azure, AWS Data & Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Tools: Airflow, DBT, Docker Infrastructure & Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills Experience with data platforms such as Snowflake or Azure Data Lake … Experience deploying models as APIs (e.g. FastAPI, Azure Functions) Knowledge of monitoring, model performance tracking and observability practices Familiarity with orchestration tools such as Airflow or Azure Data Factory ...

What you'll be doing: Design, develop, and maintain scalable data architectures and ETL pipelines Build and manage data models and data warehouse solutions (Airflow, dbt, and Redshift) Write clean, efficient Python and SQL code for data processing and transformation Integrate data from internal and third-party APIs … principles Ability to optimise data pipelines for performance and maintainability Strong collaboration skills and a proactive, problem-solving mindset Bonus Points For Experience with Airflow and/or dbt Experience working in Agile environments (Scrum/Kanban) Exposure to DevOps practices or CI/CD pipelines You'll join ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group ...

delivering advanced data solutions that support the future data strategy of the organisation. You will harness modern technologies including Data Vault, Snowflake, DBT, Airflow and AWS/Azure to shape scalable, future-proof data architectures. In this role, you will be responsible for defining, owning and governing data models … translate business requirements into effective data architecture solutions. Experience working with or supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor ...

Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience with enterprise Data Lake environments using ...

We're looking for an experienced Analytics Engineer to help shape our data foundations and deliver high quality, trusted insights across the business. You'll design and maintain scalable analytics models, ensure data quality, and ...

Senior Data Engineer AI SaaS | Data as a Product | London (Hybrid) This is a brilliant opportunity for someone who loves solving problems at the intersection of data and product and wants real ownership in a ...

Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/GKE architecture is highly desired Experience with ...

Uses Python day-to-day Has operated BigQuery at scale, and understands how queries behave across hundreds of terabytes Has built production systems with Airflow/Composer, DBT, Terraform and Docker Is comfortable with GKE, Cloud Run or Cloud Functions Has worked with streaming systems built on Dataflow/… Apache Beam Can work closely with non-technical stakeholders and shape solutions rather than just execute tickets Why join? Clear progression path - report directly into CTO with a clear route to a leadership position An opportunity to take ownership of the data platform Be part of a highly motivated ...

Uses Python day-to-day Has operated BigQuery at scale , and understands how queries behave across hundreds of terabytes Has built production systems with Airflow/Composer , DBT , Terraform and Docker Is comfortable with GKE , Cloud Run or Cloud Functions Has worked with streaming systems built on Dataflow/… Apache Beam Can work closely with non-technical stakeholders and shape solutions rather than just execute tickets Why join? Clear progression path - report directly into CTO with a clear route to a leadership position An opportunity to take ownership of the data platform Be part of a highly motivated ...

security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented … engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product ...

The Vacancy 28-35hrs per week- open to discuss flexible working of these hours Location Remote with some attendance at our London office in Shoreditch The ASA is the UK s regulator of advertising ...

value and accelerate data maturity. • Manage delivery across engineering, data science, and external vendors, ensuring deadlines and quality standards are met. • Oversee ingestion pipelines (Airflow, DBT, Glue) into AWS S3 and Redshift, ensuring reliability, scalability, and compliance. • Enable Insights, Marketing, and Commercial teams through dashboards, APIs, and curated datasets. … Manager or Data Product Owner within analytics, data platforms, or customer data domains. • Hands-on familiarity with AWS technologies (S3, Redshift) and orchestration tools (Airflow, DBT, Glue). • Strong understanding of data modelling, identity resolution, and data activation use cases. • Ability to translate business needs into clear technical requirements ...

Requires a Bachelors degree or foreign equivalent degree in Computer Science, Information Systems, Data Analytics, or a related quantitative field and two (2) years of experience in a data analytics related occupation. Experience or education ...

Cloud Infrastructure Engineer– Azure & Data Platforms Are you ready to shape the future of cloud infrastructure? We’re looking for a Cloud Infrastructure Engineer with 2–3 years of experience to design and manage a ...

Cloud Infrastructure Engineer– Azure & Data Platforms Are you ready to shape the future of cloud infrastructure? We're looking for a Cloud Infrastructure Engineer with 2–3 years of experience to design and manage a ...

Senior DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience ...

DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands ...