201 to 222 of 222 Apache Airflow Jobs

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

ingestion workflows Implement data quality frameworks and enforce data contracts Build CI/CD pipelines and automated testing for data workflows Orchestrate pipelines using Airflow, Prefect, or Dagster Improve observability, monitoring, and lineage across data systems Mentor junior engineers and elevate engineering standards Key Skills and Experience Management … Data Engineering experience Expert-level SQL and advanced data modelling Strong Python Experience with Snowflake and Databricks Cloud experience Experience with orchestration tools (Airflow, Prefect) CI/CD and DataOps experience for data platforms This role will suit someone who is looking to remain hands on , whilst leading ...

skills with the ability to work cross-functionally with stakeholders, engineers, and analysts. Technical Stack: Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker Data: Snowflake, Delta Lake, Redis, Azure Data Lake Infra & Ops: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable skills/knowledge/… Experience deploying models as APIs (FastAPI, Azure Functions). Understanding of monitoring, model performance tracking, and observability best practices. Familiarity with orchestration tools like Airflow or Azure Data Factory. ...

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group ...

delivering advanced data solutions that support the future data strategy of the organisation. You will harness modern technologies including Data Vault, Snowflake, DBT, Airflow and AWS/Azure to shape scalable, future-proof data architectures. In this role, you will be responsible for defining, owning and governing data models … translate business requirements into effective data architecture solutions. Experience working with or supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor ...

Gateway, and Kinesis. Integrating third-party APIs into the data platform and transforming data for CRM delivery. Migrating R-based data streams into modern Airflow-managed Python/DBT pipelines. Ensuring observability and reliability using CloudWatch and automated monitoring. Supporting both BAU and new feature development within the data … services including Lambda, API Gateway, S3, Kinesis, and CloudWatch. Strong programming ability in Python and data transformation skills using SQL and DBT. Experience with Airflow for orchestration and scheduling. Familiarity with third-party API integration and scalable data delivery methods. Excellent communication and the ability to work ...

training, validation, deployment, and monitoring of models. Support scalable ML solutions across use cases like recommendations, forecasting, and automation. Work with tools like Airflow, Azure ML, and FastAPI to deliver production-ready systems. Automate model deployment workflows using CI/CD tools (e.g. GitHub Actions, Azure DevOps). Contribute … code (Terraform). Collaborative team player with excellent communication skills. Technical Stack: Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: MLflow, Azure ML, Airflow, Docker, Fargate, FastAPI Data: Snowflake, Delta Lake, Redis, Azure Data Lake Infra & Ops: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable skills/ ...

Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Experience with IaC deployment of AKS/EKS/GKE architecture Experience with enterprise Data Lake environments using ...

We're looking for an experienced Analytics Engineer to help shape our data foundations and deliver high quality, trusted insights across the business. You'll design and maintain scalable analytics models, ensure data quality, and ...

Senior Data Engineer AI SaaS | Data as a Product | London (Hybrid) This is a brilliant opportunity for someone who loves solving problems at the intersection of data and product and wants real ownership in a ...

Technology, Engineering, or associated discipline Experience working with advanced ETL data workflows including technologies such as AWS EMR, Azure Synapse, Azure Data Factory, or Apache Hive/Spark/Airflow Supervisory experience Experience with IaC deployment of AKS/EKS/GKE architecture is highly desired Experience with ...

Uses Python day-to-day Has operated BigQuery at scale, and understands how queries behave across hundreds of terabytes Has built production systems with Airflow/Composer, DBT, Terraform and Docker Is comfortable with GKE, Cloud Run or Cloud Functions Has worked with streaming systems built on Dataflow/… Apache Beam Can work closely with non-technical stakeholders and shape solutions rather than just execute tickets Why join? Clear progression path - report directly into CTO with a clear route to a leadership position An opportunity to take ownership of the data platform Be part of a highly motivated ...

Uses Python day-to-day Has operated BigQuery at scale , and understands how queries behave across hundreds of terabytes Has built production systems with Airflow/Composer , DBT , Terraform and Docker Is comfortable with GKE , Cloud Run or Cloud Functions Has worked with streaming systems built on Dataflow/… Apache Beam Can work closely with non-technical stakeholders and shape solutions rather than just execute tickets Why join? Clear progression path - report directly into CTO with a clear route to a leadership position An opportunity to take ownership of the data platform Be part of a highly motivated ...

security. Drive modernisation by transitioning from legacy systems to a lean, scalable platform. Act as a lead expert for technologies such as AWS, DBT, Airflow, and Databricks. Establish best practices for data modelling, ingestion, storage, streaming, and APIs. Governance & Standards Ensure all technical decisions are well-justified, documented … engineering, including data ingestion, transformation, and storage. Significant hands-on experience with AWS and its data services. Expert-level skills in SQL, Python, DBT, Airflow and Redshift. Confidence in coding, scripting, configuring, versioning, debugging, testing, and deploying. Ability to guide and mentor others in technical best practices. A product ...

The Vacancy 28-35hrs per week- open to discuss flexible working of these hours Location Remote with some attendance at our London office in Shoreditch The ASA is the UK s regulator of advertising ...

value and accelerate data maturity. • Manage delivery across engineering, data science, and external vendors, ensuring deadlines and quality standards are met. • Oversee ingestion pipelines (Airflow, DBT, Glue) into AWS S3 and Redshift, ensuring reliability, scalability, and compliance. • Enable Insights, Marketing, and Commercial teams through dashboards, APIs, and curated datasets. … Manager or Data Product Owner within analytics, data platforms, or customer data domains. • Hands-on familiarity with AWS technologies (S3, Redshift) and orchestration tools (Airflow, DBT, Glue). • Strong understanding of data modelling, identity resolution, and data activation use cases. • Ability to translate business needs into clear technical requirements ...

Requires a Bachelors degree or foreign equivalent degree in Computer Science, Information Systems, Data Analytics, or a related quantitative field and two (2) years of experience in a data analytics related occupation. Experience or education ...

Cloud Infrastructure Engineer– Azure & Data Platforms Are you ready to shape the future of cloud infrastructure? We’re looking for a Cloud Infrastructure Engineer with 2–3 years of experience to design and manage a ...

Cloud Infrastructure Engineer– Azure & Data Platforms Are you ready to shape the future of cloud infrastructure? We're looking for a Cloud Infrastructure Engineer with 2–3 years of experience to design and manage a ...

than headcount substitution, aligning with Outside IR35 status . Key responsibilities include: Designing, building, and delivering data pipelines and orchestration workflows using Prefect or Airflow Developing Python-based services and APIs for data ingestion and enrichment Building and deploying containerised workloads using Docker and Kubernetes (or Swarm) Managing dependencies … UKSV DV clearance (minimum 12 months remaining) Strong Python development experience in secure or restricted environments Proven delivery of data pipelines using Prefect or Airflow Hands-on experience with Docker, Kubernetes , and container orchestration Experience operating in air-gapped systems , managing builds without external connectivity Strong understanding of data ...

Senior DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience ...

DataEngineer-RemoteWorking LynxarecurrentlyworkingwithalargeITconsultancytohelpthemsourceaDataEngineer.OurclientislargeglobalConsultancywhoworkwithenterpriseclients,solvingtheirbusinessandtechnologyproblemsusingcuttingedgesolutions. Asa DataEngineer ,youwillplayakeyroleindesigning,building,andmaintainingrobustdataplatformsandpipelines.Youllworkalongsidedatascientists,analysts,andengineerstoensurereliable,scalable,andhigh-qualitydatasolutions. Whatyoullbedoing: Designingandbuildingdatapipelines,models,andarchitectures DevelopingandmaintainingETL/ELTprocessesusingmoderntools Implementingdatastoragesolutionsacrossrelational,non-relational,andcloudplatforms Ensuringdataquality,reliability,andoperationalexcellence Leadingthedesignanddeliveryofnewdataproductsandpipelines Collaboratingcloselywithstakeholdersandtechnicalteams Providingtechnicalleadershipandmentoringwithindeliveryteams Whattherelookingfor: Strongexperienceindataengineeringroles Provenleadershiporlinemanagementexperience Hands ...