6 of 6 Permanent Apache Airflow Jobs in Manchester

model on hybrid/on-prem environments. Hard Skills Experience in data engineering, ideally aerospace/defence or industrial sectors. ETL/ELT tools (Airflow, Azure, Microsoft SSIS), streaming (Spark, Kafka). Strong Python and SQL; C++, C#, or MATLAB a plus. Databases: PostgreSQL, SQL Server, Oracle, Snowflake, Iceberg ...

with a strong focus on ETL/ELT. • Advanced SQL and Python development skills. • Hands-on experience with DBT, GIT, Terraform, Docker, IAM, and Airflow (Composer). • Proven experience working on cloud platforms – ideally GCP (BigQuery), but Azure or AWS also considered. • Strong understanding of Data Mesh, Test Driven ...

warehousing concepts Exposure to data transformation tools such as DBT is beneficial Basic knowledge of Python, ideally in the context of orchestration tools like Airflow Confident communication skills and the ability to work effectively in a remote team A proactive approach with the ability to take ownership and solve ...

necessary infrastructure, resources, and interfaces to enable data loading and LLM workflows. Use Python/Java and large-scale data workflow orchestration platforms e.g. Airflow to construct software artifacts for ETL, interfacing with diverse data formats and storage technologies, and incorporate them into robust data workflows and dynamic systems ...

restricted/high‐side environments Python for automation and data processing Data platform and pipeline engineering experience Familiarity with orchestration tooling such as Airflow Understanding of MLOps practices and ML delivery workflows Additional Responsibilities Provide technical assurance, design review, and architecture support Define practical engineering standards and ways ...

distributed processing frameworks such as Spark or Databricks Build and optimise data workflows across cloud platforms (AWS, Azure, GCP) Implement orchestration frameworks such as Airflow Test, troubleshoot, and improve data products to ensure reliability and quality Collaborate with engineering teams to deliver robust, maintainable systems Key Requirements: Experience building … Experience working with at least some of: Distributed computing frameworks (e.g. Spark, Databricks) Cloud platforms (AWS, Azure, or GCP) Workflow orchestration tools (e.g. Airflow) Strong understanding of data system reliability, testing, and performance Experience troubleshooting and improving production data systems Strong problem-solving skills and attention to detail Ability ...