Remote Apache Airflow Jobs in Leeds

2 of 2 Remote Apache Airflow Jobs in Leeds

Lead Data Engineer

Leeds, West Yorkshire, England, United Kingdom
Hybrid / WFH Options
Robert Walters
services (e.g., S3, Glue, Lambda, Redshift, Athena, EMR). Experience designing and building data lakes and modern data platforms. Proficiency with Python, SQL, and data pipeline orchestration tools (e.g., Airflow, dbt). Strong understanding of data modelling, ETL/ELT processes, and distributed systems. Knowledge of data security, governance, and compliance best practices. Excellent leadership, communication, and stakeholder engagement More ❯
Employment Type: Full-Time
Salary: £80,000 - £90,000 per annum
Posted:

Senior Data Engineer (Data Governance, Databricks, PySpark)

Leeds, Yorkshire, United Kingdom
Hybrid / WFH Options
PEXA Group Limited
end data quality, from raw ingested data to business-ready datasets Optimise PySpark-based data transformation logic for performance and reliability Build scalable and maintainable pipelines in Databricks and Airflow Implement and uphold GDPR-compliant processes around PII data Collaborate with stakeholders to define what "business-ready" means, and confidently sign off datasets as fit for consumption Put testing … internal and external customers Skills & Experience Required Extensive hands-on experience with PySpark, including performance optimisation Deep working knowledge of Databricks (development, architecture, and operations) Proven experience working with Airflow for orchestration Proven track record in managing and securing PII data, with GDPR compliance in mind Experience in data governance processes; Alation experience preferred, but similar toolswelcome Strong SQL More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:
Apache Airflow
Leeds
25th Percentile
£65,000
Median
£67,500
75th Percentile
£72,500
90th Percentile
£74,000