2 of 2 Part-Time Delta Lake Jobs in the UK

your skills in analytics engineering, responding to business and project needs rather than operating as a narrow silo. You'll work hands-on with Azure Databricks, Azure Data Factory, Delta Lake, and Power BI to design scalable data pipelines, implement efficient data models, and ensure high-quality data delivery. This is a fantastic opportunity to join a newly … solutions for the business. In addition, you'll be responsible for the following: Designing, developing, and optimizing end-to-end data pipelines (batch & streaming) using Azure Databricks, Spark, and Delta Lake. Implementing Medallion Architecture and building scalable ETL/ELT processes with Azure Data Factory and PySpark. Partner with the data architecture function to support data governance, using tools … Working collaboratively with analysts to validate and refine datasets for reporting. Apply DevOps & CI/CD best practices (Git, Azure DevOps) for automated testing and deployment. Optimize Spark jobs, Delta Lake tables, and SQL queries for performance and cost efficiency. Troubleshoot and resolve data pipeline issues proactively. Partner with Data Architects, Analysts, and Business Teams to deliver end More ❯

using Azure Data Factory, Databricks (Python/PySpark), and advanced SQL. Productionise Databricks: Lead the development of robust, scalable solutions on Databricks. This is role focused on production code, Delta Lake, Structured Streaming, and Spark performance tuningnot just ad-hoc notebooks. Champion DataOps & CI/CD: Implement and manage CI/CD processes for data pipelines using Azure More ❯