Data Engineer
Data Engineer | £60-75K | London (5 days p/w Onsite)
Build a greenfield data platform from scratch!
A major logistics company is undergoing a massive digital transformation. Legacy systems are being dismantled, replaced with a clean, cloud-native Azure stack - and the new data team is central to making it all work.
You'll be working directly with their Head of Data, building Azure-based pipelines from the ground up, and shaping how the company uses data to drive decisions. There's real investment, real urgency, and real interest in doing this properly - not endless meetings and PowerPoints.
What you'll be doing:
- Designing, building, and optimising end-to-end data pipelines using Azure Databricks, PySpark, ADF, and Delta Lake
- Implementing a medallion architecture - from raw to enriched to curated
- Working with Delta Lake and Spark for both batch and streaming data
- Collaborating with analysts to validate and refine datasets for reporting
- Applying CI/CD and DevOps best practices (Git, Azure DevOps)
- Enforcing data governance using Azure Purview and Unity Catalog
- Optimising Spark jobs and SQL queries for performance and cost efficiency
- Exploring emerging tech like Kafka/Event Hubs and Knowledge Graphs
What they're looking for:
- A strong communicator - someone who can build relationships across technical and business teams
- Hands-on experience building pipelines in Azure using Databricks, ADF, and PySpark
- Strong SQL and Python skills
- Understanding of medallion architecture and data lakehouse concepts
- Bonus points if you've worked with Power BI, Azure Purview, or streaming tools
- You're versatile - happy to collaborate with architects, analysts, and business stakeholders
- Proactive problem-solver who can troubleshoot and optimise data pipelines
Why now?
- Help build a greenfield platform with a modern Azure stack
- Real business impact - maritime logistics, supply chain operations
- A rare opportunity to shape something properly, from the ground up
- Work with cutting-edge cloud technologies and emerging data tools
Apply here to register your interest!
McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds.
- Company
- McGregor Boyall
- Location
- London, South East, England, United Kingdom
- Employment Type
- Full-Time
- Salary
- £65,000 - £75,000 per annum
- Posted
- Company
- McGregor Boyall
- Location
- London, South East, England, United Kingdom
- Employment Type
- Full-Time
- Salary
- £65,000 - £75,000 per annum
- Posted