Lead Azure Data Engineer
Lead Data Engineer (Azure Data Platform)
Inside IR35 Rate: .00 per day
Location: UK Remote
Clearance: Active SC Clearance Required
The Opportunity
We're looking for an experienced Lead Azure Data Engineer to play a key role in delivering a large-scale Azure Data Platform programme. You'll be responsible for designing, building, and optimising modern data solutions that transform data from multiple source systems into trusted, governed, and reusable data products.
This is a hands-on leadership role focused on data platform engineering, data modelling, automation, and the delivery of scalable analytics capabilities that support reporting, decision-making, and future AI initiatives.
Key Responsibilities
- Design, build, and support Azure-based data platform solutions.
- Develop robust data ingestion frameworks and ETL/ELT pipelines.
- Build and maintain Bronze, Silver, and Gold data layers.
- Implement Common Data Models and scalable data warehouse architectures.
- Develop batch and near real-time data pipelines.
- Create reusable engineering patterns, templates, and accelerators.
- Implement CI/CD pipelines and deployment automation.
- Support data quality, governance, lineage, and metadata management.
- Produce technical documentation, runbooks, and knowledge-transfer materials.
- Collaborate with architecture, governance, and delivery teams to ensure successful platform delivery.
Essential Skills & Experience
- Strong experience with:
- Azure Data Factory
- Azure Databricks
- Azure SQL
- Python
- Azure DevOps
- Git
- Expertise in:
- ETL / ELT development
- Data Lakes and Data Warehousing
- Data Modelling
- Performance Tuning
- REST API Integration
- CI/CD Pipelines
- Experience delivering enterprise-scale Azure data solutions.
- Strong understanding of data quality, governance, and engineering best practices.
- Excellent documentation and stakeholder communication skills.
Highly Desirable Skills
- Microsoft Purview
- Semarchy MDM
- Event Hub
- Stream Analytics
- Change Data Capture (CDC)
- Master Data Management (MDM)
- Power BI Data Modelling
What We're Looking For
You'll be a proactive and technically strong data engineer who enjoys building scalable data platforms, driving automation, and solving complex engineering challenges. You'll be comfortable leading technical delivery while remaining hands-on with development and implementation.
If you're an SC-cleared Azure Data Engineer with strong Databricks, Data Factory, Python, and data platform experience, we'd love to hear from you.
If you receive suspicious outreach claiming to be from us, please contact us via the ManpowerGroup website.