Data Engineer
Data Engineer | £450-£500p/day (Inside IR35) | London (Hybrid, 1-2 days per week on site) | Energy/highly regulated environments | Azure/Microsoft Fabric
Our client is looking for an experienced Data Engineer to support the ongoing maintenance, enhancement and development of their operational data platform within a highly regulated Energy from Waste (EfW) environment.
We're looking for someone who will manage and improve the flow of operational, plant and asset data from on-premises systems into the Microsoft Azure ecosystem enabling effective reporting and compliance.
The role is split roughly 60% business-as-usual (platform maintenance, support and enhancement) and 40% strategic projects.
Key Responsibilities:
- Design, maintain and optimise data pipelines that ingest data from operational and business systems into Azure and Microsoft Fabric
- Support the ongoing operation and enhancement of Azure-based data platforms, including Azure Synapse Analytics, Azure Storage and Logic Apps
- Manage and improve ingestion of operational plant data, including weighbridge systems, asset monitoring systems and real-time data feeds
- Support the development and maintenance of data warehousing and lakehouse solutions within Microsoft Fabric
- Configure and support access controls, security groups and user permissions in Microsoft Fabric and Microsoft Entra ID
Essential Skills & Experience:
- Strong Python development skills
- Experience integrating data from on-premises SQL Server environments into cloud platforms
- Good understanding of APIs, system integrations and data exchange mechanisms
Proven experience with Microsoft Azure data technologies, including:
- Azure Synapse Analytics
- Azure Storage
- Azure Logic Apps
- Azure data integration services
Strong experience with Microsoft Fabric, including:
- Data warehousing
- Lakehouse architecture
- Data pipelines
- Security and access management
If this sounds like a good fit, apply now!
Data Engineer | £450-£500p/day (Inside IR35) | London (Hybrid, 1-2 days per week on site) | Energy/highly regulated environments | Azure/Microsoft Fabric
Oscar Associates (UK) Limited is acting as an Employment Business in relation to this vacancy.
To understand more about what we do with your data please review our privacy policy in the privacy section of the Oscar website.