Senior Data Engineer - Azure

Senior Data Engineer – Azure

** 5 days a week onsite - Central London **

£70,000 - £80,000 per annum

About the Role

One of the UK’s leading insurers are looking for a Senior Data Engineer with a primary focus on Azure to lead the design and implementation of scalable, enterprise-grade data solutions. This role will play a key part in building real-time and ETL/ELT data pipelines, maintaining and optimising our data warehouse, and delivering advanced analytics through Power BI.

You will also contribute to innovative AI-driven solutions, including the development of AI agents for post-sales call auditing, leveraging OpenAI’s APIs.

This is a stand-alone, hands-on role based onsite in Central London , working closely with cross-functional teams to drive data and AI initiatives that directly support business outcomes.

Key Responsibilities

• Design and implement scalable, robust real-time data pipelines integrating diverse data sources (APIs, databases, flat files).
• Build, maintain, and optimise a high-performance data warehouse to support reporting, analytics, and AI workloads.
• Develop interactive Power BI dashboards and reports for business stakeholders.
• Design and implement data integration and transformation using Azure Data Factory, Logic Apps, and Azure Functions.
• Use Python and SQL for data wrangling, transformation, and large-scale data analysis.
• Leverage OpenAI APIs to build AI/ML-driven solutions for natural language processing, data enrichment, automation, and post-sales call auditing.
• Collaborate with product managers, analysts, and data scientists to align data strategy with business objectives.
• Monitor and optimise pipeline performance, ensuring data quality, reliability, and consistency.
• Implement best practices for data governance, security, and compliance.

Required Experience & Skills

• Proven experience as a Data Engineer or Data Architect
• Proven experience designing and maintaining ETL/ELT pipelines in complex data environments
• Strong Python skills for scripting, automation, and data processing
• Advanced SQL skills across relational and cloud-based data platforms
• Hands-on experience with Azure services, including: Data Factory, Logic Apps, Azure Functions, Azure Synapse and/or Azure Data Lake
• Strong experience with Power BI, including data modelling and dashboard development
• Experience working with OpenAI APIs or similar AI/ML services
• Solid understanding of data warehousing architectures and best practices
• Excellent analytical, problem-solving, and communication skills

Nice to Have

• Experience with DevOps and CI/CD pipelines.
• Familiarity with cloud-native data platforms such as Databricks or Microsoft Fabric.
• Understanding of data privacy regulations (e.g. GDPR) and secure data handling practices.

If you’re looking for a Data Engineering position that will allow you to take ownership with the opportunity for further long term growth then APPLY NOW!