Senior Data Engineer
Senior Data Engineer
As a Senior Data Integration Engineer, you will work closely with the Data and Analytics Team, and other stakeholders across the business to ensure seamless data accessibility and usage across the organisation.
Role
- Design, develop, and maintain scalable, robust data integrations using Azure Logic Apps, Azure Storage Accounts Azure API Management, Microsoft Fabric, and other Azure Services.
- Implement integration patterns such as event-driven workflows, API-based integrations, and scheduled orchestrations.
- Ensure high availability, scalability, and security of integration workflows.
- Collaborate with IT, and system users to understand business requirements and ensure data accessibility and integrity.
- Monitor integration solutions, troubleshoot failures, and proactively improve reliability.
- Lead continuous improvement initiatives, driving adoption of best practices and emerging Azure integration technologies.
- Support DevOps processes using Azure DevOps for CI/CD automation, version control, and deployment of Azure resources.
- Provides technical guidance and mentoring to junior team members to support their development and uphold best engineering standards.
- Ensure data security and compliance with industry standards and regulations, such as GDPR.
- Document data processes and workflows for both technical and non-technical audiences.
The Person
- Bachelor’s or Master’s degree in Computer Science, Information Technology, Data Science, Engineering, or a related field.
- 5+ years of experience in data integration, automation, or data engineering roles.
- 3+ years hands-on experience using Azure Logic Apps (essential), but Power Automate experience will be considered.
- Strong experience working with Azure Services such as Storage Accounts, Key Vault, Azure Functions, API Management.
- Experience of developing Analytics solutions using Microsoft Fabric or comparable Azure PaaS services, Azure Data Factory, Synapse etc.
- Experience building and deploying Azure solutions using Azure DevOps pipelines and ARM/Bicep/Terraform templates.
- Proficiency with REST APIs, authentication methods (OAuth, Managed Identities), and system-to-system integration patterns.
- Knowledge of data modelling techniques and best practices.
- Proven record of mentoring and working closely with junior members of a team, with desire to take on future line management responsibilities.
- Experience of using Purview and Power BI is also Desirable, but not essential.
- Desirable certifications, DP-203 Azure Data Engineer, DP-203 Azure Data Engineer, DP-600 Fabric Analytics Engineer Associate, AZ-900 Azure Fundamentals and DP-900 Azure Data Fundamentals.
- Strong problem-solving skills with attention to detail and the ability to troubleshoot complex data issues.
- Excellent communication and collaboration skills, able to work across teams to deliver solutions that meet business needs.