Senior Data Engineer
Job Title: Senior Data Engineer
Summary:
The Senior Data Engineer will play a key role in designing, developing, and delivering high-quality, reliable data solutions that support the organisation's strategic data initiatives. This role requires deep technical expertise in modern data engineering practices, strong analytical and problem-solving abilities, and the capability to collaborate effectively with cross-functional teams.
Key Responsibilities
- Design, build, and optimise scalable data pipelines and workflows.
- Develop and maintain data models and data warehouse structures to support analytical and operational needs.
- Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver robust data solutions.
- Troubleshoot data discrepancies, performance issues, and system errors.
- Ensure compliance with data security, governance, and regulatory standards.
- Support and enhance existing data engineering processes and platforms.
Essential Skills & Knowledge
SQL Server Proficiency:
- Strong expertise in Microsoft SQL Server and SQL.
- Skilled in querying, performance tuning, and database optimisation.
Data Warehousing & Modelling:
- In-depth understanding of data warehousing principles and modelling concepts.
- Experience with designing efficient schemas, including normalisation and denormalisation techniques.
ETL / ELT Pipelines:
- Proven experience building and maintaining ETL/ELT processes.
- Ability to extract data from diverse sources, transform it effectively, and load it into data warehouse environments.
Problem-Solving:
- Strong analytical skills to diagnose data issues, resolve performance challenges, and support user queries.
Security Awareness:
- Good understanding of data security best practices and compliance frameworks (e.g., GDPR).
- Experience working with sensitive corporate data.
Industry Knowledge:
- Experience within the insurance industry is required.
Technologies & Tools
- Snowflake Data Cloud and related technologies (e.g., Fivetran, DBT, Dataiku, Collibra preferred).
- Microsoft Azure, including Azure Synapse and Azure DevOps.
- Microsoft SQL Server tools, including Master Data Services, SSIS, SSAS, and SSRS.
- Programming experience with Python and C#.
- Microsoft Power BI for data visualisation.
- Microsoft Office 365.