Senior Data Engineer

Job description

Job responsibilities

Duties and Responsibilities

Data Engineering

• Toassistin the design and implementation of Extract, Transform & Load (ETL) processes to ingest data from multiple sources into central data repositories.

• Support the design and development of data models that are robust, maintainable, and aligned with the organizations IT architecture and standards.

• To specify and develop processes for complex datasets using a wide-ranging technical and analytical skill set.

• To ensure the integrity of the data extracted from Trust transactional systems and held within the data warehouse.

• To ensure records are complete, valid and accurate and adhere to NHS data dictionary definitions.

• Design, code, test and implement efficient and robust database schemas plus SQL Queries, Views, Stored Procedures, and Triggers as part of data warehouse development.

• Provide ongoing source of expertise in database design, development and maintenance of the data environment. Identify, report on and implement new techniques, tools and best practices where they will benefit the organisation.

• To maintain technical, professional and specialist knowledge and understanding and be competent in the use of a wide range of specialist software packages, including, but not limited to Microsoft SQL Server (including MSSQL, Reporting Services, Integration Services, Analytical Services) and Power BI.

• To specify and develop solutions that will automate, schedule and improve upon current processes within the data warehouse function.

• Interpret; analyse; investigate; and resolve complex data warehouse problems and. evaluate and analyse a range of options to implement the most cost-effective solution to prevent reoccurrence of the problems.

• Comfortable in data modelling techniques and tools to design and manage data structures.

• To create and maintain high quality documentation for all data warehouse and data engineering related processes.

• Able to document using approaches such as Entity Relationship diagrams, Data Flow Diagrams or Star Schema Diagrams.

• Develop detailed technical designs, SOPs, and post-incident reports to support continuous improvement.

• Keep documentation up to date to minimise recurrence of issues and support future development.

Analysing and Judgement

Independently exercise sound judgment in complex situations, requiring thorough analysis, and interpretation of patterns and anomalies in data.

Analyse, investigate and resolve complex data queries and data quality issues (e.g. missing data, erroneous data, inaccurate data translation) using in-depth knowledge and advanced analysis skills.

• Diagnose and resolve complex technical issues

Planning and Organising

• Ability to organise, prioritise and manage a complex, highvolume workload, including adjusting plans at short notice to meet shifting priorities across departments. For example, coordinating tasks and data requirements for the delivery of the Trusts PowerBI project. Use proven organisational skills to influence and empower less experienced stakeholders in a project.

• Able to ensure timely, appropriate updates to managers and project managers, highlighting areas of concerns around meeting deadlines.

• Ability to delegate appropriately to ensure the team meets deadlines.

• To inform and make recommendations to support the digital deployment and roll out of project plans.

Reporting

• Supportthedevelopment of business intelligence (BI) reporting systems, ensuring solutions are efficient, scalable, andfuture proof.

• Design and develop systems to support the production of nationally mandated datasets, adhering to relevant standards and timelines.

• Deliver Trust-widedatamodelsthat support operational processes, performance monitoring, and financial reporting, with careful consideration of sensitive data requirements.

• Collaborate withData Analysts across the Trustto define and implement business rules for automated data cleansing, ensuring high-quality datasets that supportaccuratedecision-making and performance monitoring.

• Recommend and implement changes to IM&T practices and procedures in response to evolving reporting requirements oridentifieddata quality concerns.

• Ensure all data models comply with current and emerging national standards, including NHS data definitions and regulatory frameworks.

Stakeholder Collaboration

• Engage with clinical stakeholders, third-party vendors, and technical teams to gather requirements, manage priorities, and deliver solutions that support clinical workflows.

• Liaise with experts in other departments e.g.Performance andAnalyticsteam,andsuppliers of clinical systems to obtain information for further data integration and processing.

• Report regularly on project progress, risks, and outcomes to ensure transparency and alignment across teams.

• Act as a key technical advisor during digital transformation initiatives such as system migrations, upgrades and procurements.

• Communicate complex integration concepts to non-technical stakeholders, fostering shared understanding and trust.

Person Specification

Experience

• Extensive knowledge and experience in data warehousing and data engineering.
• Experience of data modelling techniques and tools to design and manage data structures.
• Experience of working with and manipulating large relational datasets.

Qualifications

• Educated to degree level in Computer Science, data engineering, or a related technical discipline; or equivalent experience working in complex corporate IT operational environments.

• Evidence of continued professional development.

Knowledge

• Proficient in in ETL processes (SSIS), SQL Server and Reporting Services (SSRS, Power BI) and Analytical Service

• Knowledge of Mental Health Services.

Disclosure and Barring Service Check

This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.

Certificate of Sponsorship

Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website.

From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants.

Employer details

Employer name

Hertfordshire Partnership University NHS Foundation Trust

Address

99 Waverley Road

99 Waverley Road

St Albans

AL35TL

United Kingdom

Employer's website

https://www.hpft.nhs.uk/careers/