BI Engineer
Job summary
The BI & Data Engineer will work alongside the BI Lead to develop, maintain and support Greenwich Health's Business Intelligence, reporting and data infrastructure. The role is intended to provide significant overlap with the BI Lead's core technical and reporting responsibilities, improving resilience and reducing dependency on a single individual, while bringing additional expertise in data engineering, automation and software development practices. The post holder will be expected to independently manage areas of the BI environment, troubleshoot data and reporting issues, develop new solutions and contribute to the ongoing improvement of the organisation's data infrastructure.
Main duties of the job
Undertake any other work appropriate to the level and general nature of the post.
Maintain professional knowledge and remain aware of developments in Business Intelligence, data engineering, cloud technology and NHS information requirements.
Participate in relevant training and continuing professional development.
Work flexibly where necessary to support business-critical reporting or data processes.
About us
Greenwich Health is committed to providing quality care to patients whilst building resilience for General Practice and delivering services and programmes of work at scale for the Greenwich population. The post holder will support the organisation's Business Intelligence and data function, ensuring that reliable, secure and timely information is available to support operational management, clinical governance, contractual reporting and strategic decision-making.
Job description
Job responsibilities
Develop, maintain and support SQL databases, data models, queries, stored procedures and reporting datasets.
Develop and maintain Power BI reports, dashboards and semantic models supporting operational, contractual, financial, clinical and governance requirements.
Produce regular and ad-hoc analysis to support senior management, service leads and commissioners, identifying trends, performance issues and opportunities for service improvement.
Develop and maintain automated ETL and data-processing pipelines, including ingestion, transformation, validation and loading of information from clinical and operational systems.
Use Python, SQL and other appropriate technologies to automate repetitive data-processing and reporting activities.
Monitor scheduled data processes, reporting systems and interfaces, investigating and resolving failures or data-quality issues.
Design appropriate validation, reconciliation, logging and alerting processes to improve the reliability and traceability of data pipelines.
Support the development and administration of the organisation's cloud-based data infrastructure, including Azure SQL and associated Microsoft Azure services.
Apply appropriate software development practices including source control, documentation, testing, code review and controlled deployment.
Work with internal and external stakeholders to understand information requirements and translate these into practical technical and reporting solutions.
Support statutory, contractual and commissioner reporting requirements and provide cover for established BI processes where required.
Support clinical governance and audit activity by providing accurate datasets, reports and data-quality assurance.
Identify data-quality problems within source systems and reporting processes and work with relevant teams to develop appropriate solutions.
Maintain clear technical documentation covering data sources, transformations, reporting processes, system dependencies and recovery procedures.
Work collaboratively with the BI Lead on the design and development of the organisation's longer-term data architecture, reporting capability and Business Intelligence strategy.
Support business continuity by developing sufficient knowledge of core BI systems and processes to maintain essential reporting and data services during periods of absence.
Contribute to Information Governance and data-security processes, ensuring that systems and data are handled in accordance with GDPR, confidentiality requirements and organisational policies.
Information Governance
The post holder will provide practical and technical support to the oversight and delivery of Greenwich Health's Information Governance function, working alongside the BI Lead, Caldicott Guardian, Data Protection Officer and Senior Information Risk Owner. The role contributes to maintaining the organisation's Information Governance framework, assurance activity and data-sharing arrangements, rather than solely operating within it.
Support the coordination and annual submission of the Data Security and Protection Toolkit, maintaining the evidence library, tracking assertion evidence and progressing outstanding actions.
Maintain the organisation's Information Governance policy suite, including scheduled review, version control and renewal of data protection, data quality, records management and acceptable-use policies, escalating gaps to the appropriate lead.
Maintain the Information Asset Register and Record of Processing Activities, ensuring new systems, datasets and reporting products are captured and information asset owners identified.
Develop and maintain the organisation's data flow mapping, documenting how data moves between Greenwich Health, member practices, Primary Care Networks, commissioners and third-party suppliers.
Support the drafting, review and ongoing management of Data Sharing Agreements, Data Processing Agreements and information-sharing protocols with practices, NHS partners and external suppliers.
Maintain a register of data-sharing arrangements and processor contracts, tracking lawful bases, review dates and expiry, and prompting renewal where required.
Support the completion of Data Protection Impact Assessments for new systems, datasets, integrations and reporting products, providing the technical detail on data flows, storage, access and security controls.
Support supplier and system assurance activity, including review of third-party security documentation, DSP Toolkit status and technical controls during onboarding and contract review.
Provide technical evidence and assurance to support Information Governance audits, internal reviews, commissioner information requests and external inspection.
Support the administration and periodic review of access controls and permissions across BI and data systems, producing access reports for Information Governance oversight.
Support the handling of Subject Access Requests, Freedom of Information requests and other information-rights requests by extracting, collating and quality-assuring the relevant data.
Support the investigation and technical root-cause analysis of information-governance incidents, near misses and suspected breaches, and contribute to remedial action plans.
Produce data and reporting to support Information Governance monitoring and oversight, including training compliance, incident trends and data-quality metrics for the relevant governance group.
Contribute to Information Governance papers, reporting and agenda items for the relevant governance or assurance group, and support the implementation of agreed actions.
Communication and Relationship Skills
- Demonstrate excellent communication skills when working with the internal team as well as external partners
- Be able to identify and take into consideration barriers to understanding and employ appropriate methods to ensure effective communication
- Provide emotional support to patients, carers and colleagues as appropriate.
- Be aware of the procedures to follow if concerned regarding the protection of children.
- Ensure compliance with policies, procedures and clinical guidelines for self and others.
- Hold good relationship building skills to develop strong relationships with key individuals
Responsibilities for HR
- Maintain active status on relevant professional registers.
- Act always in accordance with professional code of conduct and guiding documents, Health Care Standards.
- Maintain a professional portfolio.
- To take responsibility for own continuous self-development, undertaking any education and training opportunities identified as necessary for role to remain eligible for professional registration including mandatory training.
- Adhere to Company Policy & Procedure.
- Assist managers in the development of strategies for professional development in keeping with staff competence appraisal, service developments and professional requirements.
-
Research and Development
- Takes responsibility for own continuing professional development and performance, including identifying own development needs and maintain own portfolio in accordance with requirements.
- Maintain a high level of awareness of relevant research issues and trends within the scope of practice and professional area.
- Take responsibility for personal development and education and Personal Development Plan objectives.
Attend all mandatory training relevant for the post.
- Attend and actively participate in an annual personal development review and undertake relevant activities to meet the training and development objectives as identified in the performance review.
Person Specification
Experience
- Significant practical experience working in Business Intelligence, data analytics, data engineering or a closely related role.
- Strong SQL skills and experience developing and maintaining relational databases, queries and data transformations.
- Experience developing dashboards and analytical reporting using Power BI or a comparable Business Intelligence platform.
- Experience designing, developing and maintaining ETL or automated data-processing workflows.
- Experience using Python or another programming/scripting language for data processing, automation or integration.
- Strong understanding of data modelling, data quality, validation and reconciliation.
- Ability to investigate complex data or system issues and independently identify practical solutions.
- Experience producing accurate management information and translating data into clear findings for non-technical stakeholders.
- Ability to document technical systems and processes clearly enough to enable support and maintenance by other team members.
- Understanding of data protection, confidentiality and secure handling of sensitive information.
- Experience of working on Information Governance elements as outlined in the JD.
- Experience working with Microsoft Azure, particularly Azure SQL and related data services.
- Experience with Git, source control, automated testing, CI/CD or other modern software-development practices.
- Experience developing or consuming APIs, SFTP interfaces or other system integrations.
- Experience implementing monitoring, logging and automated alerting for production data processes.
- Experience working with NHS or healthcare information.
- Understanding of NHS datasets, clinical systems, commissioner reporting or healthcare performance monitoring.
- Knowledge of Information Governance requirements including GDPR, DSP Toolkit and Caldicott principles.
Qualifications
- Degree-level education in Data Science, Computer Science, Information Systems, Mathematics, Statistics or a related discipline, or equivalent relevant professional experience.
- Evidence of continued professional development within Business Intelligence, analytics, data engineering or software development.
- Relevant Microsoft, Azure, Power BI, SQL or data-engineering certification.
- BCS, PRINCE2, Agile, ITIL or similar professional/project/service-management qualification.
Personal Skills
- Able to work independently and take ownership of technical systems, reporting processes and deliverables.
- Strong analytical and problem-solving ability.
- Able to manage competing priorities and deliver work to agreed deadlines.
- Methodical approach with strong attention to data accuracy and quality.
- Comfortable working collaboratively within a small team where responsibilities overlap and knowledge sharing is essential.
- Willingness to learn unfamiliar systems, datasets and healthcare processes.
- Able to maintain confidentiality and exercise appropriate judgement when handling sensitive information.
Communication Skills
- Ability to communicate technical and analytical information clearly to both technical and non-technical audiences.
- Strong written communication and report-writing skills.
- Ability to work effectively with senior managers, clinicians, operational teams, commissioners and external suppliers.
- Ability to understand stakeholder requirements and translate them into appropriate technical solutions.
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Employer details
Employer name
Greenwich Health Ltd
Address
25 John Wilson Street
London
SE18 6PZ
United Kingdom
Employer's website
https://www.greenwich-health.com/