Principal Data Engineer FTC
Job summary
The Information and Digital Departments at Chelsea and Westminster are a cutting edge working environment, looking to further utilise modern technologies and methods.
The post-holder will be expected to work closely with all members of the digital team, data engineering team, and other key stakeholders, providing dynamic and creative support within the teams, as well as, for the wider organisation. This is an exciting opportunity to become involved with an evolving team, utilising cloud technology platforms and modern development tools.
The post-holder will serve as a senior member of the Digital, Information and data Warehousing departments, taking responsibility for designing, building, maintaining and optimising data infrastructures, creating pipelines which collate data from multiple sources and making it available for analysis by other stakeholders
Main duties of the job
o To contribute towards continual improvements to the Trust's Azure based Data engineering environment
o Contribute towards aspects of Data engineering solution designs, SQL code, and the overall cloud architecture of the warehouse
o To develop specialist datasets and oversee the data management and availability of clean and relevant datasets for appropriate teams in a timely and accurate manner.
o To ensure the continuation of the provision of high quality data to be used for reporting and analysis by the departments involved.
o To support with evaluating key business intelligence reports, combining detailed operational awareness with knowledge of data and systems.
o To lead, when required, on the technical design, maintenance and development of special datasets based on specifications agreed with the departments.
To engage with clinical and non-clinical stakeholders to map and improve data flows and quality.
o To lead on the communication of complex technical specifications and intelligence reports to Trust senior managers and executives.
o To quality assure key reports/applications before they are published and highlight on exception performance issues to seniors.
About us
Chelsea and Westminster Hospital NHS Foundation Trust is one of England's top-performing and safest trusts. We operate two main acute hospital sites--Chelsea and Westminster Hospital and West Middlesex University Hospital--along with award-winning clinics across North West London.
Our nearly 7,500 staff care for a diverse population of 1.5 million, providing full clinical services, including maternity, A&E, and children's services, plus specialist HIV and sexual health clinics. The Care Quality Commission rates us 'Good' in safety, effectiveness, care, and responsiveness, and 'Outstanding' in leadership and resource use.
We continually invest in our facilities, including a £30m expansion of critical care at Chelsea and Westminster and an £80m Ambulatory Diagnostic Centre at West Middlesex.
We welcome applications for flexible working arrangements, accommodating requests where possible to support our staff and patient needs.
The Trust is committed to equality and welcomes applications from all, regardless of background. Adjustments can be made for disabled candidates. Early application is advised as vacancies may close once sufficient applications are received. If you haven't heard from us within three weeks of the closing date, your application was likely unsuccessful. Employment is subject to a six-month probationary period.
Some roles may require weekend shifts at multiple sites.
Job description
Job responsibilities
In addition to the duties listed in the Key Responsibilities section, the post holder would be expected to do the following;
Data Engineering TasksMaintain and improve data infrastructures and propagate product knowledge bases
Contribute towards enriching documentation of database architecture and standards for administration including conventions for naming tables and columns
Translate business data requirements into logical and physical data models, applying the concepts of proper data modelling and database design and ensuring a strong understanding of source data to ensure the design approach results in a logical and efficient data model to support the Trusts Information reporting capabilities
Ensure the data warehouse environment is operating at optimum performance and contribute towards regular review of data architecture, performance and efficiency of underlying objects
Work closely with ICT and Information Analysts to ensure the construction and structure of data supports their requirements and conforms to the NHS Data Dictionary Standards and Information Standard Notices
Deliver tasks vital to Digital, Information and Performance teams per Trust priorities
Meet with external and internal stakeholders to evaluate requirements and organise implementation solutions and support Trust requirements
To bring together through various reporting methodologies, the individual strands of External and Internal reporting for the two departments through making appropriate datasets available.
To be responsible for dataset creation for complex clinical outcome benchmark models commissioned by the departments.
To follow the Information Team strategy of using Azure SQL/DataBricks/Palantir Foundry to return datasets from the Trusts Data Warehouse and support in the use of applications to disseminate the results to the Trust
Communication and RelationshipsTo receive, analyse and communicate a wide range of highly complex technical information to colleagues, including junior analysts and peers, where cooperation and comprehension is fundamentally necessary.
To liaise with clinical and management leads to ensure there is regular provision of relevant information to support key work streams
To promote the corporate Patient Administration System (Cerner) as the principal source for data entry and analysis, working to improve data quality in conjunction with the related teams for data quality.
To work with Digital team and Information team to understand how to make best use of the analyst resource, coordinating pan organisation information processes and taking lead for delivery of strategic analysis and monitoring of compliance against Trust Performance Assurance Framework.
To liaise with relevant staff within the Trust such as the Clinical Coding Team, Divisional Operational Colleagues and Information/Data Warehouse teams to ensure that data is reliably reportable in an accurate, complete, consistent and timely manner.
Work closely with, and influence, key executive members across the Trust, including Divisional Directors, Director of Finance and Director of Strategy.
Knowledge, Training and ExperienceTo use a highly developed specialist knowledge of NHS Data and Acute Informatics effectively within the Trust to stimulate an advancement of a research and business intelligence culture.
To have a highly developed knowledge of systems used within the teams (e.g. SQL) and be adaptable and able to learn about other system used by the trust, and to be able to extract data from them, transform, cleanse and analyse it.
To provide guidance on data items catalogued in the NHS data dictionary.
To apply knowledge from previous projects and to identify risks and benefits to system changes.
Planning and Organisational SkillsTo plan and organise strategic projects, creating datasets and using/supporting use of Trusts main business intelligence and analysis tools.
Understanding the detail of complex requests for the provision of data/information from a variety of sources internal and external to the Trust, scoping and planning of requests. This will include on-going dialogue with the data/information requestor on the fine detail of the request
To respond to and prioritise ad-hoc requests for information, ensuring that information supplied is relevant, insightful and in an accurate, complete and timely fashion.
To support the managers in ensuring that procedures carried out are correctly documented and maintained in a transparent manner for all routine datasets, reports and investigating and performing a Root Cause Analysis into data processing issues that arise.
Other ResponsibilitiesTo support the development and appropriate usage of Trust wide clinical information systems, including integration and full reconciliation with corporate systems.
Line management, mentoring and support to more junior members of the team
To attend regular relevant meetings as and when required
Maintains and protects patient confidentiality at all times and in accordance with the Data Protection Act and relevant Trust policies.
Provides training and guidance to other members of the team with regards to systems, standards and reporting.
To carry out any other duties as requested by the General Manager for Digital or Head of Information.
Person Specification
Education and Qualifications
- Educated to Master levels (or equivalent experience) in a computer science, data engineering or related subject
- Evidence of continuing professional development
Experience
- Experience of requirements gathering for complex requests around specialist data & datasets creation
- Experience of leading and delivering complex change and strategy development programmes in a politically sensitive and complex environment
- Ability to present complex technical ideas/solutions to non-technical audiences
- Significant SQL scripting Experience (creating / administrating stored procedures, scripts, functions, and other objects)
- Experience in working with databases, understanding of relational database design and experience in dimensional Data-modelling
- Experience in the manipulation, transformation, and exploration of large multi-dimensional datasets
- Knowledge and experience of Azure Data Factory creating and deploying pipelines
- Knowledge and experience of Cloud Services (Azure Data Services)
- Python,/Pyspark development experience or use of other programming languages
Skills and knowledge
- Knowledge of information management gained through senior management experience
- Understanding of role of NHS data standards, policies and data definitions
- Ability to communicate clearly and concisely, both written and oral, at all levels, both within the trust and with external stakeholders
- Extensive knowledge of staff management gained through senior management experience and/or qualification
- Proven track record of working under pressure to strict deadlines
- Strong Project Management & MS Excel Skills
- Data engineering and reporting experience, including Azure SQL & DataBricks
- Understanding of the Software Development Lifecycle and version control processes
- Knowledge of data modelling and data architecture techniques
- Highly data rational with the ability to use quantitative and qualitative information to stimulate improvement and provide assurance on data integrity
- Experience and knowledge of data science techniques and statistics, including use of Python/R
- Experienced building reports and dashboards on Qlik, Palantir or similar
Personal Qualities
- Excellent stakeholder management and interpersonal skills
- Intellectually flexible and creative, challenging current ways of working to produce innovative service plans
- Highly developed negotiation and influencing skills
- Ability to manage and self-organise while dealing with multiple competing priorities
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Employer details
Employer name
Chelsea and Westminster Hospital NHS Foundation Trust
Address
Harbour Yard
Chelsea Harbour
London
SW10 0XD
Employer's website
https://www.chelwest.nhs.uk/