Advanced Data Engineer
Job summary
This post is offered on a fixed-term or secondment basis for 12 months (please see note above).
Are you a data engineer with a passion for public service? Then maybe you're looking for us!
Public Health Wales provides integrated health protection services to the people of Wales, through information, advice and taking action to protect people from communicable disease and environmental hazards. Services are delivered through health protection teams, a range of national health protection programmes, the Communicable Disease Surveillance Centre (CDSC), the environmental health protection team and a national network of microbiology/ reference/ specialist laboratory services. CDSC is the epidemiology and surveillance branch of the Health Protection Division.
We are seeking an experienced Advanced Data Engineer to play a key role in delivering multiple high-profile digital transformation programmes, modernising how surveillance data is ingested, processed and made available for public health action. This hands-on role will combine technical delivery, architectural influence and close collaboration with epidemiologists, scientists and informatics specialists.
Main duties of the job
You will join the Engineering, Data Science and Genomic Epidemiology (EDGE) specialty group within CDSC and collaborate with other specialty teams, including:
Healthcare Associated Infection, Antimicrobial Resistance and Prescribing Programme (HARP)
Blood Borne Viruses, Sexual Health, Tuberculosis and Inequalities
Gastrointestinal Infections and Zoonoses
Vaccine Preventable Disease and Respiratory Infection
Field Epidemiology
Setting based surveillance
Environmental surveillance
You will design and build robust, secure and scalable cloud-native data pipelines in Microsoft Azure and Google Cloud Platform (GCP), supporting infectious disease surveillance, analytics and reporting at national scale. A key aspect of the role is translating complex surveillance needs and challenges into well-engineered data products and pipelines, working confidently with both technical and non-technical colleagues.
About us
Public Health Wales is the National Public Health Institute in Wales. Our vision is 'Working to achieve a healthier future for Wales'. We play a pivotal role in driving improvements in population health and well-being, reducing health inequalities, improving healthcare outcomes, protecting the public and supporting the development of health in all policies across Wales.
Never more has public health been so important as we come through the Coronavirus pandemic, face the challenges of the cost-of-living crisis and tackle and prevent the harmful effects of climate change. We are an organisation that places ourselves at the heart of supporting people, communities, partners, and the Welsh Government in addressing these major challenges and providing solutions for action.
Our organisation is guided by our Values, 'Working together, with trust and respect, to make a difference'. We are committed to creating an inclusive workplace that values equality, diversity and inclusion. We welcome applications which represent the rich diversity of the communities we serve and from those wishing to work part time or on a job share basis.
The ability to speak Welsh is desirable for this post; Welsh and/or English speakers are equally welcome.
For guidance on the application process, please visithttps://phw.nhs.wales/working-for-us/applicant-information-and-guidance/
Job description
Job responsibilities
Duties and responsibilities
As an Advanced Data Engineer, you will:
- Design, build and maintain enterprisegrade data pipelines and platforms in Azure and GCP
- Contribute to and shape data architecture, standards and engineering best practice across CDSC
- Develop and maintain core platform components such as:
- Data lakes and warehouses
- ETL / ELT and orchestration frameworks
- Data catalogues and metadata management
- Work closely with epidemiologists and specialty teams to understand surveillance requirements and deliver usable, reliable data assets
- Implement robust ingestion and integration frameworks to ensure data quality, timeliness and consistency
- Ensure platforms meet information governance, security and ethical standards, including GDPR and Cyber Essentials Plus
- Provide technical leadership and guidance to other engineers and informatics staff
Contribute directly to the delivery of strategic digital transformation projects across Public Health Wales
You will be able to find a full Job description and Person Specification attached within the supporting documents or please click Apply now to view in Trac.
Person Specification
Qualifications and/or Knowledge
- Educated to degree level in computer science or related field. Will also consider equivalent work experience.
- Excellent knowledge of programming and scripting languages such as SQL, Python, Java, and Spark.
- Good understanding of data architecture, data modelling, ETL processes, and metadata management concepts.
- Familiarity with cloud platforms (Azure/GCP/AWS) and on premises infrastructure.
- Knowledge of data security, governance, and compliance regulations.
- Knowledge of the technical and legislative environment specific to the NHS in Wales.
- Familiarity with NHS data sets and applications is advantageous.
Experience
- Significant relevant experience working as a data engineer, developer, computer scientist, or similar.
- Proven track record of developing effective data solutions using appropriate technologies.
- Experience with SQL and NoSQL databases and data warehousing concepts.
- Experience using Git, and tools such as GitHub, to version control code and develop collaboratively.
- Experience in Agile software development methodologies.
Aptitude & Ability
- Communicating between the technical and non-technical. You can communicate effectively with technical and non-technical stakeholders. You can support and host discussions within a multidisciplinary team, with potentially difficult dynamics. You can be an advocate for the team externally and can manage differing perspectives. (Skill level: working)
- Data analysis and synthesis. You can undertake data profiling and source system analysis. You can present clear insights to colleagues to support the end use of the data. (Skill level: working)
- Data development process. You can design, build, and test data products that are complex or large scale. You can build teams to complete data integration services. (Skill level: practitioner)
- Data innovation. You can understand the impact on the organisation of emerging trends in data tools, analysis techniques and data usage. (Skill level: working)
- Data integration design. You can select and implement the appropriate technologies to deliver resilient, scalable, and future-proofed data solutions. (Skill level: practitioner)
- Data modelling. You can produce relevant data models across multiple subject areas. You can explain which models to use for which purpose. You can understand industry-recognised data modelling patterns and standards, and when to apply them. You can compare and align different data models. (Skill level: practitioner)
- Metadata management. You can design an appropriate metadata repository and present changes to existing metadata repositories. You can understand a range of tools for storing and working with metadata. You can provide oversight and advice to more inexperienced members of the team. (Skill level: practitioner)
- Problem resolution (data). You can respond to problems in databases, data processes, data products and services as they occur. You can initiate actions, monitor services, and identify trends to resolve problems. You can determine the appropriate remedy and assist with its implementation, and with preventative measures. (Skill level: working)
- Programming and build (data engineering). You can use agreed standards and tools to design, code, test, correct and document moderate-tocomplex programs and scripts from agreed specifications and subsequent iterations. You can collaborate with others to review specifications where appropriate. (Skill level: practitioner)
- Technical understanding. You can understand the core technical concepts related to the role and apply them with guidance. (Skill level: working)
- Testing. You can review requirements and specifications and define test conditions. You can identify issues and risks associated with work. You can analyse and report test activities and results. (Skill level: working)
- A commitment to Welsh and English bilingualism
Values
- Reliable, trustworthy, creative, collaborative, and resilient.
- High-level attention to detail, being well organised, and having the ability to prioritise workload.
- A demonstrated ability to embrace, drive, and lead change.
- Able to lead and direct others to achieve organisational goals and objectives.
- The ability to flexibly adjust plans and workloads to meet the requirements of the role.
- Demonstrates an eagerness to improve performance and deliver better services.
Other
- Willingness and ability to travel between sites.
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Certificate of Sponsorship
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website.
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants.
Employer details
Employer name
Public Health Wales
Address
Capitol Quarter 2
Tyndall Street
Cardiff
CF10 4BZ
United Kingdom
Employer's website
https://phw.nhs.wales/