Data Engineer
Job summary
Are you motivated by building robust data solutions and shaping how data flows through a modern NHS cloud platform? We are recruiting two Data Engineers on 12 month fixed term contracts to support the continued development of our Modern Data Platform.
These roles are suited to individuals who enjoy designing and maintaining scalable data pipelines, working with complex datasets and improving how data is structured and prepared for analytics and operational use. You will contribute to the development of secure, reusable data engineering solutions using Azure-based technologies, helping to provide consistent and trusted data foundations across clinical, operational and strategic services.
This is a hands-on technical role focused on data ingestion, transformation and optimisation within a structured cloud environment. You will work closely with BI developers and operational stakeholders to ensure data is accurate, well governed and aligned to organisational and system requirements.
The role is primarily remote, with occasional in-person meetings and team activities expected throughout the year. Applicants should be based within reasonable travelling distance of Trust sites to enable attendance when required.
Should we receive a high number of applications we reserve the right to close this vacancy at any point after 06.03.2026
Main duties of the job
As a Data Engineer, you will help design, build and maintain data pipelines that support reliable, high-quality data across the Trust's cloud data platform. You will contribute to the development of datasets and data structures that align with wider system requirements, including the NHS Federated Data Platform.
You will work with structured datasets to apply transformation and validation logic, helping ensure data is accurate, consistent and ready for analytical and operational use. This includes developing curated datasets, refining existing processes and supporting the transition from manual tasks to more efficient, automated data services.
The role involves working across development, test and production environments, supporting reliable delivery through monitoring, quality controls and defined change processes. You will work closely with colleagues across data, analytics and operational teams to understand requirements and turn them into practical technical solutions, while contributing to good practice in data standards, documentation and governance.
Strong experience working with cloud-based data platforms and data transformation technologies is essential, along with the ability to manage your own workload within a structured delivery approach and communicate technical concepts clearly to a range of audiences.
This role is not eligible for Skilled Worker visa sponsorship. Applicants must already hold the right to work in the UK
About us
Rated 'Outstanding' by the Care Quality Commission, we are proud to provide high quality innovative services across most of the east of England that enable people to receive care closer to home and live healthier lives.
There's one reason why our services are outstanding - and that's our amazing staff who, for the seventh year running, rated us incredibly highly in the national staff survey.
If you share our passion for innovative and high-quality care delivery, then please submit your application and join us on our exciting journey as a leading-edge specialist community provider. All are welcome to apply and our promise to you is a culture which prioritises staff engagement and development.
Job description
Job responsibilities
As a Data Engineer, you will:
Build, test and maintain scalable data pipelines using Azure Synapse Pipelines and Data Lake Storage
Develop and maintain solutions to support the NHS Federated Data Platform
Contribute to the design and automation of data flows that replace manual processes and improve efficiency
Apply DevOps practices including source control, CI/CD and sprint-based delivery using Azure DevOps and Jira
Collaborate with BI Developers to ensure data products meet operational, analytical and service needs
Contribute to technical documentation, metadata and data cataloguing using Microsoft Purview
Support the development and implementation of Purview design and data management standards
Participate in QA, peer review and continuous improvement of shared data assets and pipelines
Ensure data engineering solutions comply with information governance, security and data protection requirements within NHS and organisational policy
Where applicable, contribute to data engineering processes that support statutory national datasets such as CSDS and MHSDS
Communication
Proactively engage with team members and stakeholders to gather data and technical requirements and support the development of effective working relationships, verbally and in writing
Attend relevant internal and external meetings on behalf of the team where appropriate
Communicate developments within the data platform and pipeline architecture to colleagues and stakeholders to support transparency and shared understanding People Management
Maintaining own professional development and requirement to take part in appraisal and KSF process.
Research & Development
Keep up to date with developments in data engineering tooling and platforms including Azure Synapse, Data Factory, Fabric, SQL Server, Spark and related Microsoft releases
Maintain awareness of emerging approaches in data architecture, data modelling, pipeline design, automation and DevOps practices relevant to the analytics and data platform landscape
Ensure ongoing personal and professional development by staying current with technologies, standards and best practice across data engineering, data governance and cloud-based data services
Clinical and Practice Governance
Observe and maintain strict confidentiality with regards to any information in line with the requirements of the Data Protection Act.
Any data that is must be undertaken with regard to the Trust Information Governance and Information Security policies.
The post holder must adhere to the Trust risk assessment and risk management processes.
The post holder must adhere to infection control policies and procedures.
Undertake mandatory training and any other training relevant to the role as required by the trust.
The post holder must participate in clinical and safeguarding audits as required.
The post holder is required to participate in relevant emergency preparedness process for their team.
Person Specification
Qualifications and Training
- Educated to degree level in a relevant technical subject or able to demonstrate equivalent applied experience within a data engineering or cloud data platform role
- Evidence of continued professional development relevant to cloud-based data platforms and data engineering practices
- Microsoft Azure or recognised data platform certification
- Structured training in cloud data platforms, DevOps or data governance
Experience
- Delivering and maintaining data engineering solutions within a cloud-based data platform using Azure Synapse Pipelines and Data Lake Storage or similar
- Developing and optimising curated datasets using Synapse SQL, Spark notebooks such as PySpark or equivalent technologies
- Ttranslating requirements into effective data solutions using an Agile approach, with structured task management through tools such as Jira
- Supporting and troubleshooting data pipelines within a live production environment, including structured change and security controls
- Applying data validation and monitoring controls within a production data environment
- Working with complex or sensitive datasets, ensuring defined data quality and compliance standards are met
- Working within an NHS or other regulated public sector environment
- Contributing to data catalogue, metadata or lineage management using tools such as Microsoft Purview
- Integrating data with external or system-wide platforms
- Aligning local data solutions with nationally defined data standards or information models
Knowledge and Skills
- Strong applied understanding of the Medallion architecture and layered data design principles within a cloud data platform
- Strong understanding of secure and scalable data platform design, including performance optimisation concepts
- Good understanding of cloud platform concepts including storage, compute and access management
- Good understanding of DevOps principles including version control and controlled release
- Ability to communicate complex technical concepts clearly to technical and non-technical audiences
- Ability to build and maintain effective working relationships across technical and operational teams
- Ability to interpret and apply data standards, guidance and best practice
- Strong understanding of data governance, security, and access control in enterprise reporting
- Detailed understanding of NHS datasets, information standards, and performance reporting
Disclosure and Barring Service Check
This post is subject to the Rehabilitation of Offenders Act (Exceptions Order) 1975 and as such it will be necessary for a submission for Disclosure to be made to the Disclosure and Barring Service (formerly known as CRB) to check for any previous criminal convictions.
Certificate of Sponsorship
Applications from job seekers who require current Skilled worker sponsorship to work in the UK are welcome and will be considered alongside all other applications. For further information visit the UK Visas and Immigration website.
From 6 April 2017, skilled worker applicants, applying for entry clearance into the UK, have had to present a criminal record certificate from each country they have resided continuously or cumulatively for 12 months or more in the past 10 years. Adult dependants (over 18 years old) are also subject to this requirement. Guidance can be found here Criminal records checks for overseas applicants.
Employer details
Employer name
Cambridgeshire Community Services NHS Trust
Address
CCS Head Office
St Ives
PE27 4LG
Employer's website
https://www.cambscommunityservices.nhs.uk/careers