DATA ENGINEER - LICHFIELD, STAFFORDSHIRE - 1 DAY A WEEK ONSITE - £50 - £63K + BENEFITS
DATA ENGINEER - LICHFIELD, STAFFORDSHIRE - 1 DAY A WEEK ONSITE - £50 - £63K + BENEFITS
About the Role
We are seeking an experienced Data Engineer to join a growing Data & Analytics team and play a key role in designing, developing and maintaining scalable, reliable data solutions.
This is a hands-on opportunity for a Data Engineer who enjoys taking ownership and delivering end-to-end solutions. You will be responsible for building robust ETL/ELT pipelines using the Microsoft Azure data platform, ensuring high-quality, secure and governed data is available for reporting, analytics and business decision-making.
You will work closely with Data Engineers, BI Developers and stakeholders across the organisation to translate business requirements into scalable technical solutions and contribute to the continued development of the data platform.
Key Responsibilities
- Design, build and maintain end-to-end ETL/ELT pipelines
- Develop scalable data models and optimised SQL transformations
- Develop data processing and automation solutions using Python
- Build and maintain solutions across Azure Data Factory, Azure Data Lake Storage (ADLS), Azure SQL and Azure Synapse Analytics
- Monitor and improve data quality, reliability and performance
- Deliver data engineering projects from initial design through to production
- Implement data security, governance and quality controls
- Troubleshoot data and pipeline issues and identify opportunities for improvement
- Work closely with BI Developers, Data Engineers and business stakeholders
- Collaborate with internal teams and third-party technology partners
- Create and maintain technical documentation, standards and data definitions
- Contribute to the continuous improvement of the organisation's data architecture and engineering practices
Essential Skills & Experience
The successful candidate will have:
- 3+ years' professional experience with SQL
- 3+ years' professional experience with Microsoft Azure
- 2+ years' professional experience with Python
- Proven experience delivering production-grade data engineering solutions
- Strong experience with Azure Data Factory (ADF)
- Experience working with Azure Data Lake Storage (ADLS)
- Strong knowledge of Azure SQL
- Experience with Azure Synapse Analytics
- Advanced SQL skills, including data modelling and query optimisation
- Proven experience developing and supporting ETL/ELT pipelines
- Good understanding of data governance, data quality and compliance
- Experience with Git and CI/CD
- Understanding of Agile development methodologies
- Strong analytical and problem-solving skills
- Excellent communication skills, with the ability to work with both technical and non-technical stakeholders
- Ability to manage competing priorities and deliver projects to agreed deadlines
Desirable Skills & Experience
Experience with one or more of the following would be advantageous:
- Microsoft Fabric
- Fabric Lakehouses
- Dataflows Gen2
- Real Time Analytics
- Databricks
- PySpark
- Delta Lake
- dbt (data build tool)
- Experience working within healthcare, social care or another regulated environment
The Ideal Candidate
We are looking for someone who is technically strong, commercially aware and comfortable taking ownership of data engineering projects from conception through to delivery.
You should have a strong background in Azure, SQL and Python, with hands-on experience building data pipelines and working with modern cloud data platforms.
You will also be a confident communicator who can work effectively with developers, analysts, business stakeholders and third-party partners.
Experience within a regulated sector such as healthcare or social care would be beneficial, although it is not essential.
Apply Now
If you are an experienced Data Engineer looking for an opportunity to work with Microsoft Azure, SQL and Python on business-critical data projects, we would love to hear from you.