Senior Data Engineer
Senior Data Engineer
Cardiff (hybrid)
£47,675
Benefits: 28.9% Pension & 31 days annual leave + Bank Holidays, and 2 Privilege days
We're looking for an experienced Senior Data Engineer to design and build a modern cloud data platform from the ground up. This is a greenfield opportunity where you'll shape the organisation's data architecture, establish engineering best practices, and create scalable solutions that power reporting, analytics, and future AI initiatives.
If you enjoy solving complex data challenges, building robust platforms, and influencing technical direction, this role offers genuine ownership and impact.
What You'll Be Doing
- Design and build a modern Azure-based data platform
- Develop scalable ETL/ELT pipelines using Databricks, Spark and Azure services
- Implement secure, governed data solutions following DataOps and DataSecOps principles
- Create high-quality data models to support reporting and self-service analytics
- Develop and optimise Power BI semantic models and reporting architecture
- Ensure data quality, security and performance across the platform
- Champion CI/CD, automation and engineering best practices
- Mentor junior engineers and contribute to technical leadership
- Collaborate with stakeholders to turn business requirements into scalable data solutions
Essential Skills
- Strong SQL and Python (PySpark preferred)
- Proven experience building cloud-based data platforms on Azure
- Hands-on experience with Azure Databricks, Delta Lake and Azure Data Lake
- Expertise designing ETL/ELT pipelines
- Experience with Power BI administration and data modelling
- Knowledge of Git, CI/CD and modern engineering practices
- Strong understanding of data governance, security and access control
- Experience designing scalable analytics and reporting solutions
Nice to Have
- Medallion Architecture or Lakehouse experience
- Azure Data Factory, dbt or Prefect
- DataSecOps and cloud security experience
- AI/ML data preparation knowledge
- Experience leading technical projects or mentoring engineers
You'll Thrive Here If You...
- Enjoy building solutions from the ground up
- Take ownership and drive technical decisions
- Balance engineering excellence with practical delivery
- Communicate confidently with both technical and non-technical stakeholders
- Enjoy mentoring others and sharing knowledge
- Have a continuous improvement mindset
Why Join?
- Greenfield engineering opportunity
- Significant technical ownership and autonomy
- Opportunity to influence long-term data strategy
- Modern Azure technology stack
- Collaborative engineering culture
- Opportunity to mentor and shape engineering standards
- Work on projects that deliver genuine business impact
Benefits:
- 31 days annual leave + Bank Holidays, and 2 Privilege days
- Flexible and hybrid working
- Generous employer contribution of 28.97%
- Time off for wellbeing activities
- Green car scheme
- Cycle2Work and season travel tickets
- Access to subsidised sports groups
Think this one's for you
If you think this Senior Data Engineer opportunity is for you then please apply online.
Yolk Public Sector & Not-for-Profit team works with organisations across the UK to fulfil their recruitment needs and to achieve their D&I objectives. We recruit temporary, contract and permanent hires for 1 off specialist needs or for volume campaigns. We support our applicants to navigate the public sector recruitment processes and secure their dream jobs.
Yolk Recruitment is an equal opportunities employer and embraces diversity in our workforce. We employ the best people for the job at hand and actively encourage applications from all qualified candidates, regardless of gender, age, race, religion, sexual orientation, disability, educational background, parental status, gender identity or any other protected characteristic. We champion and celebrate diversity at Yolk allowing our team to bring their whole selves to work.