Senior Databricks Engineer
Senior Databricks Engineer | Hybrid | Cardiff| Outside IR35 | £400 - £500 Opus is partnering with a new client to support a major data platform build, and we’re looking for a Senior Data Engineer to play a key role in the next phase of delivery. This is a hands-on contract position focused on building out a modern cloud-based data environment using Azure, Databricks, and Lakehouse architecture principles.You’ll be working within a growing data function, helping to design and deliver scalable, production-grade data solutions that underpin reporting and analytics across the business. This role will suit someone who enjoys taking ownership, working closely with stakeholders, and translating business requirements into robust data engineering solutions.What you'll be doing:
- Design, build and optimise data pipelines using Azure Data Factory, Databricks, Python and SQL
- Work within a Lakehouse / Medallion architecture framework
- Develop and maintain data models and structures to support analytics and reporting
- Work across Azure SQL / MS SQ L environments
- Improve and maintain CI/CD and deployment pipelines for data workflows
- Support downstream analytics, including Power BI datasets
- Contribute to data quality, governance and best practice standards
- Strong hands-on experience with Databricks and Azure data platforms
- Databricks certification (current/relevant)
- Advanced SQL skills (MS SQL / Azure SQL)
- Strong Python experience
- Experience building scalable data platforms, ideally using Lakehouse architecture
- Solid understanding of data modelling, data quality and governance
- Experience working with Git and CI/CD pipelines