Data Engineer
Data Engineer
Up to £60,000
We are partnering with a growing organisation that is continuing to invest in its data platform, data engineering capabilities and wider technology estate.
As part of this continued investment, the business is looking to appoint a Data Engineer to join its Data & Innovation team. This is an excellent opportunity for an experienced Data Engineer to combine hands-on technical delivery with SQL database expertise, helping to develop and mature a modern Microsoft data platform.
Working closely with stakeholders across technology and the wider business, you will be responsible for developing and maintaining data pipelines, integrating new data sources, optimising data transformation processes and supporting the ongoing performance and reliability of the SQL database estate.
This role would suit a Data Engineer with strong Databricks, SQL and Python/PySpark expertise who enjoys solving technical challenges, improving data platforms and working collaboratively with both technical and non-technical stakeholders.
Key Responsibilities
- Design, develop and maintain robust, scalable data pipelines using Databricks, helping to build and shape the wider data platform.
- Build and optimise ETL processes that bring together data from a range of sources and make it ready for reporting, analytics and insight.
- Create high-quality SQL and Python transformations that are efficient, reliable and built to scale.
- Develop and optimise queries, stored procedures and database objects
- Contribute to the design and ongoing development of data warehouses, data models and the wider data platform.
- Identify opportunities to improve data quality, consistency and reliability while promoting strong database development practices.
- Contribute to CI/CD, Git and source control processes, helping to improve automation, deployment and engineering standards.
Skills & Experience
- Proven experience working in a Data Engineering role
- Hands on Databricks experience, with the ability to develop and support data engineering workloads.
- Advanced SQL skills, with confident use of joins, CTEs, window functions and data modelling techniques.
- Solid ETL and data integration experience, with an understanding of how to bring together data from multiple sources effectively.
- Strong development skills in SQL and Python
- Experience working with relational databases and modern data architectures, ideally including the medallion architecture.
What's on Offer
- Salary of up to £60,000
- Hybrid working environment with 2 days in Oxfordshire HQ
- Opportunity to join a growing Data & Innovation function
- Hands-on exposure to modern Microsoft data technologies including Databricks, SQL, Python and PySpark
- Opportunity to influence the development and maturity of the organisation's data platform
- Collaborative working environment with exposure to a broad range of data and technology projects