Senior Data Engineer

The IPO is a modern organisation which depends on its IT and Data services to operate and innovate effectively. In order to provide up to date services to our customers both nationally and internationally, our systems need to be developed, improved and maintained. As a Senior Data Engineer, situated within our Digital, Data and Technology (DDaT) Chief Data Office, you will work within a multi-functional delivery team, responsible for the delivery of the robust data services and designs. You will need the appetite to learn new technologies and methodologies for delivering high quality IT services. In this role you will work within a multi-disciplinary squad using several technologies to build enterprise grade services. Specific responsibilities for this role include the development of data systems as required, development and optimisation of ETL layers, maximising opportunities to re-use existing data flows and provide support in relation to data platforms and data integration within our cloud estate. Working Style This role will be carried out in-line with IPO Hybrid working arrangements where staff are currently expected to spend at least 20% of their time working onsite from one of our offices. This role is based in our Newport Office. The requirement for attendance at an office location can vary by role so we would encourage candidates to discuss working arrangements with the recruiting manager to agree a reasonable balance between working from home and the office. Job description Main duties consist of but are not limited to: Be responsible for data enhancements and executing plans that utilise the current toolkit and the skills of the team to deliver these. Contribute to the development of a world class Data Engineering capability for IPO IT & Data. Work closely with our Data Management and Business Intelligence Teams to drive solutions that ensure ease of access to data and help them to work with data more effectively and efficiently. Build IPO data pipelines, owning the data engineering artefacts. Build solutions to move data internal & external to IPO. Engage with stakeholders to build relationships and to gain a thorough understanding of key IPO user groups and design decisions. Work across groups, projects, and products to implement data engineering solutions to solve complex business problems, using the IPO’s chosen technology. Support the vision for the organisation’s use of data in line with corporate goals and vision. Person specification Essential Technical Experience of Azure Data Factory (ADF), Data Bricks, Python and other data tooling Evidence an ability to design, code, test, correct and document simple programs or scripts. Experience of cleansing, preparing and formatting data sets. Awareness of designing scalable solutions and future-proof data services. Essential Experience Has been a key player in delivering technical solutions as part of large projects Experienced with modern delivery models such as Scrum and other Agile Advocate of DevOps principles Experience with Azure DevOps