Data Engineer
- Hiring Organisation
- DWP Digital
- Location
- Sheffield, South Yorkshire, Yorkshire, United Kingdom
- Employment Type
- Permanent, Work From Home
- Salary
- £75,000
and location details discussed during the recruitment process. What skills, knowledge and experience will you need? Proven experience designing and delivering complex ETL/ELT pipelines, managing priorities and driving quality outcomes. Ability to communicate complex technical concepts clearly to technical and non-technical audiences … strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design ...