Data Engineer
- Hiring Organisation
- DWP Digital
- Location
- Sheffield, South Yorkshire, Yorkshire, United Kingdom
- Employment Type
- Permanent, Work From Home
- Salary
- £50,000
purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon … delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role ...