Data Engineer
- Hiring Organisation
- DWP Digital
- Location
- Sheffield, South Yorkshire, Yorkshire, United Kingdom
- Employment Type
- Permanent, Work From Home
- Salary
- £50,000
within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing … products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda, and EC2 to process large volumes of structured and unstructured data efficiently. Your role involves collaborating with a wide range of stakeholders ...