Lead PySpark Engineer
- Hiring Organisation
- SKILLFINDER INTERNATIONAL
- Location
- London, United Kingdom
- Employment Type
- Contract
- Contract Rate
- GBP Annual
Advanced (P3) AWS - Advanced (P3) SAS - Foundational (P1) Key Responsibilities Technical Delivery Design, develop, and maintain complex PySpark solutions for ETL/ELT and data mart workloads. Convert and refactor Legacy SAS code into optimized PySpark solutions using automated tooling and manual refactoring techniques. Build scalable, maintainable, and production … ready data pipelines. Modernize Legacy data workflows into cloud-native architectures. Ensure data accuracy, quality, integrity, and reliability across transformation processes. Cloud & Data Engineering (AWS-Focused) Develop and deploy data pipelines using AWS services such as EMR, Glue, S3, and Athena. Optimize Spark workloads ...