Lead PySpark Engineer
- Hiring Organisation
- SKILLFINDER INTERNATIONAL
- Location
- London, United Kingdom
- Employment Type
- Contract
- Contract Rate
- GBP Annual
financial services environment. Skill Profile: PySpark - P3 (Advanced) AWS - P3 (Advanced) SAS - P1 (Foundational) Key Responsibilities Technical Delivery Design, develop, and fix complex PySpark code for ETL/ELT and data-mart workloads. Convert and refactor SAS code into PySpark using SAS2PY tooling and manual optimisation. Build production … Spark execution, partitioning, performance tuning, and optimisation. Troubleshooting distributed data pipelines at scale. Python & Engineering Quality Strong Python coding capability with emphasis on clean code and maintainability. Experience applying engineering best practices including: Parameterisation Configuration management Structured logging Exception handling Modular design SAS & Legacy Analytics (P1) Foundational knowledge ...