Senior Data Engineer
- Location
- Greater London, England, United Kingdom
Senior Data Engineer role will be responsible for building and maintaining data processing pipelines and also the transformation and optimisation of data for analytical use. Build data pipelines that clean, transform, and aggregate data from disparate sources Collaborate with stakeholders and other engineers Contribute to the completion of milestones … technical direction within your team Requirements/knowledge (you don't need everything) Experience of working in an Agile delivery team Strong analytic skills related to working with unstructured datasets Python (PySpark, Pandas, PyArrow) Distributed data processing (Apache Spark) Data ETL (Apache Airflow, AWS Step Functions, Apache NiFi) Cloud ...