Senior Data Engineer
- Location
- Greater London, England, United Kingdom
contribute Leading the development and optimisation of ingestion and transformation pipelines using technologies such as Spark, Scala, Python, AWS, DBT, and Snowflake Architecting and evolving the organisation’s Data Lake environment to ensure it remains robust, scalable, secure, and future‐ready Owning and improving ETL processing, table refreshes, defect resolution … platform. Our environment includes EMR, Athena, Lambda, S3, Glue and Step Functions, but we're open to transferable experience solving similar problems. Experience with Snowflake, Spark, Scala or Airflow, or transferable experience with comparable technologies and solving similar data engineering challenges. Experience with Git, GitHub and CI/CD practices ...