Data Engineer
- Location
- City Of London, England, United Kingdom
backfills and schema changes Troubleshoot data-quality and pipeline issues Implement data-quality checks, testing and documentation Work with distributed data technologies such as Presto, Spark or Hive Use workflow orchestration tools such as Airflow Participate in code reviews and Git-based development workflows Collaborate with Data Engineers, Analysts … looking for 5+ years' experience building production data pipelines Advanced SQL , including performance optimisation on large tables Strong Python for data engineering Experience with Presto, Spark, Hive or similar Experience with Airflow or another workflow scheduler Strong ETL/data pipeline development experience Git and code-review experience Strong ...