Senior Enterprise Technology Engineer
- Hiring Organisation
- BP
- Location
- London, United Kingdom
- Salary
- £ 100 K
deliverables.Design, develop and implement highly scalable and efficient data pipelines using advanced Python (Pandas, web scraping and machine learning libraries), SQL (including advanced optimisation techniques) and Apache Airflow.Lead the extraction, transformation and loading (ETL) of large and complex datasets, including time series data, from various sources (web APIs, databases … build, deploy and manage data pipelines in a secure and cost-effective manner, with particular focus on cloud cost optimisation and Total Cost of Ownership (TCO).Coach and mentor a team of 8-10 data engineers, providing guidance on standard processes, technical development ...