Senior Data Engineer
- Hiring Organisation
- Michael Page Technology
- Location
- London, South East, England, United Kingdom
- Employment Type
- Temporary
- Salary
- £550 - £880 per day
business-critical data initiatives within a complex global environment. Description Design, build and maintain scalable data pipelines using Python and Databricks Develop and optimise ETL/ELT processes leveraging Spark and Delta Lake Create robust data models and data architectures within modern Lakehouse environments Implement and manage data workflows across … Proven experience with Databricks, including notebooks, workflows, jobs and Delta Lake Strong knowledge of Apache Spark/PySpark Experience designing and delivering large-scale ETL/ELT pipelines Advanced SQL skills and experience with relational databases Experience working with cloud technologies such as AWS, Azure or GCP Knowledge of modern ...