Senior Data Engineer - Databricks
- Hiring Organisation
- JLA Resourcing Ltd
- Location
- South West London, London, United Kingdom
- Employment Type
- Contract
- Contract Rate
- £500-£540 per day
Senior Data Engineer, you'll take ownership of the design, development and optimisation of production-grade data solutions using Databricks, Apache Spark and Delta Lake. Your responsibilities will include: Designing, building and optimising scalable ETL/ELT data pipelines using Databricks, PySpark and Spark SQL Implementing Medallion Architecture patterns … Strong commercial experience with Databricks Excellent PySpark, Apache Spark and Spark SQL skills Experience building production-grade ETL/ELT pipelines Strong knowledge of Delta Lake and Lakehouse architecture Experience implementing Medallion/Bronze-Silver-Gold architectures Strong experience with Azure and/or AWS data platforms Knowledge ...