Data Engineer

Role Title: Data Engineer

Role Type: Contract (inside ir35)

Role Location: London, UK

Mandatory: Active Security Clearance

Job Description:-

Essential Skills & Experience:

·10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks.

·Good proficiency in Python and Spark (PySpark) or Scala.

·Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns.

·Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database.

·Experience working with large datasets and complex data pipelines.

·Experience with data architecture design and data pipeline optimization.

·Proven expertise with Databricks, including hands-on implementation experience and certifications.

·Experience with SQL and NoSQL databases.

·Experience with data quality and data governance processes.

·Experience with version control systems (e.g., Git).

·Experience with Agile development methodologies.