Senior Data Engineer

A leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud technologies to transform data capabilities.

About the Role

The successful candidate will play a key role in designing and implementing scalable data solutions using the Microsoft Azure Data Stack. You'll work closely with stakeholders to translate business requirements into robust technical architectures, ensuring best practices in data governance, security, and performance.

Key Responsibilities

  • Design and optimise data pipelines and ETL processes using Azure Data Factory and Databricks.
  • Develop and maintain data models, transformations, and integrations across multiple systems.
  • Collaborate with client teams to deliver high-quality, timely solutions.
  • Mentor junior engineers and contribute to architectural decisions.
  • Implement best practices for data governance and security.

Required Skills & Experience

  • 5–10 years in data engineering roles, ideally within consultancy environments.
  • Strong proficiency in:
  • Databricks (PySpark)
  • Azure Data Factory (ADF)
  • SQL (complex queries and optimisation)
  • Azure Data Services (Data Lake, Synapse, etc.)
  • Excellent communication and stakeholder management skills.

Nice-to-Have

  • Experience with Scala for Spark development.
  • Knowledge of CI/CD pipelines and DevOps practices in Azure.
  • Familiarity with data governance frameworks.

Why Apply?

  • Work on a flagship transportation project with real-world impact.
  • Join a collaborative, innovative team culture.
  • Opportunities for professional growth and Azure certifications.

Apply now online for a confidential discussion.

Job Details

Company
ScaleOps Search Ltd
Location
London, UK
Employment Type
Full-time
Posted