Senior Data Engineer

Senior Data Engineer (Databricks) Location: London (Hybrid)Rate: Negotiable, depending on experience Duration: 6 months (initial)We’re looking for a Senior Data Engineer (Databricks) to join a world-leading energy organisation on a key transformation programme within their trading and supply division. This is an exciting opportunity to play a pivotal role in building modern, scalable data solutions using Azure cloud technologies.The Role As a Senior Data Engineer, you’ll be responsible for designing and developing robust data foundations and end-to-end solutions that drive value across the business. You’ll help shape and embed data-driven thinking across both technical and business teams, ensuring the organisation continues to lead with insight and innovation.You’ll act as a subject matter expert, guiding technical decisions, mentoring junior engineers, and ensuring data engineering best practices are consistently applied.Key Responsibilities

• Design and build data solutions aligned with business and IT strategy.
• Lead development of scalable data pipelines and models using Azure and Databricks.
• Support data foundation initiatives and ensure effective rollout across business units.
• Act as a bridge between technical and non-technical stakeholders, presenting insights clearly.
• Oversee change management, incident management, and data quality improvement.
• Contribute to best practice sharing and community-building initiatives within the data engineering space.

Required Skills & Experience

• Cloud Platforms: Strong expertise in AWS / Azure / SAP
• ETL/ELT Pipelines: Advanced proficiency
• Data Modelling: Expert level
• Data Integration & Ingestion: Skilled
• Databricks, SQL, Synapse, Data Factory and related Azure services
• Version Control / DevOps tools: GITHUB, Azure DevOps, Actions
• Testing & Automation tools: PyTest, SonarQube

Desirable Experience

• Experience leading or running scrum teams
• Exposure to planning tools such as BPC
• Familiarity with external data ecosystems and documentation tools (e.g., MKDocs)

The Project You’ll be joining a large-scale programme focused on modernising a global data warehouse platform using Azure technologies. The project aims to deliver a unified and standardised view of data across international operations — a key enabler for smarter, data-driven trading decisions.If you’re a data engineer with deep Azure and Databricks experience, and you enjoy solving complex challenges within a global business, this contract offers a chance to make a real impact on a high-profile initiative.Interested?  Please apply now with your updated CV and reach out to Tom Johnson at Certain Advantage - Ref: 79413