Senior Data Engineer

PermanentLondon, United Kingdom100,000Senior Data EngineerLondon | Hybrid, 3 days per week
90,000–100,000 + bonus & benefitsWe're partnering with a large, complex global organisation looking for a Senior Data Engineer to take a leading technical role within its evolving data engineering function.This is much more than a pipeline delivery role.You'll own engineering standards, design patterns, performance and quality across a sizeable Azure data estate. You'll work across high-volume operational data, help shape how the engineering service operates and act as a key technical authority across the function.Designing and improving engineering patterns across Azure Databricks and Azure Data FactorySetting the optimisation strategy across caching, indexing, partitioning and costDefining clear data engineering and integration engineering patternsActing as the engineering quality gate, reviewing internal and third-party code before releaseOwning DevOps practices end-to-end, including CI/CD, branching standards, environment promotion and release governanceDriving automation across the engineering lifecycle, removing repetitive manual processesWorking with advanced SQL and existing data engineering patternsEstablishing governance across data and algorithms used for analytics and automated decision-makingWorking closely with analytics engineering and data science to maintain data quality, security and governanceMentoring engineers and helping build the technical capability of the wider teamWorking with external engineering partners and holding them to a high technical standardYou'll need strong hands-on experience across:Azure DatabricksAzure Data FactorySparkAdvanced SQL, including query optimisation, indexing and performance diagnosisCI/CD and DevOpsDelta LakeUnity CatalogMedallion architectureAPIs, including OAuth2, pagination, rate limits and schema driftData governance and orchestrationIoT and telemetry data, particularly high-volume, high-frequency datasetsExposure to Synapse, Power BI, complex data types or spatial data would be useful too.You'll ideally have 6+ years' experience across data engineering and wider data management disciplines, including integration, modelling, optimisation and data quality.This environment will suit someone who has worked with complex, large-scale operational data and understands what good engineering looks like beyond simply getting something into production.You'll be a standard setter. Someone whose approach to code, review, documentation and engineering discipline becomes the benchmark for others.You'll also need to be comfortable communicating across technical, business and senior stakeholder groups, mentoring other engineers and constructively challenging both internal teams and external suppliers when quality isn't where it needs to be.There's a lot to get your teeth into here. You'll be joining at a point where the organisation is evolving its data engineering operating model, with genuine scope to influence how the function develops and a longer-term pathway into broader Platform Ownership.At Mirai, we believe diverse teams build better technology. We're committed to creating an inclusive recruitment process and encourage applications from people of all backgrounds, experiences and identities.If this role sounds exciting but you don't meet every single requirement, please don't let that stop you from applying. We know that great people don't always tick every box, and we'd still love to hear from you.Interested? Get in touch to find out more.