Hadoop Platform Engineer
Hadoop Platform Engineer
Location: Edinburgh or London (1-2 days per week on-site)Contract- day rate
6 Month Contract
Our UK leading banking client is undergoing a major enterprise data transformation, and we're looking for a skilled Hadoop Platform Engineer to help shape and evolve the future of our data ecosystem. If you're passionate about data engineering at scale, modernisation, and cloud migration, this is a unique opportunity to work at the heart of one of the UK's largest financial institutions.
The Role
As a Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification and transformation initiatives.
You'll work across our data engineering community, ensuring our platforms remain robust, secure, and high-performing as we transition to the next generation of data capabilities.
What You'll Be Doing
- Managing and maintaining large-scale Hadoop clusters across on-prem environments
- Supporting and optimising our HDFS-based Data Lake and adjacent platform components
- Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie, and related tooling
- Partnering with engineering teams to deliver scalable, high-quality data solutions
- Contributing to our cloud migration strategy, helping move legacy workloads into modern cloud platforms
- Driving platform simplification and engineering excellence across distributed systems
- Supporting enterprise data transformation activities that enable the bank's strategic objectives
- Ensuring stability, performance, and security of critical data services
What We're Looking For
- Strong hands-on experience with Hadoop ecosystem tools (HDFS, Spark, Hive, Oozie, YARN, etc.)
- Experience operating and supporting large, complex, distributed clusters
- Understanding of data engineering principles and data platform design
- Experience with on-prem Hadoop environments and ideally cloud-based data platforms
- Exposure to cloud technologies (AWS, Azure, or GCP)
- Ability to troubleshoot complex platform issues across networking, compute, and storage layers
- A proactive mindset and desire to contribute to large-scale transformation work
- Open to applicants from a variety of industries and backgrounds
Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.