Data Engineer
Senior Data Engineer – Query Federation & Data Lakehouse
Location - London
Salary - £70,000
Hybrid - 2 days per week central London
The Role
I am working with a leading technology services organisation to find an experienced Senior Data Engineer to join their AI & Data team. You'll take ownership of enterprise data infrastructure, ensuring clients can seamlessly access and utilise their data across multiple platforms.
What You'll Be Doing
- Deploying, configuring and managing Trino/Starburst Enterprise and Galaxy environments, including upgrades and performance tuning
- Administering a Dell Data Lakehouse platform, setup, maintenance, and ensuring high availability
- Integrating diverse data sources into a unified, accessible data platform
- Designing and tuning containerised solutions (Kubernetes/OpenShift) for scalability and resilience
- Setting up and managing data catalogs across multiple operational modes
- Implementing security controls, managing data access governance, and ensuring regulatory compliance
- A degree in Computer Science, Data Science, Engineering or a related field or equivalent practical experience
Skills to have:
- Proven Trino/Starburst Enterprise/Galaxy administration experience
- Strong Unix/Linux skills and solid understanding of distributed systems
- Kubernetes or OpenShift container orchestration experience
- Familiarity with Big Data (Hadoop/Hive/Spark) and cloud platforms (AWS, Azure, GCP)
- Knowledge of security frameworks: LDAP, Active Directory, OAuth2, Kerberos
Nice to Have:
- Starburst Certified Practitioner certification
- Python and/or Java experience
- Ansible or similar automation tooling
- Dell Data Lakehouse administration experience
Occasional out-of-hours availability may be required for project go-lives.