Lead Data Engineer

Lead Data Engineer - Remote - AWS - Databricks - up to £110,000

I am working with a client specialising in AI-driven learning platform used by enterprise clients across the globe. They are scaling fast, innovating constantly, and they are investing heavily in data engineering as a core pillar of the business. This is the kind of environment where a strong engineer can genuinely influence direction, modernise the stack, and build things the right way.

If you want to lead real transformation, drive architectural decisions, and work in a company where data is at the heart.

Your work will include:

• Leading the adoption of Databricks and building a modern Lakehouse architecture.
• Designing and implementing AWS-native ETL pipelines using S3, Glue, Athena, Step Functions.
• Building scalable, ACID-compliant datasets using Apache Iceberg.
• Running cost-efficiency initiatives across Redshift and broader AWS services.
• Consolidating fragmented environments into a secure, multi-tenant data platform.
• Implementing automated data quality and validation workflows.
• Establishing platform-wide security baselines (encryption, deletion policies, access control).
• Working cross-functionally with product, sales, and operations teams to deliver high-value data products.
• Mentoring junior engineers and shaping the data engineering culture as the team grows.

Benefits

• Competitive salary + performance-aligned progression
• Hybrid working with flexibility around Cambridge HQ
• Opportunity to define and own the data engineering roadmap
• A collaborative, mission-driven team using cutting-edge tooling
• Exposure to AI-powered learning technologies and large-scale enterprise deployments
• Clear path for leadership and technical authority as the team expands

Key Experience

• 5+ years in data engineering, including experience in a senior or lead position
• Strong expertise across AWS
• Hands-on experience with Databricks, PySpark, and Lakehouse patterns
• Strong Python and SQL engineering ability
• Experience implementing scalable ETL/ELT pipelines
• Background in data modelling and building analytics-ready datasets
• Understanding of security best practices and compliance-driven architecture
• Ability to influence, mentor, and collaborate with stakeholders across the business

Ready to take ownership and shape the future of data at a fast-growing AI company?

This is a high-impact role with real influence and roles at this level don't stay open for long.

Apply now or send your CV directly!