Senior Data Engineer - Databricks

Senior Data Engineer - Databricks - London (Hybrid) - Up to £80,000

We're partnering with a fast-growing analytics and data business operating across the entertainment sector. As demand for real-time insight and advanced analytics continues to scale, the company is investing heavily in a modern, cloud-native data platform, with Databricks at its core.

This role is ideal for a Senior Data Engineer who wants true end-to-end ownership: designing, building, deploying and operating production-grade data systems, while shaping engineering standards and CI/CD practices across the platform.

The Role

You'll play a key role in building and evolving a high-performance Databricks lakehouse platform, taking ownership from ingestion through to production deployment.

Key responsibilities include:

• Design, build and operate end-to-end data pipelines using Databricks
• Own and evolve Databricks architecture across batch, streaming and event-driven workloads
• Implement and mature CI/CD pipelines for data engineering (testing, deployment, versioning)
• Develop reusable, production-ready data frameworks and patterns
• Drive engineering best practice across performance, security, reliability and cost optimisation
• Lead technical design decisions and influence long-term data platform strategy
• Mentor other engineers and raise overall data engineering standards

This is a hands-on role with genuine architectural influence, not a people-management-only position.

Key Experience & Capabilities

We're specifically looking for strength in modern data engineering, not just analytics or reporting.

Core requirements:

• Strong experience delivering end-to-end data engineering solutions in production
• Deep hands-on expertise with Databricks (jobs, notebooks, workflows, Delta Lake)
• Experience designing and operating CI/CD pipelines for data platforms
• Strong Python & SQL skills for scalable data processing
• Solid understanding of lakehouse architecture and the Medallion (Bronze/Silver/Gold) pattern
• Strong data modelling experience (star/snowflake schemas, SCD Types 1-3)
• Experience with streaming and event-driven architectures
• Performance tuning and cost optimisation in cloud data platforms
• Experience with data quality, observability and data contracts

Nice to have (but not essential):

• dbt, Snowflake or similar analytics engineering tooling
• Experience supporting ML or advanced analytics workloads
• Exposure to data mesh or domain-oriented data platforms

What's on Offer

• Up to £80,000 salary
• Join a scaling, well-funded business with serious technical ambition
• Work on a modern Databricks-centric data platform
• High impact role with ownership of architecture, CI/CD and engineering standards
• Clear opportunity to influence how data engineering is done across the organisation

Interested

If you're a Senior Data Engineer who wants real ownership of Databricks, end-to-end pipelines and shape a modern data platform from the ground up.

Apply Now!