Senior Data Engineer

Senior Data Engineer

Up to £85,000

We are partnering with a growing organisation that is investing heavily in its data platform and analytics capabilities. With a strong focus on modern cloud technologies and data-driven decision-making, the business is building a scalable, enterprise-grade data environment to support innovation, operational efficiency and future growth.

As part of this investment, the organisation is looking to appoint a Senior Data Engineer to join its Data Platform team. This is an excellent opportunity for an experienced data professional to play a key role in the development and evolution of a modern Databricks environment while working alongside Data Science, Analytics and Product teams.

Working closely with senior engineering leadership, you will be responsible for designing and delivering robust data solutions, building scalable pipelines and helping to establish best practices across the data platform. You will contribute to the architecture, performance and governance of a business-critical data ecosystem while supporting the delivery of high-value data products.

Key Responsibilities

• Design, build and maintain scalable data pipelines using Databricks and Apache Spark.
• Develop and optimise batch and streaming data workflows, ensuring reliability, scalability and performance.
• Contribute to the design and implementation of modern Lakehouse data architectures.
• Implement data quality, monitoring and observability frameworks across the platform.
• Collaborate with Data Scientists, Analysts and business stakeholders to deliver high-quality data products.
• Participate in code reviews and contribute to engineering standards and best practices.
• Identify opportunities to improve platform performance and optimise cloud spend.
• Translate business requirements into scalable technical solutions.
• Contribute to platform documentation, tooling decisions and ongoing continuous improvement initiatives.

Skills & Experience

• Proven experience as a Data Engineer working with Databricks in production environments.
• Strong Python and SQL development skills.
• Experience with cloud-based data platforms, ideally within Azure environments..
• Good understanding of data modelling, ETL frameworks and distributed data processing.
• Strong communication and stakeholder management skills.
• Experience with Unity Catalog and Databricks Asset Bundles is desirable.

What's on Offer

• Salary up to £85,000.
• Opportunity to work on a modern Databricks-based enterprise data platform.
• Exposure to cutting-edge cloud, data engineering and analytics technologies.
• Significant involvement in shaping data architecture and engineering best practice.
• Opportunity to work closely with Data Science, Analytics and Product teams.
• Collaborative and innovation-focused culture.
• Clear progression opportunities within a growing data function.
• Flexible and hybrid working arrangements.
• Training, certification support and ongoing professional development opportunities.
• Opportunity to influence the future direction of a rapidly evolving data platform.