SENIOR DATA ENGINEER - Databricks

Senior Data Engineer – Databricks

Location: Remote UK or office based (opportunity to work remotely or be office based depending on your preference)

Salary: £50k - £64k plus benefits

Type: Full-Time

ARCA Resourcing is proud to be partnered with an innovative leading retailer that’s transforming how data powers decision-making. We’re seeking a Senior Data Engineer to take a technical leadership role within their modern Enterprise Data Platform. If you thrive in shaping scalable, innovative data solutions and mentoring talented engineers, this is your opportunity to make a real impact.

About the Role

As a Senior Data Engineer, you will drive the design and implementation of robust, high-performance data solutions. You will work hands on with Databricks to deliver industrialised pipelines and data science model feeds. You will also mentor junior engineers, champion best practices, and ensure technical excellence across all deliveries.

What You’ll Do

• Lead the technical delivery of data initiatives in a collaborative squad environment.
• Translate functional designs into scalable, reusable technical solutions.
• Build and test high-performance ELT pipelines in Databricks.
• Mentor junior engineers and promote engineering best practices.
• Ensure high quality, reliable, and well-documented deliverables through peer reviews.
• Optionally support on-call platform duties as needed.

What We’re Looking For

• 4 years expertise in Databricks, Spark, and cloud data architecture
• Coding skills in Python and SQL.
• Experience with orchestration tools like Azure Data Factory and Databricks Workflows.
• Knowledge of lakehouse architectures, modern data engineering, and data warehousing principles.
• Understanding of data modelling, ELT/ETL pipelines, and testing frameworks.
• Familiarity with CI/CD, version control, and DevOps practices.
• Strong problem-solving, debugging, and technical leadership skills.
• Awareness of security, governance, and cost optimisation practices.

Desirable: Degree in IT or related business discipline.

Why Join

This is your chance to work at the forefront of data innovation in a dynamic retail environment, shaping solutions that deliver real business impact. You’ll have the autonomy to drive technical excellence, while also developing others in a supportive and high-performing team.