Databricks Data Engineer
Databricks Data Engineer - Leeds - Up to £70,000
Location: Leeds (Hybrid - 2 days per week onsite)Job Type: Permanent
About the Company
Our client is a rapidly growing data-driven consultancy helping enterprise-scale organisations modernise their data estates. With several major new projects kicking off in early 2026, they are expanding their Leeds engineering hub and looking for a Databricks-focused Data Engineer to join their high-performing team.
You will design, build, and optimise cloud-based data pipelines that feed analytics, AI, and real-time insights. You'll work closely with architects, analysts, and platform teams to deliver scalable, high-quality data solutions.
Key Responsibilities:
- Develop, optimise, and maintain ETL/ELT pipelines within Databricks
- Build reliable data ingestion frameworks using PySpark and Spark SQL
- Design well-structured data models across medallion/lakehouse architecture
- Work with DevOps teams to automate deployments using CI/CD
- Collaborate with stakeholders to understand analytical needs
- Ensure compliance with best practices around data governance, security, and quality
Requirements:
- Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables)
- Proficiency in PySpark and Python
- Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services
- Understanding of Delta Lake, streaming pipelines, and lakehouse architecture
- Solid knowledge of data engineering principles (ETL/ELT, modelling, optimisation)
Benefits:
- Salary up to £70,000
- Annual bonus
- Structured career development and funded certifications
- Opportunity to work on high-impact, enterprise-scale data transformation programmes