Databricks Engineer - £400PD - Remote

We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven decision making across the business.

• Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.

• Build and optimise data lakehouse architectures on Azure Data Lake Storage (ADLS).

• Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows

• Implement best practices for data governance, security, and quality across all pipelines.

• Collaborate with data scientists, analysts, and cross-functional teams to deliver reliable, production-grade data models.

• Monitor and tune pipeline performance to ensure efficiency, reliability, and cost optimisation.

• Participate in CI/CD processes and infrastructure-as-code solutions using tools like Terraform, GitHub Actions, or Azure DevOps

• 3+ years' experience as a Data Engineer working in Azure environments.

• Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling).

• Solid knowledge of Azure cloud services including:

  • Azure Data Lake Storage

  • Azure Data Factory

  • Azure Synapse / SQL Pools

  • Azure Key Vault

• Strong programming skills in Python and SQL.

• Experience building scalable, production-grade data pipelines.

• Understanding of data modelling, data warehousing concepts, and distributed computing.

• Familiarity with CI/CD, version control, and DevOps practices.

• Experience with streaming technologies (e.g., Spark Structured Streaming, Event Hub, Kafka).

• Knowledge of MLflow, Unity Catalog, or advanced Databricks features.

• Exposure to Terraform or other IaC tools.

• Experience working in Agile/Scrum environments.

To apply for this role please submit your CV or contact Dillon Blackburn on (phone number removed) or at (url removed).

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group. We are the global leaders in Data & AI recruitment.