2 of 2 Remote/Hybrid Delta Lake Jobs in the West Midlands

data engineers, own the technical architecture and stay hands-on in development. What you'll do Architect and build the platform on Azure Databricks (Delta Lake, Unity Catalog, medallion architecture) Use AI agents and LLMs to reverse-engineer legacy reports, queries and transformations, and build repeatable AI-assisted … processes for code generation, testing and migration Build automated testing and reconciliation to validate migrated data against existing reporting Integrate SAP, Azure Data Lake, Salesforce and other systems, and design gold-layer models for Power BI Set engineering standards (Workflows, CI/CD, IaC, governance) and mentor the team ...

conceptual, logical, and physical), including lakehouse zone strategies and schema evolution approaches. Champion Databricks as the core data platform, leveraging lakehouse architecture, Unity Catalog, Delta Live Tables, Structured Streaming, and MLflow. Drive a consistent multi-cloud Databricks strategy, enabling scalable and interoperable data platforms across environments. Optimise performance across … environment promotion. Embed robust data governance, security, and lifecycle controls, ensuring compliance through classification, encryption, access management, and lineage frameworks (e.g., Unity Catalog, Purview, Lake Formation). Act as a senior SME for troubleshooting complex issues, leading root-cause analysis and long-term remediation of data quality and platform ...