15 of 15 Contract Delta Lake Jobs in England

Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records … survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement data quality, standardization, reconciliation, and validation processes. Support Unity Catalog, data lineage ...

Experience: 6–10+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus … survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement data quality, standardization, reconciliation, and validation processes. Support Unity Catalog, data lineage ...

data engineers, own the technical architecture and stay hands-on in development. What you'll do Architect and build the platform on Azure Databricks (Delta Lake, Unity Catalog, medallion architecture) Use AI agents and LLMs to reverse-engineer legacy reports, queries and transformations, and build repeatable AI-assisted … processes for code generation, testing and migration Build automated testing and reconciliation to validate migrated data against existing reporting Integrate SAP, Azure Data Lake, Salesforce and other systems, and design gold-layer models for Power BI Set engineering standards (Workflows, CI/CD, IaC, governance) and mentor the team ...

powered solutions and using tools like GitHub Copilot, Claude Code or Cursor day to day, with real examples Tech: Azure, ADF, Synapse, Databricks, Delta Lake, Spark, Terraform, Data Vault, LLM APIs, RAG, agentic frameworks If you're a UK-based data engineer with consultancy experience and a practical ...

extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing … growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. ...

extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing … growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. ...

extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing … growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. ...

conceptual, logical, and physical), including lakehouse zone strategies and schema evolution approaches. Champion Databricks as the core data platform, leveraging lakehouse architecture, Unity Catalog, Delta Live Tables, Structured Streaming, and MLflow. Drive a consistent multi-cloud Databricks strategy, enabling scalable and interoperable data platforms across environments. Optimise performance across … environment promotion. Embed robust data governance, security, and lifecycle controls, ensuring compliance through classification, encryption, access management, and lineage frameworks (e.g., Unity Catalog, Purview, Lake Formation). Act as a senior SME for troubleshooting complex issues, leading root-cause analysis and long-term remediation of data quality and platform ...

processes Experience supporting Generative AI solutions, including RAG architectures, vector search, LLM integration, AI orchestration, or agentic workflows Databricks experience, including Unity Catalog, MLflow, Delta Lake, Lakehouse architecture, and AI tooling Experience working within secure, regulated, or government environments Exposure to large-scale enterprise data and AI platforms ...

programme “from scratch” - In-depth experience of Azure Data Factory for designing, implementing and maintaining data pipelines - Detailed knowledge of data platform technologies including Delta Lake/Medallion Architecture - Strong experience of Azure Synapse and PySpark - Solid knowledge of the “data wrangling” operations within data platforms including reconciliations ...

Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/CD and pipeline orchestration A track record of setting standards ...

Strong hands-on experience with AWS data services covering data ingestion, storage, processing, orchestration, security, and monitoring. Advanced knowledge of Databricks , including Lakehouse architecture, Delta Lake, and large-scale data engineering practices. Expertise in conceptual, logical, and physical data modelling, including dimensional modelling, relational modelling, and modern warehouse ...

reviews and stakeholder workshops, providing technical assurance and direction to delivery teams. Essential Strong architecture experience delivering enterprise Databricks and Lakehouse solutions. Expertise in Delta Lake, Unity Catalog and modern data engineering patterns. Experience integrating Databricks with AWS, including relevant storage, identity and networking services. A strong background ...

lookout for an experienced data consultant - supporting an existing specialist on the team with a key client. Skills needed: Azure Databricks (including Jobs & Workflows, Delta Lake, Unity Catalog, cluster management and Databricks APIs) Azure services such as ADLS Gen2, networking and Entra ID Strong Python experience ...

designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR, data mesh and event ...