21 of 21 Delta Lake Jobs in the South East

MDM Data Engineer

Hiring Organisation
Response Informatics
Location
South East, United Kingdom
Employment Type
Temporary Contract, On-site
Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records … survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement data quality, standardization, reconciliation, and validation processes. Support Unity Catalog, data lineage ...

Databricks Data Engineer

Hiring Organisation
Response Informatics
Location
South East, United Kingdom
Employment Type
Temporary Contract, On-site
Salary
£350 per day Inside IR35
Experience: 6–10+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus … survivorship rules. Integrate data from multiple source systems into the Databricks Lakehouse . Develop and optimize data pipelines using Databricks, PySpark, SQL, and Delta Lake . Build and enhance Bronze, Silver, and Gold data layers. Implement data quality, standardization, reconciliation, and validation processes. Support Unity Catalog, data lineage ...

Data Engineer

Location
Southampton, England, United Kingdom
engineering solutions. The role contributes to the continuous evolution of Quilter's cloud-based data platform, leveraging technologies including Azure Data Factory, Azure Data Lake Storage, Databricks, Azure Key Vault, Azure DevOps, and related Azure services. The successful candidate will demonstrate strong technical capability, a proactive approach to problem … Contribute to the delivery of analytical, operational, and regulatory data capabilities. Data Platform Engineering Develop and maintain solutions using Azure Data Factory, Azure Data Lake Storage, Databricks, Delta Lake, Azure Key Vault, and related Azure technologies. Support the ongoing enhancement of platform capabilities, standards, frameworks, and reusable ...

Staff BI & Data Engineer | Databricks

Hiring Organisation
Datatech
Location
Berkshire, United Kingdom
Employment Type
Permanent
Salary
£55000 - £67000/annum
supporting colleagues. What you'll do ·Build and optimise pipelines using Azure Databricks, PySpark, SQL, ADF and ADLS Gen2. ·Develop governed lakehouse solutions using Delta Lake, medallion architecture and Unity Catalog. ·Own Power BI semantic models, DAX measures and row-level security, ensuring reporting is accurate, secure …/CD. ·Mentor colleagues and share good practice across the team. What you'll bring ·Strong production experience with Databricks, PySpark, Delta Lake and Unity Catalog. ·Hands-on Power BI expertise, including data modelling, DAX, RLS and performance optimisation. ·Strong SQL skills and experience with Azure data services. ...

CDI Data Engineer

Hiring Organisation
Michael Page Technology
Location
Ascot, Berkshire, United Kingdom
Employment Type
Full-Time
Salary
£400.00 - £500.00 per day
deployment Worked across monitoring, logging and operational alerting Completed data-quality and reconciliation controls API/file/SFTP integration patterns Nice to have: Delta Lake/Delta MERGE Databricks Asset Bundles Azure DevOps MLOps/model deployment work history SFMC or Comarch integration Customer decisioning/ ...

Lead Data Engineer

Location
Southampton, England, United Kingdom
make sound engineering decisions. Strong communication skills, with the ability to explain complex technical concepts clearly to both technical and non‐technical audiences. Databricks Delta Lake, Unity Catalog, Workflows, Asset Bundles, Notebooks, Compute Management, Delta Live Tables, Spark Declarative Pipelines and platform optimisation. Microsoft Fabric Lakehouse, Data ...

Senior Data Engineer

Hiring Organisation
Hireful
Location
Central London, South East, United Kingdom
Employment Type
Permanent Contract, On-site
Salary
£89,999
extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing … growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. ...

Senior Data Engineer - Databricks

Hiring Organisation
Hireful
Location
Central London, South East, United Kingdom
Employment Type
Permanent Contract, On-site
Salary
£89,999
extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing … growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. ...

Databricks Solution Architect

Hiring Organisation
Experis
Location
South West London, South East, United Kingdom
Employment Type
Hybrid
patterns. Produce architecture artefacts including HLDs, LLDs, reference architectures, and technical governance documentation. Essential Skills & Experience Proven expertise with Databricks including: Databricks Lakehouse Architecture Delta Lake Unity Catalog Databricks Workflows Databricks SQL MLflow Data Governance and Security Strong cloud architecture experience within: Microsoft Azure (preferred) AWS or Google … Cloud Platform Deep understanding of: Data warehousing Data lake architectures Master Data Management (MDM) Data modelling and metadata management Data integration patterns Experience designing enterprise-scale analytics and business intelligence platforms. Strong stakeholder management and communication skills. Experience leading multi-disciplinary technical teams If you receive suspicious outreach claiming ...

Senior Digital Infrastructure & DevOps Engineer

Location
Oxford, England, United Kingdom
device data services (desirable) Experience with containerisation, Kubernetes, AKS, API management, application gateways, or equivalent cloud application hosting technologies (desirable) Experience with Databricks, Spark, Delta Lake, Unity Catalog, Azure Data Factory, SAP BW/4HANA, S/4HANA, OData, CDS views, CDC patterns, or equivalent enterprise data technologies ...

Azure Data Engineer

Hiring Organisation
Essential Recruitment
Location
South East, United Kingdom
Employment Type
Permanent Contract, On-site
Salary
£70,000
programme “from scratch” - In-depth experience of Azure Data Factory for designing, implementing and maintaining data pipelines - Detailed knowledge of data platform technologies including Delta Lake/Medallion Architecture - Strong experience of Azure Synapse and PySpark - Solid knowledge of the “data wrangling” operations within data platforms including reconciliations ...

Senior Data Engineer

Location
Horsham, England, United Kingdom
career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build robust … data engineering capability. Essential Skills & Experience Proven hands‐on experience building and supporting production‐grade data pipelines using Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ELT pipelines capable of handling ...

Data Engineer

Location
Milton Keynes, England, United Kingdom
Data Warehousing . Strong background in incident resolution, requests, changes and problem‐solving within SLAs. Hands‐on experience with Spark, Data Architecture, SQL and Delta Lake. Cloud development experience (AWS, GCP or Azure). Working knowledge of Medallion Architecture. Demonstrated capability in implementing and supporting pipelines in demanding environments. ...

Lead Product Owner, Data Platform

Location
Woking, England, United Kingdom
product, owning the full supply chain from instrument and edge ingestion, through modelling and governance, to exposure for AI, workflow, analytics and customer data lake consumers. You will drive a critical transformation: moving IDBS from a traditional electronic lab notebook capture tool to an enterprise Data Product Provider. That … product metrics. Deep understanding of modern lakehouse architecture, including medallion data tiers, transactional storage engines and change data capture patterns (for example Databricks and Delta Lake). Strong grasp of scientific data modelling, including unstructured to structured transformation, data contracts, schema evolution, ontologies and provenance standards (for example ...

CRM Technical Lead - MarTech

Hiring Organisation
Gazelle Global Consulting Ltd
Location
South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Negotiable
PECR, consent management and data governance requirements are met. Essential Skills: Hands-on experience with mParticle and Braze. Strong Databricks, SQL, Python, PySpark and Delta Lake. Experience with dbt and workflow orchestration tools. API, webhook and event-driven integrations. Technical leadership within MarTech or data engineering environments. Competitive contract ...

Databricks Engineer

Hiring Organisation
Gazelle Global Consulting Ltd
Location
City of London, South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Negotiable
performance optimisation. Key Responsibilities: Build and maintain Databricks Lakehouse platforms across development, testing and production environments. Develop data pipelines using PySpark, SQL and Delta Lake. Configure Unity Catalog, permissions, access controls and security policies. Implement CI/CD pipelines and automate platform deployments. Manage Databricks Jobs, Workflows and Declarative … incremental data processing. Optimise platform performance, monitoring and operational reliability. Key Skills: Strong hands-on experience with Databricks and PySpark. Excellent knowledge of Delta Lake and Lakehouse architecture. Experience with Unity Catalog, Autoloader and Structured Streaming. Knowledge of AWS S3, IAM, KMS, Glue and Lambda. Experience with ...

Databricks Data Engineer

Hiring Organisation
Response Informatics
Location
South East, United Kingdom
Employment Type
Temporary
Salary
GBP 350 Daily
Experience: 6-10+ Years Key Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse click apply ...

MDM Data Engineer

Hiring Organisation
Response Informatics
Location
South East, United Kingdom
Employment Type
Temporary
Salary
GBP Annual
Skills: MDM, Databricks, PySpark, SQL, Delta Lake, Unity Catalog, Data Quality, Data Governance Role Summary We are looking for an experienced MDM/Databricks Data Engineer to build scalable master data and integration solutions on a modern Databricks Lakehouse. The role will focus on common IDs, Golden Records ...

Senior Data Engineer

Hiring Organisation
Method-Resourcing
Location
South East, United Kingdom
Employment Type
Temporary
Salary
GBP 450 Daily
lookout for an experienced data consultant - supporting an existing specialist on the team with a key client. Skills needed: Azure Databricks (including Jobs & Workflows, Delta Lake, Unity Catalog, cluster management and Databricks APIs) A click apply for full job details ...

Senior Data Engineer

Hiring Organisation
Method-Resourcing
Location
South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Up to £450 per day
lookout for an experienced data consultant - supporting an existing specialist on the team with a key client. Skills needed: Azure Databricks (including Jobs & Workflows, Delta Lake, Unity Catalog, cluster management and Databricks APIs) Azure services such as ADLS Gen2, networking and Entra ID Strong Python experience ...

Information/Data Architect

Hiring Organisation
Gazelle Global Consulting Ltd
Location
South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Negotiable
designs, data flows and integration specifications. Provide technical leadership across architecture and engineering teams. Essential Skills: Strong AWS and Databricks expertise, including Lakehouse and Delta Lake. Extensive data modelling and enterprise data architecture experience. Supply chain planning, demand forecasting and inventory optimisation. Knowledge of SCOR, data mesh and event ...