1 to 25 of 89 Delta Lake Jobs in the UK

Data Engineer

Hiring Organisation
Hunter Selection
Location
Birmingham, West Midlands, West Midlands (County), United Kingdom
Employment Type
Permanent
Salary
£50000 - £65000/annum 26 days holiday, health plan, bonus
Data Factory, Microsoft Fabric, Fabric, SQL, PostgreSQL, API, CI/CD, PowerBI, ETL, ELT, Data Engineer, Azure fundamentals, Fabric Data Engineer, ADF, ADL, Data Lake, Delta Lake, Azure Data Warehouse, Azure Data Factory, Microsoft Fabric, Fabric, SQL, PostgreSQL, API, CI/CD, PowerBI, ETL, ELT, Data Engineer … Azure fundamentals, Fabric Data Engineer, ADF, ADL, Data Lake, Delta Lake, Azure Data Warehouse, Azure Data Factory, Microsoft Fabric, Fabric, SQL, PostgreSQL, API, CI/CD, PowerBI, ETL, ELT, Data Engineer, Azure fundamentals, Fabric Data Engineer, ADF, ADL, Data Lake, Delta Lake, Azure Data ...

Python Data Engineer Azure & PySpark

Hiring Organisation
Brightbox GRP Ltd
Location
East London, London, United Kingdom
Employment Type
Contract
Contract Rate
£400 - £458 per day, Benefits remote
work involves developing and maintaining complex, test-driven data flows. You will be responsible for building scalable data pipelines using Python and PySpark, optimizing Delta Lake storage, and deploying solutions in a containerised Azure environment. Quality, maintainability, and automated testing are key to this role. What youll … flows with a strong focus on clean, testable Python code Writing unit and BDD tests using Behave, including mocking and patching Creating and optimizing Delta Lake tables for performance and reliability Working with Docker to support consistent development and deployment Integrating Azure services such as Azure Functions ...

Data Platform Engineer

Hiring Organisation
McCabe & Barton
Location
City of London, London, United Kingdom
Employment Type
Contract, Work From Home
Contract Rate
Up to £750 per day
data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible … deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Platform Engineer

Hiring Organisation
McCabe & Barton
Location
Central London, London, United Kingdom
Employment Type
Permanent, Work From Home
data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled … deployments. Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Glasgow, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Leeds, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Birmingham, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Bristol, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Manchester, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
London, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Belfast, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Cardiff, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
United Kingdom
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Maidstone, Kent, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Bedford, Bedfordshire, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Colchester, Essex, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Chesterfield, Derbyshire, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Woking, Surrey, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Basingstoke, Hampshire, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Ipswich, Suffolk, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Peterborough, Cambridgeshire, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Norwich, Norfolk, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Hemel Hempstead, Hertfordshire, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
Crawley, West Sussex, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...

Data Engineer

Hiring Organisation
Searches @ Wenham Carter
Location
High Wycombe, Buckinghamshire, UK
Employment Type
Full-time
batch and streaming data pipelines using Databricks (Apache Spark) • Build and optimize ETL/ELT workflows for large-scale structured and unstructured data • Implement Delta Lake architectures (Bronze/Silver/Gold layers) • Integrate data from multiple sources (databases, APIs, event streams, files) • Optimize Spark jobs for performance … Azure cloud services: o AWS: S3, EMR, Glue, Redshift, Lambda, IAM o Azure: ADLS Gen2, Azure Databricks, Synapse, Data Factory, Key Vault • Experience with Delta Lake, Parquet, and data modeling ...