26 to 50 of 159 Delta Lake Jobs in the UK

Application Developers | Data engineers

Location
United Kingdom
GitHub Actions, GIT, Artifactory, SonarPreferred Qualifications:Bachelor’s degree in Computer Science, Engineering, Mathematics or related disciplineExtensive knowledge of data architecture principles (e.g., Data Lake, Databricks Delta Lake, Data Warehousing, etc.)Extensive knowledge of data modelling techniques including slowly changing dimensions, aggregation, partitioning and indexing strategiesExperience working ...

Principal Data Engineer

Location
Manchester, England, United Kingdom
scope to drive data democratisation, governance maturity and AI-readiness across the firm.## **What you will be doing** * Design and maintain scalable, secure data lake and lakehouse solutions using Azure Data Lake, Databricks and Delta Lake — built to support real-time insight, advanced analytics … validation, logging and monitoring to catch issues early and keep the platform reliable. **Key Requirements** * Experience in data engineering, including designing and delivering data lake or lakehouse architectures in an enterprise cloud environment, ideally Microsoft Azure.* Hands-on expertise with Databricks, Spark, PySpark, SQL and core Azure Data Services ...

Senior Data Engineering Consultant

Location
United Kingdom
writing complex high-performance queries, understanding how queries execute on different compute technologies Azure Data Factory or other cloud orchestration tools Azure Data Lake storage and Delta Lake Unity Catalog, Purview or other Data Governance tools IAC tool such as Terraform, Azure DevOps Other technology we like ...

Data Engineer

Location
United Kingdom
support API, file-based and SFTP integration patterns Technical design preparation and structured testing support Preferred Qualifications Exposure to reporting or Power BI datasets Delta Lake or Delta MERGE knowledge Databricks Asset Bundles experience Azure DevOps experience MLOps or model deployment experience Knowledge of SFMC or Comarch ...

CDI Data Engineer

Hiring Organisation
Michael Page Technology
Location
Ascot, Berkshire, United Kingdom
Employment Type
Full-Time
Salary
£400.00 - £500.00 per day
deployment Worked across monitoring, logging and operational alerting Completed data-quality and reconciliation controls API/file/SFTP integration patterns Nice to have: Delta Lake/Delta MERGE Databricks Asset Bundles Azure DevOps MLOps/model deployment work history SFMC or Comarch integration Customer decisioning/ ...

Principal Data Engineer

Location
Greater London, England, United Kingdom
extensive experience with workflow orchestration tools (e.g., Apache Airflow, Dagster). Hands-on expertise with cloud data warehouses (e.g., Snowflake, BigQuery, Redshift) and data lake architectures (e.g., Databricks, Delta Lake, Apache Iceberg). Advanced SQL skills and proficiency in Python. Strong background in modern software development practices ...

Lead Architect, Data & AI Platforms

Location
Greater London, England, United Kingdom
other teams can pick up and run, rather than as documents. Azure-First Data Platforms : Deep architecture and build experience on Microsoft Azure (Data Lake/Lakehouse patterns, ADLS Gen2, Synapse Analytics, Azure Databricks, Delta Lake), with enough hands-on AWS or Google Cloud Platform (GCP) experience … Lead Azure-First Platform Architecture : Architect and implement Azure data platforms for clients, including landing zones, networking, identity, and data platform services (Azure Data Lake Storage, Synapse, Databricks), extending patterns to AWS or GCP where a client estate requires it. Design & Build Data Pipelines : Design, Implement key data ingress ...

Senior Data Engineer

Location
Manchester, England, United Kingdom
scalable, maintainable, and aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

Lead Data Engineer

Location
Southampton, England, United Kingdom
make sound engineering decisions. Strong communication skills, with the ability to explain complex technical concepts clearly to both technical and non‐technical audiences. Databricks Delta Lake, Unity Catalog, Workflows, Asset Bundles, Notebooks, Compute Management, Delta Live Tables, Spark Declarative Pipelines and platform optimisation. Microsoft Fabric Lakehouse, Data ...

Senior Data Engineer

Location
City Of London, England, United Kingdom
Unifeye. What You'll Do Design and build scalable batch and streaming data pipelines using Spark and Databricks. Develop modern Lakehouse architectures using Delta Lake and Medallion (Bronze, Silver and Gold) design principles. Build robust ingestion frameworks from APIs, files and streaming data sources. Ensure data quality, testing … data platforms using Databricks or an equivalent Spark-based platform. Strong SQL skills and experience with data modelling. Good understanding of Lakehouse architecture and Delta Lake. Experience working with AWS, Azure or GCP. Experience implementing CI/CD, version control and deployment automation. Strong communication skills and experience working ...

Data Engineer

Location
Greater London, England, United Kingdom
Unifeye. What You'll Do Design and build scalable batch and streaming data pipelines using Spark and Databricks. Develop modern Lakehouse architectures using Delta Lake and Medallion (Bronze, Silver and Gold) design principles. Build robust ingestion frameworks from APIs, files and streaming data sources. Ensure data quality, testing … data platforms using Databricks or an equivalent Spark-based platform. Strong SQL skills and experience with data modelling. Good understanding of Lakehouse architecture and Delta Lake. Experience working with AWS, Azure or GCP. Experience implementing CI/CD, version control and deployment automation. Strong communication skills and experience working ...

Sr. Snowflake Architect

Location
City of Edinburgh, Scotland, United Kingdom
cloud platforms (AWS, Azure, or GCP) including Snowflake deployment, networking (Private Link), and cloud storage integration (S3, ADLS, GCS); familiarity with lakehouse stacks (Databricks, Delta Lake, Apache Iceberg) is a plus.Mastery of Snowflake security and governance: RBAC, tag-based governance, dynamic data masking, row access policies, column-level ...

Data Technical Lead

Location
Greater London, England, United Kingdom
Snowflake and cloud-native data services Data architecture:Lakehouse, medallion, datameshand domain-oriented patterns Data processing:Apache Spark,SQLand distributed processing technologies Data storage:Delta Lake, ApacheIcebergand open table formats Data pipelines:Enterprise-scale ETL/ELT,batchand streaming patterns Transformation and quality:dbt, Great Expectations and equivalent ...

Lead Data Tester

Location
Southampton, England, United Kingdom
their business impact. Clear communication of test progress, coverage, defects and residual risks to technical and non‐technical stakeholders. Databricks: Practical testing skills across Delta Lake, Unity Catalog, Workflows, Asset Bundles, Notebooks, Compute Management, Delta Live Tables and Spark Declarative Pipelines, including data integrity and performance validation. ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
ongoing enhancement and modernisation of enterprise data platforms Databricks & Data Platform Engineering Develop and support Databricks-based data solutions and Lakehouse architectures Utilise Delta Lake and Spark technologies to deliver scalable data processing capabilities Optimise distributed data processing workloads for performance and reliability Implement data quality controls ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
tested code for production data workloads. Practical experience building and optimising distributed data processing workloads using Spark and Databricks, or comparable platforms. Experience with Delta Lake or comparable lakehouse technologies, including notebooks, workflows and reliable production deployment. Experience delivering and operating data solutions on at least one major ...

Senior Data Scientist

Location
Greater London, England, United Kingdom
settlement). Proven experience designing and running a cloud data platform end to end, ideally on Databricks and Azure (e.g. ADLS, Unity Catalog, Delta Lake). Expert-level proficiency in Python, SQL and PySpark. Experience working with high-volume time-series data, such as SCADA or asset telemetry. ...

Principal AI Data Engineer - GenAI & Agentic AI

Location
Greater London, England, United Kingdom
projectsDeep understanding of large language model families, including GPT, Llama, Claude and Mistral, and their reasoning capabilitiesStrong hands-on experience with Databricks, including Delta Live Tables (DLT), Delta Lake concepts and Unity Catalog governanceSolid understanding of streaming technologies, including Spark Structured Streaming and Auto LoaderStrong programming skills ...

Lead Data Engineer

Location
Manchester, England, United Kingdom
Apache Kafka or Amazon MSK, including stream processing with Spark Structured Streaming. Hands‐on experience with open table formats, such as Apache Iceberg or Delta Lake, including partitioning, schema evolution and table maintenance at scale. Experience with pipeline orchestration and infrastructure‐as‐code using Terraform. Experience acting ...

Senior Solution Architect, Data & AI

Location
Manchester, England, United Kingdom
batch, streaming, change data capture (CDC), ETL/ELT and orchestration. A good understanding of relational and non‐relational databases, open table formats (e.g. Delta Lake, Apache Iceberg), and data storage and lifecycle design. Practical knowledge of data governance, including cataloguing, lineage, data quality, ownership, classification and access ...

Senior Solution Architect, Data & AI

Location
City Of London, England, United Kingdom
batch, streaming, change data capture (CDC), ETL/ELT and orchestration. A good understanding of relational and non-relational databases, open table formats (e.g. Delta Lake, Apache Iceberg), and data storage and lifecycle design. Practical knowledge of data governance, including cataloguing, lineage, data quality, ownership, classification and access ...

Data Architect

Location
Brentford, England, United Kingdom
least 3 years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience … configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises and Azure ...

Data Architect

Location
Manchester, England, United Kingdom
least 3 years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience … configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises and Azure ...

Data Architect

Hiring Organisation
Staffworx Limited
Location
United Kingdom
Employment Type
Temporary Contract, Remote
Salary
market rates, outside IR35
level discussion and technical detail Hands on implementation experience, ideally from a data engineering or developer background Databricks at architecture level on Azure, including Delta Lake, Unity Catalog and Spark optimisation Lakehouse and medallion patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. … Dimensional and data vault both useful Advanced SQL, Python or PySpark Declarative pipelines (Delta Live Tables or equivalent), Databricks Workflows, Auto Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Azure DevOps or GitHub Actions, Databricks ...

Senior Data Engineer

Hiring Organisation
Hireful
Location
Leeds, Yorkshire, United Kingdom
Employment Type
Permanent Contract, On-site
Salary
£89,999
extensive benefits package. What you'll be doing Design, build and maintain scalable data pipelines and data products using Databricks , PySpark, Spark SQL and Delta Lake. Develop and optimise ETL/ELT processes to ingest, transform and curate data from internal and external systems. Shape enterprise data architecture, balancing … growing data function. What you need to bring “Senior” level experience in data engineering, with strong hands-on Databricks skills (PySpark, Spark SQL, Delta Lake, etc) Advanced SQL and Python coding skills. A track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions. ...