76 to 100 of 159 Delta Lake Jobs in the UK

AWS Data Engineer

Location
Greater London, England, United Kingdom
with business stakeholders and understand the broader context behind technical requirements. Nice-to-Have Skills Experience with Apache Iceberg or similar table formats (e.g., Delta Lake, Hudi). Familiarity with CI/CD platforms such as GitLab CI, Jenkins, or GitHub Actions. Exposure to data quality frameworks such ...

Senior Data Engineer

Location
Leeds, England, United Kingdom
writing and troubleshooting transformations, validation and reconciliation queries. Experience scheduling, monitoring and recovering pipelines using cloud‐native or equivalent orchestration tools. Experience with Delta Lake, including transactional tables, schema changes and repeatable batch loading. Experience using Terraform or equivalent infrastructure as code to provision and maintain consistent cloud ...

Senior Data Engineer

Hiring Organisation
Munich Re
Location
Greater London, United Kingdom
Employment Type
Full Time
Demonstrable data modelling experience, including practical experience with medallion architecture, and comfortable contributing technical input into modelling discussions alongside IT Experience with Databricks, including Delta Lake; familiarity with Unity Catalog and semantic layer/consumption-layer tooling is a plus (Power BI & Databricks Dashboards) Power BI experience, able ...

Azure ETL Architect

Location
United Kingdom
hands-on experience with Azure Data Factory. Hands on knowledge of the Microsoft Fabric architecture. Strong hands-on experience with Azure Databricks, PySpark, and Delta Lake. Proven experience architecting complex ETL/ELT data integration solutions. Strong experience working with XML, XSD schema validation, XPath, and XSLT transformations. Experience ...

Data Engineer

Location
United Kingdom
Databricks Lakehouse Platform to deliver clean, production-ready data for enterprise analytics. Job Requirements Strong proficiency in PySpark, Databricks SQL, T-SQL, and handling Delta Lake formats. Hands-on experience building production pipelines inside Databricks workspaces and Fabric capacities. Practical knowledge of structural data formats including Parquet, JSON … pipelines and implementing automated data quality checks. Job Responsibilities Construct scalable data ingestion pipelines using Fabric Data Factory, Dataflow Gen2, and Databricks Workflows. Implement Delta Live Tables (DLT) to automate batch and real-time streaming data processing. Build and maintain the Medallion Architecture silver & gold layer across shared storage. ...

DevOps Engineer - Fabric

Hiring Organisation
TALENT INTERNATIONAL UK LTD
Location
United Kingdom
Employment Type
Hybrid
Salary
£400.00 - £430.00 per day
workspace deployments. Data Engineering in Fabric: Develop and maintain data pipelines, build transformations using PySpark and SQL, and support ingestion workflows across OneLake and Delta Lake. Scripting and Tooling: Automate operational tasks and platform integrations using Python, Bash, PowerShell, and REST APIs. Cross-Functional Collaboration: Partner closely with platform … support cloud-based data solutions. What We're Looking For Microsoft Fabric and Data Ecosystem: Hands-on commercial experience with Microsoft Fabric, OneLake, Delta Lake, PySpark, and SQL. Infrastructure as Code (IaC): Proven track record managing Azure and/or Fabric resources via Terraform. CI/ ...

Software Engineer III - Cloud Data Platform Engineering (AWS , Terraform & Databricks)

Location
Greater London, England, United Kingdom
secure handling of inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications, capabilities, and skills Experience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open‐source frameworks Familiarity with AWS‐native data services such as Glue, Lake Formation, Redshift, or Athena ...

Mid DataOps Engineer

Hiring Organisation
eTeam Workforce Limited
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
GBP Daily
engineers, data engineers, architects and other client teams to design, implement and support cloud-based solutions. Technical Skills: Microsoft Fabric Date Engineering - Pyspark, SQL, Delta Lake, OneLake, data ingestion and transformation IaC - Terraform for provisioning and managing Azure and Fabric resources CI/CD - Azure DevOps, Gitlab ...

Data Engineer

Location
Manchester, England, United Kingdom
data solutions using Databricks, PySpark and SQL Integrating data from multiple source systems Supporting the development of Azure-based data infrastructure Creating and maintaining Delta Lake tables and workflows Improving data quality, monitoring and performance Working closely with analysts and business stakeholders to understand data requirements Contributing ...

Databricks Architect

Location
Greater London, England, United Kingdom
requirements appropriate for banking and financial-services environments. Key Requirements Databricks & Lakehouse Strong hands-on experience with: Databricks Notebooks PySpark DataFrame API SQL transformations Delta Lake Databricks Jobs, Job Flows, Workflows Declarative Pipelines (dpx files, pipeline definitions) Experience with Unity Catalog Databricks Autoloader and Structured Streaming Terraform ...

Data Engineer

Location
Leeds, England, United Kingdom
writing and troubleshooting transformations, validation and reconciliation queries. Experience scheduling, monitoring and recovering pipelines using cloud-native or equivalent orchestration tools. Experience with Delta Lake, including transactional tables, schema changes and repeatable batch loading. Experience using Terraform or equivalent infrastructure as code to provision and maintain consistent cloud ...

Senior Digital Infrastructure & DevOps Engineer

Location
Oxford, England, United Kingdom
device data services (desirable) Experience with containerisation, Kubernetes, AKS, API management, application gateways, or equivalent cloud application hosting technologies (desirable) Experience with Databricks, Spark, Delta Lake, Unity Catalog, Azure Data Factory, SAP BW/4HANA, S/4HANA, OData, CDS views, CDC patterns, or equivalent enterprise data technologies ...

Technical Lead – MarTech Development Team

Location
United Kingdom
engagement platforms, event tracking, identity resolution, and customer data models. Experience building and optimising batch and streaming data pipelines using SQL, Python, PySpark, and Delta Lake. Familiarity with dbt for data transformations and orchestration tools such as Airflow, Dagster, or Prefect. Experience designing and delivering secure, resilient API, webhook ...

Microsoft Fabric Data Engineers – Contract (3 months)

Location
Greater London, England, United Kingdom
experience delivering Microsoft Fabric platforms in production (OneLake, Fabric Lakehouse, Fabric Warehouse and Data Factory) Building medallion architectures from scratch PySpark, Python, SQL and Delta Lake Strong data modelling and transformation experience Power BI, Direct Lake, buidling semantic models Git integration, CI/CD and deployment pipelines ...

Principal Platform Architect

Location
Cambridge, England, United Kingdom
search platform that handles diverse query types (keyword, semantic, or hybrid) across large structured or semi-structured datasets. Hands-on experience with data lake, warehouse or lakehouse architectures at scale: Delta Lake or Apache Iceberg, schema evolution patterns, partition pruning, and the trade-offs between query performance ...

Databricks Consultant

Location
Leeds, England, United Kingdom
reusable frameworks and accelerators. What You’ll Be Doing Building production-grade data pipelines with Databricks, PySpark and SQL Developing Lakehouse architectures using Delta Lake, Unity Catalog and medallion frameworks Gathering requirements and providing technical guidance to client teams Embedding CI/CD, automated testing and Infrastructure ...

Macro Hive - Data Engineer

Location
Greater London, England, United Kingdom
Python and SQL, with experience in production-level ETL/ELT processes. In-depth knowledge of cloud data stack technologies, such as Azure, Databricks, Delta Lake, or Snowflake. Experience with time-series data and complex data structures, demonstrating an understanding of data quality and monitoring. Ability to clean ...

Data Platform Manager

Hiring Organisation
Norton Rose Fulbright LLP
Location
Newcastle Upon Tyne, Tyne and Wear, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
Databricks and Fabric architecture, including Lakehouse patterns Ability to oversee ingestion, transformation and reporting layers across enterprise data flows Working knowledge of Databricks (Delta Lake, pipelines, orchestration) and Fabric (Power BI, semantic models) Experience in operating appropriate governance over data quality, lineage, access and cross-border data controls ...

Principal Data Solution Architect

Location
Manchester, England, United Kingdom
cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge ...

Senior Data Engineer

Location
Horsham, England, United Kingdom
career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build robust … data engineering capability. Essential Skills & Experience Proven hands‐on experience building and supporting production‐grade data pipelines using Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ELT pipelines capable of handling ...

Databricks Solution Architect

Hiring Organisation
GIS Recruiter Ltd
Location
London, United Kingdom
Employment Type
Permanent
Salary
£90000 - £120000/annum Hybrid Working
Databricks platform experience. Extensive Azure Databricks architecture experience. Expert-level PySpark, Spark SQL and Python knowledge. Deep understanding of Apache Spark processing architecture. Extensive Delta Lake and Lakehouse architecture experience. Strong experience designing Medallion Architecture. Expert knowledge of Unity Catalog, governance, permissions and data lineage. Experience designing Databricks … workspaces, clusters, compute policies and networking. Knowledge of private endpoints, managed identities, Key Vault and secure connectivity. Experience with Azure Data Lake Storage Gen2, Azure Data Factory and Azure services. Public Sector Experience Extensive experience delivering enterprise data architectures Understanding of UK Government security principles and data governance requirements. ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
help the team do better and be better, again and again Write maintainable, testable code and enjoy providing code reviews Be experienced with Databricks, Delta Lake and Lakehouse architecture for efficient data management; experience with ETL processes and optimizing data pipelines for performance Be strong in Python ...

Software Engineer III - Data - Agentic Commerce

Location
Greater London, England, United Kingdom
Skills: Experience with agent frameworks (e.g., Google ADK, LangGraph) and agent protocols such as MCP, A2A, or AG-UI Experience with Databricks, MLflow, and Delta Lake or Apache Iceberg Exposure to model serving on Kubernetes and to model monitoring (drift, latency, accuracy) Familiarity with CRM platforms such ...

Senior Forward Deployed Engineer III, Data Cloud, Google Cloud

Location
City of Westminster, England, United Kingdom
BigQuery, Managed Service for Apache Spark, Dataflow) or with equivalent platforms (e.g., Databricks, Snowflake, Palantir Foundry), and with open table formats (e.g., Apache Iceberg, Delta Lake). Experience building applications on large language models over enterprise data (e.g., Gemini, agents, RAG, vector search) and evaluating them for quality ...

Lead Data Platform Engineer

Location
Greater London, England, United Kingdom
discussions, including vendor conversations and the technical sections of proposals Desirable Experience with NHS or other routine healthcare data at patient level Unity Catalog, Delta Lake and medallion structure, bronze to silver to gold Exposure to dbt and dimensional modelling Experience contributing to vendor or partner relationships, such ...