76 to 100 of 132 Delta Lake Jobs in England

Principal Platform Architect

Location
Cambridge, England, United Kingdom
search platform that handles diverse query types (keyword, semantic, or hybrid) across large structured or semi-structured datasets. Hands-on experience with data lake, warehouse or lakehouse architectures at scale: Delta Lake or Apache Iceberg, schema evolution patterns, partition pruning, and the trade-offs between query performance ...

Databricks Consultant

Location
Leeds, England, United Kingdom
reusable frameworks and accelerators. What You’ll Be Doing Building production-grade data pipelines with Databricks, PySpark and SQL Developing Lakehouse architectures using Delta Lake, Unity Catalog and medallion frameworks Gathering requirements and providing technical guidance to client teams Embedding CI/CD, automated testing and Infrastructure ...

Lead Data Engineer - Perm up to £100k

Hiring Organisation
Lorien Resourcing Limited
Location
Manchester, North West, United Kingdom
Employment Type
Permanent Contract, Hybrid
Advanced Python, PySpark and SQL Production experience with Kafka or Amazon MSK, including Spark Structured Streaming Hands-on experience with Apache Iceberg or Delta Lake Strong data modelling and lakehouse design (bronze, silver, gold) Terraform, CI/CD and pipeline orchestration A track record of setting standards ...

Data Platform Manager

Hiring Organisation
Norton Rose Fulbright LLP
Location
Newcastle Upon Tyne, Tyne and Wear, United Kingdom
Employment Type
Full-Time
Salary
Competitive salary
Databricks and Fabric architecture, including Lakehouse patterns Ability to oversee ingestion, transformation and reporting layers across enterprise data flows Working knowledge of Databricks (Delta Lake, pipelines, orchestration) and Fabric (Power BI, semantic models) Experience in operating appropriate governance over data quality, lineage, access and cross-border data controls ...

Principal Data Solution Architect

Location
Manchester, England, United Kingdom
cloud databases Proven track record with complex data migration projects (terabyte+ datasets, multiple legacy source systems, structures and unstructured data) Proficiency with Parquet/Delta Lake or other modern data storage formats Experience with streaming architectures using Kafka, Event Hubs, or Kinesis for real-time data processing Knowledge ...

Senior Data Engineer

Location
Horsham, England, United Kingdom
career while helping customers unlock the power of their data. Responsibilities Design, build and optimise scalable data pipelines using Databricks, Apache Spark, PySpark and Delta Lake. Develop and implement modern Lakehouse architectures, applying Medallion (Bronze, Silver, Gold) design principles to support trusted and reusable data products. Build robust … data engineering capability. Essential Skills & Experience Proven hands‐on experience building and supporting production‐grade data pipelines using Databricks, PySpark, Spark SQL and Delta Lake. Experience designing and implementing Lakehouse architectures, including Medallion (Bronze, Silver, Gold) data models. Expertise in developing scalable ETL/ELT pipelines capable of handling ...

Databricks Solution Architect

Hiring Organisation
GIS Recruiter Ltd
Location
London, United Kingdom
Employment Type
Permanent
Salary
£90000 - £120000/annum Hybrid Working
Databricks platform experience. Extensive Azure Databricks architecture experience. Expert-level PySpark, Spark SQL and Python knowledge. Deep understanding of Apache Spark processing architecture. Extensive Delta Lake and Lakehouse architecture experience. Strong experience designing Medallion Architecture. Expert knowledge of Unity Catalog, governance, permissions and data lineage. Experience designing Databricks … workspaces, clusters, compute policies and networking. Knowledge of private endpoints, managed identities, Key Vault and secure connectivity. Experience with Azure Data Lake Storage Gen2, Azure Data Factory and Azure services. Public Sector Experience Extensive experience delivering enterprise data architectures Understanding of UK Government security principles and data governance requirements. ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
help the team do better and be better, again and again Write maintainable, testable code and enjoy providing code reviews Be experienced with Databricks, Delta Lake and Lakehouse architecture for efficient data management; experience with ETL processes and optimizing data pipelines for performance Be strong in Python ...

Software Engineer III - Data - Agentic Commerce

Location
Greater London, England, United Kingdom
Skills: Experience with agent frameworks (e.g., Google ADK, LangGraph) and agent protocols such as MCP, A2A, or AG-UI Experience with Databricks, MLflow, and Delta Lake or Apache Iceberg Exposure to model serving on Kubernetes and to model monitoring (drift, latency, accuracy) Familiarity with CRM platforms such ...

Lead Data Platform Engineer

Location
Greater London, England, United Kingdom
discussions, including vendor conversations and the technical sections of proposals Desirable Experience with NHS or other routine healthcare data at patient level Unity Catalog, Delta Lake and medallion structure, bronze to silver to gold Exposure to dbt and dimensional modelling Experience contributing to vendor or partner relationships, such ...

Junior Data Engineer

Location
Manchester, England, United Kingdom
from employment, education, an apprenticeship or personal projects. Experience with Microsoft Fabric or another cloud data platform. Familiarity with data warehouses, Lakehouses , PySpark or Delta Lake. Awareness of testing and CI/CD practices. Candidates do not need to meet every desirable criterion to apply. We are proud ...

Lead Product Owner, Data Platform

Location
Woking, England, United Kingdom
product, owning the full supply chain from instrument and edge ingestion, through modelling and governance, to exposure for AI, workflow, analytics and customer data lake consumers. You will drive a critical transformation: moving IDBS from a traditional electronic lab notebook capture tool to an enterprise Data Product Provider. That … product metrics. Deep understanding of modern lakehouse architecture, including medallion data tiers, transactional storage engines and change data capture patterns (for example Databricks and Delta Lake). Strong grasp of scientific data modelling, including unstructured to structured transformation, data contracts, schema evolution, ontologies and provenance standards (for example ...

Senior Software Engineer (AI/Data)

Location
Greater London, England, United Kingdom
Your code comes with tests, and you leave things tidier than you found them. Depth in at least one of SQL, Spark, Databricks/Delta Lake, Dagster/Airflow/Temporal or dbt. Bonus if you’ve shaped any of them into something a model can query, through ...

Data Platform Architect

Location
Greater London, England, United Kingdom
architecture governance decisions. PERSONAL PROFILE 7–10+ years in data platform architecture, data engineering, or cloud data infrastructure. Deep expertise in Databricks (Unity Catalog, Delta Lake, Spark, Databricks SQL) or equivalent Lakehouse platforms, including administration, cost management, and performance optimisation. Strong understanding of cloud-native architecture principles, cost ...

CRM Technical Lead - MarTech

Hiring Organisation
Gazelle Global Consulting Ltd
Location
South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Negotiable
PECR, consent management and data governance requirements are met. Essential Skills: Hands-on experience with mParticle and Braze. Strong Databricks, SQL, Python, PySpark and Delta Lake. Experience with dbt and workflow orchestration tools. API, webhook and event-driven integrations. Technical leadership within MarTech or data engineering environments. Competitive contract ...

Senior Software Engineer II - Data Onboarding & Reporting

Location
Greater London, England, United Kingdom
Must Haves (Hard Skills) Data Lakehouse Mastery: Proven experience building data infrastructure using Trino/Presto and open table formats like Apache Iceberg or Delta Lake. Advanced Data Modeling: Deep expertise in Medallion Architecture patterns, Star Schemas, and processing semi-structured financial data logs (JSON/Avro). Robust ...

Senior Data Engineer - Real-Time Trading Data & APIs

Location
Greater London, England, United Kingdom
seek engineers with multi-language skills and deep experience in Linux-based high-throughput environments, plus exposure to streaming platforms like Kafka and data lake technologies such as Delta Lake or Apache Iceberg. #J-18808-Ljbffr ...

Databricks Engineer

Hiring Organisation
Gazelle Global Consulting Ltd
Location
City of London, South East, United Kingdom
Employment Type
Temporary Contract, Hybrid
Salary
Negotiable
performance optimisation. Key Responsibilities: Build and maintain Databricks Lakehouse platforms across development, testing and production environments. Develop data pipelines using PySpark, SQL and Delta Lake. Configure Unity Catalog, permissions, access controls and security policies. Implement CI/CD pipelines and automate platform deployments. Manage Databricks Jobs, Workflows and Declarative … incremental data processing. Optimise platform performance, monitoring and operational reliability. Key Skills: Strong hands-on experience with Databricks and PySpark. Excellent knowledge of Delta Lake and Lakehouse architecture. Experience with Unity Catalog, Autoloader and Structured Streaming. Knowledge of AWS S3, IAM, KMS, Glue and Lambda. Experience with ...

Data Architect

Location
Greater London, England, United Kingdom
only. Multi-cloud platform depth (AWS and GCP): hands-on experience with data services across one or both of AWS (Redshift, Glue, S3/Lake Formation, MSK, RDS) and GCP (BigQuery, Dataflow, Pub/Sub, Cloud Composer). Data flow mapping and optimisation: demonstrable experience producing current-state data … serving, and GenAI/RAG architectures grounded in proprietary content. Lakehouse and modern data platform design: strong knowledge of open table formats (Apache Iceberg, Delta Lake), zone architecture (landing, cleansed, curated), streaming and batch pipeline patterns, and data quality frameworks. Project engagement and design assurance: able to engage ...

Information / Data Architect (Supply Chain)

Hiring Organisation
DCV Technologies
Location
Luton, Bedfordshire, United Kingdom
Employment Type
Contract
Contract Rate
£600 - £700/day - Hybrid / Inside IR35
Strong hands-on experience with AWS data services covering data ingestion, storage, processing, orchestration, security, and monitoring. Advanced knowledge of Databricks , including Lakehouse architecture, Delta Lake, and large-scale data engineering practices. Expertise in conceptual, logical, and physical data modelling, including dimensional modelling, relational modelling, and modern warehouse ...

Databricks Solution Architect

Location
Greater London, England, United Kingdom
Databricks experience who can operate at both architectural and engineering level. You should have strong experience across areas such as: Databricks Databricks Lakehouse Delta Lake Medallion Architecture Data Architecture Data Engineering Semantic Modelling/Semantic Layers Databricks Genie/AI/BI Conversational BI Unity Catalog Enterprise data ...

Data Engineer

Location
Greater London, England, United Kingdom
fixing performance bottlenecks in live systems through profiling and measurement. Nice to Have: Experience with PostgreSQL/pgvector, OpenSearch (or Elasticsearch), Spark/Delta Lake, AWS, NoSQL databases, or Rust/C++ is useful. The Founders You'll partner with a founding team of AI PhDs and elite ...

Senior Information Architect-London

Location
Greater London, England, United Kingdom
creation of data domains that align with the banks underlying capabilities Data Engineering & Platforms: Design data product schemas across Snowflake and Databricks, including Delta Lake structures and access patterns Define and enforce architectural guardrails for data product design, including performance, scalability, security, and cost efficiency Set design standards ...

Azure Databricks Engineer

Location
Greater London, England, United Kingdom
Disclosure and Barring Service)Mandatory SkillsAzure Databricks Platform EngineeringHands-on implementation and troubleshooting of Azure DatabricksDatabricks Serverless configuration and workload optimisationDatabricks SQL and Delta Lake developmentCluster management, compute policies, autoscaling, and workload monitoringData EngineeringStrong Python, PySpark, and SQL development skillsDesign and build ingestion and transformation pipelinesFull and incremental ...

Commercial Analytics Leader — UK & Global

Location
Greater London, England, United Kingdom
services using the below technologies: Python, pandas and SQL in Jupyter notebooks for analysis, and for scripting dbt and Databricks data platform with Delta Lake Lightdash as our BI tool and semantic layer Streamlit for interactive data applications Airflow/Orchestra for orchestration Kubernetes for application deployment ...