51 to 75 of 132 Delta Lake Jobs in England

Senior Full Stack Software Engineer

Hiring Organisation
MFK Recruitment
Location
London, England, United Kingdom
video visualisation, enhancement, rendering or tagging applications.Integrating AI, Machine Learning or computer vision products into customer-facing software.GIS applications or geo-referenced imagery.Data-lake or lakehouse technologies such as Delta Lake, Apache Iceberg, Apache Hudi, Databricks, Snowflake or AWS Lake Formation.Event-driven architectures using Kafka, RabbitMQ ...

Client-Facing Data Engineer

Location
Greater London, England, United Kingdom
outstanding interpersonal abilities. The responsibilities we’ll trust you with Designing and architecturing data lakehouse solutions using AWS cloud services (S3, Glue, Athena, Redshift, Lake Formation) Implementing robust data governance frameworks with particular attention to PII (Personally Identifiable Information) protection and regulatory compliance Managing data residency and territorial integrity … security officers, and legal advisors to ensure holistic solutions Your areas of knowledge and expertise Proven experience designing and implementing data lakehouse architectures (Databricks, Delta Lake, Apache Flink, or similar technologies) Strong, hands-on AWS cloud experience including services such as S3, Glue, Lake Formation, Athena ...

Lead Data Engineer

Hiring Organisation
Hackajob Ltd
Location
Solihull, West Midlands, United Kingdom
Employment Type
Permanent Contract, Hybrid
conceptual, logical, and physical), including lakehouse zone strategies and schema evolution approaches. Champion Databricks as the core data platform, leveraging lakehouse architecture, Unity Catalog, Delta Live Tables, Structured Streaming, and MLflow. Drive a consistent multi-cloud Databricks strategy, enabling scalable and interoperable data platforms across environments. Optimise performance across … environment promotion. Embed robust data governance, security, and lifecycle controls, ensuring compliance through classification, encryption, access management, and lineage frameworks (e.g., Unity Catalog, Purview, Lake Formation). Act as a senior SME for troubleshooting complex issues, leading root-cause analysis and long-term remediation of data quality and platform ...

Azure Data Engineer (Fabric & Cloud Data Platform)

Location
Greater London, England, United Kingdom
customer in Central London. Key Responsibilities Data Lakehouse Architecture: Design and optimize a high-performance lakehouse pattern utilizing Microsoft Fabric OneLake and Azure Data Lake Storage Gen2 (ADLS Gen2). Data Zone Management: Maintain architectural segregation between raw storage (immutability, landing) and curated data zones (cleansed, conformed business layers … OneLake, Data Factory, Fabric Lakehouse). Big Data Processing: Deep technical expertise with Apache Spark/Azure Databricks for distributed compute, memory optimization, and Delta Lake formats. Data Engineering Languages: Advanced proficiency in SQL (T-SQL, SparkSQL) and Python (PySpark). Security & Compliance: Direct experience implementing security controls ...

Senior Consultant Data Engineer

Location
Greater London, England, United Kingdom
reliability. Collaborate with analysts and AI engineers to deliver robust and reusable data products. Manage data lakes and warehouses using formats such as Delta Lake and Parquet. Implement best practices for data governance, performance, and security. Continuously evaluate and adopt new technologies to evolve Movar's data platform. ...

Senior Backend Engineer

Location
Greater London, England, United Kingdom
Experience with streaming or queuing systems (Kafka, Pub/Sub, SQS). Familiarity with AI/LLM systems and agentic workflow integration. Experience with Delta Lake, Unity Catalog, or other lakehouse governance and optimization tools. Prior experience with API gateway architectures, caching layers, or service meshes. Full stack ...

Senior Platform Engineer - Azure Data & AI Platform

Location
City Of London, England, United Kingdom
aggregation patterns) Strongly Preferred Experience with Azure landing zones and CAF (Cloud Adoption Framework) Microsoft Purview for data governance and cataloging Experience with Delta Lake, Spark optimization, data quality frameworks Azure networking certifications or equivalent deep knowledge Container orchestration (AKS) API design and management (API Management, App Gateway ...

Databricks Solution Architect

Location
Greater London, England, United Kingdom
patterns. Produce architecture artefacts including HLDs, LLDs, reference architectures, and technical governance documentation. Essential Skills & Experience Proven expertise with Databricks including: Databricks Lakehouse Architecture Delta Lake Unity Catalog Databricks Workflows Databricks SQL MLflow Data Governance and Security Strong cloud architecture experience within: Microsoft Azure (preferred) AWS or Google … Cloud Platform Deep understanding of: Data warehousing Data lake architectures Master Data Management (MDM) Data modelling and metadata management Data integration patterns Experience designing enterprise-scale analytics and business intelligence platforms. Strong stakeholder management and communication skills. Experience leading multi-disciplinary technical teams #J-18808-Ljbffr ...

Databricks Solution Architect

Hiring Organisation
Experis
Location
South West London, South East, United Kingdom
Employment Type
Hybrid
patterns. Produce architecture artefacts including HLDs, LLDs, reference architectures, and technical governance documentation. Essential Skills & Experience Proven expertise with Databricks including: Databricks Lakehouse Architecture Delta Lake Unity Catalog Databricks Workflows Databricks SQL MLflow Data Governance and Security Strong cloud architecture experience within: Microsoft Azure (preferred) AWS or Google … Cloud Platform Deep understanding of: Data warehousing Data lake architectures Master Data Management (MDM) Data modelling and metadata management Data integration patterns Experience designing enterprise-scale analytics and business intelligence platforms. Strong stakeholder management and communication skills. Experience leading multi-disciplinary technical teams If you receive suspicious outreach claiming ...

Senior Software Engineer, C/FICCO Data

Location
Greater London, England, United Kingdom
skills - you communicate clearly with stakeholders as well as other engineers, fostering a collaborative, supportive working environment Experience in the financial markets, especially in delta one, store of value, and/or FICC options trading Experience with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline … orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more information about DRW's processing activities ...

Forward Deployed Engineer – Enterprise Data & Databricks

Location
Greater London, England, United Kingdom
Engineering, Data Science or a related field. Strong experience in enterprise data architecture, data engineering and advanced data modelling. Hands-on expertise with Databricks, Delta Lake, Unity Catalog and Databricks Workflows. Production experience with SQL, Python/PySpark, and dbt and/or Spark Declarative Pipelines. A solid ...

Data/AI engineer with Python

Location
Greater London, England, United Kingdom
delivery environments. Strong communication skills and ability to interact efficiently with various stakeholder groups including business users. Nice to have Experience with Databricks, Spark, Delta Lake, or similar modern data engineering platforms. Experience designing enterprise data lakes, lakehouses, or large-scale analytical platforms. Domain experience within Investment Management ...

Data Engineering Manager

Location
Greater London, England, United Kingdom
leading multi-disciplinary engineering teams. Solid understanding of the software and data delivery lifecycle. Technical Skills Strong experience with Databricks (PySpark/Spark SQL, Delta Lake, Unity Catalog, medallion architecture, Databricks Workflows). Working knowledge of Microsoft Dynamics 365 data structures, Dataverse, and common integration patterns (Synapse Link ...

Senior Data Engineer

Location
Greater London, England, United Kingdom
production. You know MergeTree schema and sort-key design, materialised views, bulk loads and query tuning. Databricks in production. You have worked with PySpark, Delta Lake and Unity Catalog, designed incremental and idempotent tables, and kept an eye on compute cost. Large-scale data. You have hands ...

Consultant Data & AI Architect IRC303856

Location
Manchester, England, United Kingdom
time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge of Databricks/Snowflake environments, including Unity Catalog, workspaces, Delta Lake, and networking/security (VPNs, Private Links, Firewalls) and/or Snowflake Platform including Cortex, Horizon and Snowpark. Advanced proficiency in Azure ...

Consultant Data & AI Architect IRC303856

Location
Greater London, England, United Kingdom
time streaming, and CI/CD pipelines (Git, Terraform, Databricks Asset Bundles). Deep knowledge of Databricks/Snowflake environments, including Unity Catalog, workspaces, Delta Lake, and networking/security (VPNs, Private Links, Firewalls) and/or Snowflake Platform including Cortex, Horizon and Snowpark. Advanced proficiency in Azure ...

AWS Data Engineer

Location
Greater London, England, United Kingdom
with business stakeholders and understand the broader context behind technical requirements. Nice-to-Have Skills Experience with Apache Iceberg or similar table formats (e.g., Delta Lake, Hudi). Familiarity with CI/CD platforms such as GitLab CI, Jenkins, or GitHub Actions. Exposure to data quality frameworks such ...

Senior Data Engineer

Location
Leeds, England, United Kingdom
writing and troubleshooting transformations, validation and reconciliation queries. Experience scheduling, monitoring and recovering pipelines using cloud‐native or equivalent orchestration tools. Experience with Delta Lake, including transactional tables, schema changes and repeatable batch loading. Experience using Terraform or equivalent infrastructure as code to provision and maintain consistent cloud ...

Senior Data Engineer

Hiring Organisation
Munich Re
Location
London, England, United Kingdom
Demonstrable data modelling experience, including practical experience with medallion architecture, and comfortable contributing technical input into modelling discussions alongside IT Experience with Databricks, including Delta Lake; familiarity with Unity Catalog and semantic layer/consumption-layer tooling is a plus (Power BI & Databricks Dashboards) Power BI experience, able ...

Software Engineer III - Cloud Data Platform Engineering (AWS , Terraform & Databricks)

Location
Greater London, England, United Kingdom
secure handling of inputs/outputs, and adherence to resiliency and security expectations Preferred qualifications, capabilities, and skills Experience with data lakehouse architectures using Delta Lake, Apache Spark, or similar open‐source frameworks Familiarity with AWS‐native data services such as Glue, Lake Formation, Redshift, or Athena ...

Data Engineer

Location
Manchester, England, United Kingdom
data solutions using Databricks, PySpark and SQL Integrating data from multiple source systems Supporting the development of Azure-based data infrastructure Creating and maintaining Delta Lake tables and workflows Improving data quality, monitoring and performance Working closely with analysts and business stakeholders to understand data requirements Contributing ...

Principal AI Data Engineer : Commodity Trading

Hiring Organisation
Eaglecliff Recruitment
Location
London, England, United Kingdom
ready solutionsCore Experience Required: • 8-12 years of experience • Strong hands-on experience in AI, GenAI and data engineering• Advanced knowledge of Databricks, MLflow, Delta Lake and data architecture• Strong Python and SQL programming skills• Experience with LLMs, RAG architectures, AI agents, LangChain and LangGraph• Understanding of data ...

Databricks Architect

Location
Greater London, England, United Kingdom
requirements appropriate for banking and financial-services environments. Key Requirements Databricks & Lakehouse Strong hands-on experience with: Databricks Notebooks PySpark DataFrame API SQL transformations Delta Lake Databricks Jobs, Job Flows, Workflows Declarative Pipelines (dpx files, pipeline definitions) Experience with Unity Catalog Databricks Autoloader and Structured Streaming Terraform ...

Data Engineer

Location
Leeds, England, United Kingdom
writing and troubleshooting transformations, validation and reconciliation queries. Experience scheduling, monitoring and recovering pipelines using cloud-native or equivalent orchestration tools. Experience with Delta Lake, including transactional tables, schema changes and repeatable batch loading. Experience using Terraform or equivalent infrastructure as code to provision and maintain consistent cloud ...

Senior Digital Infrastructure & DevOps Engineer

Location
Oxford, England, United Kingdom
device data services (desirable) Experience with containerisation, Kubernetes, AKS, API management, application gateways, or equivalent cloud application hosting technologies (desirable) Experience with Databricks, Spark, Delta Lake, Unity Catalog, Azure Data Factory, SAP BW/4HANA, S/4HANA, OData, CDS views, CDC patterns, or equivalent enterprise data technologies ...