1 to 25 of 61 Data Lake Jobs in London

Role: Contract Business Analyst Project: Trading Data Platform (Data Lake & Data Warehouse) Industry: Energy & commodities trading Location: London (hybrid 3 days per week) Rate: £700–800/d (inside IR35) Contract: 6 months initial (multiyear scope) X4 Technology are partnered with a leading … This role sits within a strategic data platform initiative focused on the design and build of a cloud-based data lake and enterprise data warehouse, creating a scalable, governed single source of truth for trading, risk and commercial data across ...

Introduction At Gallagher Re, we bring clarity to complexity by helping clients around the world make confident, data-driven decisions in a rapidly evolving risk landscape. Here, youll be part of a team that leverages world-class analytics and deep reinsurance expertise to deliver strategic advisory services … career, and collaborate with people who are as driven and inquisitive as you are. Overview At Gallagher Re, we are seeking an experienced Data Platform and Design Lead to establish and evolve the core fundamentals of our Data Platform. This platform will support operational, transactional ...

Role Overview The role is responsible for designing, building & maintaining robust data architectures that integrate SAP and non-SAP systems to support enterprise-wide data management, analytics, and reporting needs. This role ensures seamless data flow, integrity, and accessibility across diverse platforms while aligning … PowerBI, SAP BOBJ, Bex, SAP analytics etc with good knowledge on some of those systems. · Good to know: Modern cloud-based data lake houses such as Databricks · Run/Support RFP/software selection evaluation Technical Skills · 15+ years of experience with strong expertise ...

more Chinese jobs please follow us on WeChat: teamchinapf AND pfteamchina Ref: 23377 The Skills You'll Need: Mandarin and English fluent, solid data management experiences within banking. Your New Salary: Competitive + Bonus + Benefits Fully office based Permanent Office based: London Start: ASAP Reports to: Head … report automation and process management tools Should be able to read and write SQL Should understand the architecture and concept of data lake and data warehouse related knowledge and design Must be proactive and analytical to evaluate and solve problems independently Must be able ...

IMMEDIATE JOINERS !! 💻 DATA ENGINEER (Python & SQL Focus) 📊 We're looking for an enthusiastic and detail-oriented Junior Big Data Developer to join our data engineering team. This role is ideal for an early-career professional with foundational knowledge in data processing, strong … distributed computing framework like Apache Spark (using PySpark). Familiarity with cloud data services ( AWS S3/Redshift, Azure Data Lake/Synapse, or Google BigQuery/Cloud Storage ). Exposure to workflow orchestration tools ( Apache Airflow, Prefect, or Dagster ). Bachelor's degree ...

architecture design for projects, producing Data Architecture Assessments Design and deliver cloud data architectures using Azure Data Lake, Azure Data Factory, Synapse, SQL and related services Lead project-level data architecture, defining data models, flows, integrations … with hands-on experience delivering enterprise data models Strong hands-on experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, Databricks or Fabric Expertise in conceptual and logical data modelling, ideally using UML Deep understanding of Azure-aligned data ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

This is a rare opportunity to apply serious data engineering in a domain where latency, correctness, and reliability carry direct commercial weight. * Requirements * 6+ years data engineering in production environments; Python expertise - idiomatic, well-tested, production-grade code, not notebook scripts * ETL/ELT pipeline design … retry, and exactly-once semantics * Azure data platform - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, Azure Data Lake Storage; infrastructure as code for data workloads (Terraform or Bicep) * Databricks - Delta Lake, Unity Catalog, job cluster vs interactive cluster trade ...

client is an international bank seeking a Data Management Officer to join its London-based IT function, supporting critical data governance and data security initiatives across the business. This is a hands-on role operating at the intersection of data, regulation … technology, working closely with Finance, Compliance, and broader business teams to embed robust data management practices across the organisation. Key Responsibilities * Support the implementation of group-wide data governance frameworks and standards * Assist in building and enhancing data quality frameworks, monitoring, and reporting mechanisms ...

Associate Director, Master Data Management Solution Architect, Engineering, AI & Data, Technology & Transformation Basic information Location London Business Line Job Type Permanent/FTC Date published 10-Dec-2025 Connect to your Industry Do you want to be at the heart of some of the biggest … reference data management, and stewardship workflows Strong proficiency with cloud-native data services (Azure Purview/ADF, AWS Glue/Lake Formation, GCP DataPlex) and modern integration technologies (APIs, streaming, ETL/ELT). Solid understanding of data governance, data lineage ...

critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. ...

sources Design and manage Purview scans, collections, and data maps for structured platforms including Azure SQL, Synapse, and Azure Data Lake Configure classifications, sensitivity labels, business metadata, and lineage for structured datasets Support the definition and implementation of structured data governance operating models … data governance use cases Proven experience working with structured data platforms such as Azure SQL, Azure Synapse, Data Lake Gen2, or similar Solid understanding of structured data concepts including relational models, data warehouses, and analytics architectures Experience designing ...

seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London with hybrid working. Key Responsibilities Design and build robust data … Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using Azure Data Lake Storage Implement Databricks solutions using Delta Lake and medallion architecture (bronze, silver, gold) Optimise performance ...

Responsibilities Enterprise Data Modelling Standards Define and own a group‐wide data modelling standard, including Star Schema patterns, Snowflake object hierarchies, and modelling conventions that underpin all analytical and operational data products. Cross‐Cloud Data Orchestration Design and implement secure, high‐throughput … data build tool) or comparable transformation and orchestration frameworks. Cloud & AWS Integration Strong understanding of AWS IAM, S3‐based data lake architectures, and PrivateLink or equivalent patterns for secure cross‐cloud connectivity. AI & ML Enablement Practical experience designing data infrastructure to support ...

Join the Chief Data & Analytics Office at JPMorganChase and help accelerate our data and analytics journey. You will lead complex, multi-functional technology projects that impact clients, employees, and stakeholders firmwide. Bring your technical fluency and analytical reasoning to drive innovative solutions, manage resources, and foster … data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills Experience navigating complex data governance, security ...

Data Solutions Architect Salary: £90K - £100K London (Hybrid) At Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability … work independently in a remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking ...

Data Engineer – Azure or AWS with Databricks - London (Hybrid) - £75,000 + benefits We’re partnering with a high-performing organisation that continues to invest heavily in its data capability. Over the last 24 months, the business has achieved 33% growth in its data … building end-to-end data pipelines using Databricks on Azure or AWS Developing modern lakehouse architectures using: Databricks (Spark, SQL, Delta Lake) Azure Data Lake Storage or Amazon S3 Writing high-quality PySpark, Python, and SQL for ingestion, transformation, and modelling Implementing Bronze/ ...

code agentic workflow platform — while simultaneously owning the data and model foundations that power them: the Sidetrade Data Lake, our ML model portfolio, and our LLM fine-tuning strategy. About Sidetrade: Sidetrade is an AI company, listed on Euronext Growth, on a mission to revolutionize … compose intelligent O2C workflows using agentic AI — without writing a line of code. Own the product strategy for the Sidetrade Data Lake — defining how data assets are structured, enriched, governed, and surfaced across all O2C domains, driving continuous improvement across Gold, Silver, and Bronze data ...

Title: Snowflake/Data Architect Salary: Paying up to £90,000 per annum Location: Wembley London - 5 days on-site Our client, a well-established and diversified multinational organisation, is seeking a Snowflake/Data Architect to join their team. Skills Solid experience in Data … experience with dbt (data build tool) or equivalent transformation frameworks. AWS Integration : Solid understanding of AWS IAM, S3 data lake patterns, and PrivateLink for cross-cloud data connectivity. AI Readiness : Practical experience architecting data infrastructure for AI/ML consumption - vector ...

Data Engineer – London – Databricks – Azure – 75k + bonus + benefits I’m currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they’ve established themselves … forefront of your field. What You’ll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines What you’ll do Design and implement ...

This role is responsible for designing, building, and operating robust cloud-based data platforms that support large-scale analytics and reporting. You will work across the full data lifecycle, partnering closely with technical and non-technical stakeholders to deliver reliable, secure, and scalable data … structured and unstructured data, ensuring high standards of data quality and integrity Design and implement cloud-based data lake and data warehousing architectures Create and maintain analytical data marts using dimensional modelling techniques (e.g. star and snowflake schemas) Work ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

Senior OPERA PMS & OHIP Data Integration Specialist – Hotel – London Daily rate: £500 - £600 (inside IR35) Duration: 6 – 12 months Location: London Start: ASAP We’re looking for a unique hybrid profile, someone who understands how hotel operations behave inside OPERA PMS and can translate that into clean, reliable … Mapping & Architecture Support Create detailed source-to-target mapping documentation Map OPERA data (via OHIP) into our Data Lake/Warehouse Ensure accuracy and consistency across all business scenarios Troubleshoot discrepancies between OPERA UI and downstream data Cross-Functional Collaboration Work ...