1 to 25 of 65 Data Lake Jobs in London

Reports To: Head of Strategy, Transformation and Data Governance Location: London **MUST HAVE INSURANCE EXPERIENCE** Role Purpose Data Management (DM) provides the framework that ensures data is reliable, well understood, secure, and trusted for operational, management, analytical, and customer-focused use. Data … functions to define and implement appropriate data access rules and guardrails Ensure compliance with data management and data lake governance standards Innovation & Enablement Enable effective and appropriate use of data domains and new technologies Act as a market and industry observer ...

pipelines and data integration workflows using Microsoft Azure services such as Data Factory, Synapse Analytics, Data Lake, Databricks, and related technologies. Implement and support Microsoft Fabric solutions, including dataflows, data warehouses, and real-time analytics features. Develop and maintain … EXPECTATIONS IN THE ROLE Strong hands-on experience with Microsoft Azure data services (Data Factory, Synapse Analytics, Data Lake, Databricks). Direct experience delivering solutions using Microsoft Fabric. Advanced SQL skills and experience with data modelling, transformation, and integration. Familiarity with ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

Business Data Analyst with Data Quality & MDM experience Contract: initial contract until June 2026 IR35 Status: Inside IR35 Location: Remote with travel to the office every 6 - 8 weeks We are seeking an experienced Business Data Analyst with Data Quality …/or SAP MDG is highly desirable, OR similar enterprise data tools Exposure to data lake technologies (Azure Datalake), ETL, Databricks, PowerBI Exceptional documentation and stakeholder communication skills Detail-oriented with a focus on accuracy and compliance Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio ...

Data Officer - Financial Services (London) Permanent | Full Time | Hybrid (2-3 days in office) Senior Manager or Manager level (depending on experience) An established international financial institution is seeking a Data Officer to join its London operation. This newly created role sits within the Risk function … with close collaboration across Technology, Operations and front-office business areas. It offers the opportunity to shape and lead the firm's data governance strategy during a period of organisational growth. The Role The Data Officer will be responsible for developing, embedding and overseeing the organisation ...

Morgan Hunt are working with a housing association in London to recruit an Azure Data Engineer on a permanent basis. The purpose of the role is to lead the implementation of data flows to connect operational systems, data for analytics and BI systems. … data technologies Evaluate and improved existing data processes Essential Experiences: Advanced SQL skills Proficient in Databricks, including Spark, Delta Lake and MLflow Experience migrating SSIS to Databricks In depth understanding of ETL/ELT processes Knowledge of data warehousing concepts and architectures Able ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Architect 3 days a week onsite in London 35hr working week with flexible working hours We're looking for an experienced Data Architect to join a well-established company who are going through an enterprise-wide modernisation programme. This is a brand-new role within … Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture ...

Enterprise Architect for Master Data Management Location: Remote/Hybrid London Southbank on occasion Contract Type: Inside IR35 Duration: 6 Months Start: ASAP About the Role A leading organisation is seeking a highly experienced Enterprise Architect for Master Data Management to support a major Enterprise Data Management (EDM) and Master Data strategic programme. The company is undergoing significant transformation across ERP and CRM platforms, where Customer and Product Master Data quality, governance, and architecture are critical to programme success. This Enterprise Architect for Master Data Management role will ...

/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows Implement best practices … Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory ...

Engineer across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced Python (PySpark … Proven ability to engage senior stakeholders and clearly communicate technical trade-offs Experience working in Agile delivery environments Nice to Have: Experience with AWS Lake Formation, Lambda, Step Functions, Athena, EMR, DataBrew Familiarity with data quality, lineage, or observability tooling Knowledge of GDS ways of working ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best ...

truly global environment. Join NEC and be part of shaping the future. The Opportunity We are looking for a skilled HR Data & Reporting Specialist with deep expertise in SAP SuccessFactors to take on the responsibility of data migration, reporting, and system integration initiatives within the Global … configure APIs between SAP SuccessFactors and data platforms such as Tableau Cloud/Snowflake to establish an HR Data Lake for NEC Overseas companies. Perform data reconciliation to ensure accuracy and integrity of migrated data. What You’ll Bring Experience in SAP SuccessFactors ...

Head of Data London £140,000 + Bonus + Equity/Shares (OTE £(Apply online only)k) About the role We're looking for a Head of Data to own and shape our end-to-end data strategy. This is a senior leadership role … e.g. GDPR) and ethical data use Own the Azure data platform, including Microsoft Fabric, Azure Databricks, Azure Data Lake Gen2, Azure Data Factory/Fabric Pipelines What we're looking for Proven experience in a senior data leadership role ...

Data Engineer Fully Remote 6 Months Contract £550 Inside IR35 (PAYE Rate) + Holiday Overview We’re looking for a talented and motivated Data Engineer to join a growing Data Engineering team delivering high-quality, enterprise-scale data solutions. This … data (JSON, XML) Experience with Microsoft Azure data services such as Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse, Azure Functions, Cosmos DB Familiarity with Git repositories and branching strategies Exposure to additional technologies such as PowerShell, Bicep, YAML ...

Senior Data Engineer Fully Remote 6 Months Contract £600 Inside IR35 (PAYE Rate) + Holiday Overview We’re looking for a talented and motivated Data Engineer to join a growing Data Engineering team delivering high-quality, enterprise-scale data solutions. This … data (JSON, XML) Experience with Microsoft Azure data services such as Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse, Azure Functions, Cosmos DB Familiarity with Git repositories and branching strategies Exposure to additional technologies such as PowerShell, Bicep, YAML ...

Interim Principal Azure Data Architect Location: North London (hybrid) Contract: Interim Rate: £900 per day outside IR 35 A complex organisation based in North London is seeking an Interim Principal Azure Data Architect to reset, review, and re-implement its data architecture . This … architecture Deep, practical experience across the Azure data stack (for example Azure Data Factory, Synapse, Fabric, Databricks, Data Lake, SQL) Strong background in data modelling , analytics architecture, and large-scale data platforms Experience leading data architecture resets ...

Details Role/Job Title: MLOps Tech Lead Work Location: London, UK Office Requirement (Hybrid): 2 days per week Key Responsibilities (High-Level) Data Pipeline Development: Lead the technical direction of projects and ensure the use of Sainsbury's best practices to the best quality. Data Integration: Lead and provide expertise on Integrate data from various sources, ensuring data consistency, integrity, and quality across the entire data lifecycle. Infrastructure Management: Provide guidance for the junior & Mid Data Engineers on the best practices when building and managing ...

Interim Principal Azure Data Architect Location: North London (hybrid) Contract: Interim Rate:£900 per day outside IR 35 A complex organisation based in North London is seeking an Interim Principal Azure Data Architect to reset, review, and re-implement its data architecture . This … architecture Deep, practical experience across the Azure data stack (for example Azure Data Factory, Synapse, Fabric, Databricks, Data Lake, SQL) Strong background in data modelling , analytics architecture, and large-scale data platforms Experience leading data architecture resets ...

revenues as of 12 months ending December 2024 totaled $13.8 billion. Hybrid role: 3 days working from onsite. We are seeking an experienced Data Architect to design, govern, and optimize enterprise data platforms. The architect will lead end-to-end data architecture, data … modeling, and cloud-based data engineering strategies. Key Responsibilities: - Design scalable data architectures across OLTP, OLAP, and Data Lake environments. - Architect data ingestion, ETL/ELT pipelines, and integration frameworks. - Drive data modeling (conceptual, logical, physical) using best practices. ...

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role … scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, this role … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Role Overview We are seeking an experienced Databricks Data Engineer to design and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. This is a hands-on role focused on building scalable data pipelines, optimising performance, and applying best practices … Experience 3+ years’ experience in data engineering within enterprise environments Strong expertise in Azure Databricks, ADF, Synapse, and Azure Data Lake Hands-on experience with Spark (PySpark/Spark SQL) and orchestration Strong data modelling and data warehousing knowledge Proficiency ...