25 of 25 Data Lake Jobs in Central London

Head of Data – Data Architecture, Data Strategy/Governance, Data Science/Analysis/Engineering; frameworks, data operating model (TOM), compliance, risk, automation; management information (MI) reporting, PowerBI, SQL, ADF, Azure Data Warehousing/Data Lakes. Permanent, London/Hybrid (3/2) c.£150k (Negotiable … +Bonus +Benefits Global organisation seeks Head of Data to lead strategy around data architecture, data governance, platform enhancement and MI reporting development across all systems which support business decisions and improve operations. Working in a senior level capacity, initially within an individual contributors role (initially) the Head of Data will undertake a … number of strategic and tactical duties including: Developing data initiatives in line with wider business strategy Engage with senior business leaders and technology management to design a Target Data Operating Model Develop the firms AI/NLP strategy, roadmap and capability utilising emerging data science approaches where applicable Optimise existing technology to support/ More ❯

Head of Data Data Architecture, Data Strategy/Governance, Data Science/Analysis/Engineering; frameworks, data operating model (TOM), compliance, risk, automation; management information (MI) reporting, PowerBI, SQL, ADF, Azure Data Warehousing/Data Lakes. Permanent, London/Hybrid (3/2) c.£150k (Negotiable … +Bonus +Benefits Global organisation seeks Head of Data to lead strategy around data architecture, data governance, platform enhancement and MI reporting development across all systems which support business decisions and improve operations. Working in a senior level capacity, initially within an individual contributors role (initially) the Head of Data will undertake a … number of strategic and tactical duties including: Developing data initiatives in line with wider business strategy Engage with senior business leaders and technology management to design a Target Data Operating Model Develop the firms AI/NLP strategy, roadmap and capability utilising emerging data science approaches where applicable Optimise existing technology to support/ More ❯

We are currently working with a fast-growing insurance provider that is actively recruiting for a Data Governance Analyst to join them on a permanent basis. The role is part of a data team which is vital to the business for pricing … and risk processes, focusing on Master Data Management and Reference Data Management. You will be utilising Azure-based modern architecture, including Databricks, Data Lake etc. This is a hybrid role with three days per week on-site. Key responsibilities: Ensuring proper governance as well as accuracy and consistency across all customer and reference … quality, data lineage and similar data management concepts Comfortable working with Azure and Data Lakehouse Architecture, including Databricks, Data Lake, Data Factory Excellent experience with SQL data analysis Understanding of financial services regulations and requirements MDM tooling experience e.g. Profisee, Informatica, Microsoft MDS etc. (preferable More ❯

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Architecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North … and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution … of data modelling, data integration, metadata management, and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts More ❯

support EQ's transition into a stronger, more profitable, product-led business, driven by real insights and the needs of its customers. We are looking for a skilled Data Engineer to join our Data team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data pipelines … cloud-based data pipelines and architectures Strong expertise in Microsoft Fabric and Databricks, including data pipeline development, data warehousing, and data lake management Proficiency in Python, SQL, Scala, or Java Experience with data processing frameworks such as Apache Spark, Apache Beam, or Azure Data Factory Strong understanding … Azure and or AWS Strong collaboration and communication skills, with the ability to work effectively with cross-functional teams Desirable: Experience with Azure Synapse Analytics, Azure Data Lake Storage, or other Azure data services Experience with agile development methodologies and version control systems such as Git Certification in Microsoft Azure, Databricks, or other relevant technologies More ❯

wants technical leadership, architectural influence, and the chance to shape a modern cloud-based data platform built on Azure Data Factory, Synapse, Data Lake, and Microsoft Fabric. The Role As Senior Data Engineer, you will: Lead the design, build, and optimisation of Azure Data Factory (ADF) ETL pipelines . … performance-optimised SQL workloads. Own and enhance Power BI datasets, semantic models, and reporting standards (major focus). Shape cloud data architecture across Azure Data Lake and Synapse environments. Play a key role in the organisations transition to Microsoft Fabric . Implement robust data quality, validation, and monitoring frameworks . Work closely with … pipelines, automation, optimisation). Strong Azure Synapse experience: warehousing, SQL pools, query tuning, stored procedures. Deep proficiency in SQL development and optimisation. Solid understanding of Azure Data Lake and cloud storage layers. Proven track record delivering Azure-based data engineering solutions. Strong communication and stakeholder engagement. Demonstrated mentoring or technical leadership experience. Desirable: Exposure to More ❯

data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. … Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure Monitor , Log Analytics , and Databricks tools. Optimise performance … Essential Skills & Experience 5+ years of experience with Azure services (Azure Data Factory, ADLS, Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks , Delta Lake , and cluster management . Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling , data More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits Tech Stack: Azure | Databricks | Power BI | Python Are you ready to shape the future of data? We're looking for a Data Engineer to join a team that thrives on innovation and cutting-edge technology. If you love solving complex data challenges … and building scalable solutions, this is your chance to make an impact. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines DevOps: CI/CD Bonus: Python What you'll … do Design and implement scalable Azure-based data solutions Build and optimize data pipelines for integration and transformation Develop Power BI dashboards for global stakeholders Ensure data quality, governance, and security Collaborate in an Agile environment with cross-functional teams What We're Looking For Hands-on experience with Azure & Databricks Strong data More ❯

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary technology solutions drive performance and reduce costs while helping our … clients to improve the management and sharing of data across their organisations. In 2022, Aker Systems was proud to win the Scale up Business of the Year award by the British Business Excellence Awards. In 2020 Aker Systems was recognised as a One to Watch on the Sunday Times Tech Track and was also recognised at the Thames … and cloud-native solutions. Data Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either AWS/Azure/Google More ❯

Data Engineer | Hybrid | London | Databricks | Azure | 85k I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation as a trusted leader in high-value, complex projects. Today, their … you work each week. This is an organisation where world-class projects meet an environment that prioritises your well-being and career development. I'm looking for a Data Engineer who thrives on innovation and loves tackling complex data challenges. If building scalable, cloud-based solutions excites you, this is your chance to make a real … technology and stay at the forefront of the data engineering field. You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards and analytics ETL & Data Modelling: T-SQL, metadata-driven pipelines Design and implement scalable Azure-based data More ❯

Industry: Financial Services/Highly regulated environment Job Summary: We are searching for an Enterprise Architect on behalf of a progressive financial services firm. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure, with Data architecture as the cornerstone of their digital ecosystem.This is a greenfield opportunity to … establish enterprise-wide data governance frameworks, design scalable data platforms. You'll define architectural standards that enable advanced analytics, AI/… ML capabilities, and regulatory compliance while solving complex data integration, quality, and lineage challenges. Deep knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI. This role is perfect for a strategic thinker who can bridge business objectives with technical execution, translating data challenges into architectural More ❯

superior financial strength ratings from each of the major rating agencies. General Reinsurance, London Branch (a subsidiary of General Reinsurance AG) is offering an opportunity for a Senior Data Engineer in our Data and Governance domain. Main Purpose of the Role We are seeking a detail-oriented senior data engineer to support the implementation … of our Data and AI Governance initiatives that reports into the Enterprise Data and AI Services (EDAS) team. This role will play a key part in supporting the team of governance processes, audits, managing risks and ensuring data privacy in close collaboration with the Security, Legal and Privacy teams. The post holder will also … contribute to the Implementation, integration, development and maintenance of relevant governance, MDM and lineage tools. The ideal candidate will have a strong foundation in data engineering and report configurations in a modern landscape and a keen interest in expanding their expertise in governance, audit, and privacy. This role offers the opportunity to gain hands-on experience in applying More ❯

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has … background with a hardened skillset in Microsoft Stack Technologies (C# .NET Core) who has then transitioned into Product Ownership. We need someone highly analytical who can understand large Data Sets, Data Bricks and is able to bring Proof of Concepts to the table and help with the execution. The platform primarily serves two key personas: Data … for more details Experience required: Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management:Demonstrated expertise More ❯

About the RoleWe are seeking a Databricks Data Engineer with strong expertise in designing and optimising large-scale data engineering solutions within the Databricks Data Intelligence Platform. This role is ideal for someone passionate about building high-performance data pipelines and ensuring robust data governance across modern … cloud environments. Key Responsibilities Design, build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning to ensure cost-efficient, high-performing workloads. Implement data quality … with Databricks Unity Catalogue and governance best practices. Develop PySpark applications for ETL, data transformation, and analytics, following modular and reusable design principles. Create and manage Delta Lake tables with ACID compliance, schema evolution, and time travel for versioned data management. Integrate Databricks solutions with Azure services such as Azure Data Lake More ❯

Data Engineering Consultant - £50,000 - Hybrid As a Data Engineer, you will work within an agile team to deliver high-value data solutions for clients. You'll be hands-on across the full lifecycle, using and developing your technical and project skills to create high-quality outcomes. While we follow a Winning from Anywhere … approach, some travel to client sites, company conferences, and events may be required. What You'll Deliver End-to-end data solutions covering acquisition, engineering, modelling, analysis, and visualisation. Client workshops and communication at both technical and business levels. Design and implementation of robust ETL/ELT solutions using the Microsoft/Azure ecosystem (Fabric/Databricks). … Server technologies. Skills in developing ETL/ELT pipelines using Azure Synapse, Data Factory, Databricks, or Fabric, with SQL and Python. Strong understanding of data lake and lakehouse architectures. Experience working with large, complex datasets from diverse sources. Strong SQL and Python capabilities, including stored procedures, notebooks, and query optimisation. Familiarity with Power BI, Analysis More ❯

Data Engineering team lead - £70,000 - Hybrid Overview We're looking for a Lead Technical Consultant to guide a team of Technical Consultants, oversee delivery of high-quality data solutions, and collaborate across the business to ensure successful project outcomes. This role combines leadership, resource management, and hands-on technical expertise within Microsoft and Azure data … deliver successful projects. Technical Delivery & Innovation Support technical delivery when needed, including designing scalable Azure/Microsoft data solutions. Drive innovation through cloud migrations, data lake implementations, and robust ETL/ELT pipeline development. Skills & Experience You'll thrive in this role if you have: Leadership Proven ability to build strong relationships and foster an … inclusive, collaborative environment. Demonstrated leadership experience, acting as a role model for company values. Technical Expertise Strong background in Data Engineering or Data Warehouse development using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in ETL/ELT design with SQL and Python. Solid understanding of data More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Audit Technology Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Audit Technology Product Owner (Technology and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need expertise … who is confident on the business side with the ability to get the best out of Audit Teams speaking Audit language! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details Experience required: Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management:Demonstrated expertise More ❯

Senior Data Engineering Consultant - £60,000 - Hybrid Key Responsibilities Lead, mentor, and develop a team of Technical Consultants. Manage resource planning, scheduling, and overall delivery workflows. Collaborate with Pre-sales, Commercial, and … Project Management teams to scope and deliver projects. Contribute to technical delivery, designing scalable data solutions in Azure/Microsoft environments. Support cloud migrations, data lake builds, and ETL/ELT pipeline development. Ensure delivery follows best practices and internal standards. Skills & Experience Strong leadership and relationship-building skills. Experience guiding or managing technical teams. … Deep hands-on experience in Data Engineering using Microsoft Fabric, Azure Databricks, Synapse, Data Factory, and/or SQL Server. Expertise in SQL and Python for ETL/ELT development. Knowledge of data lakes, medallion lakehouse architecture, and large-scale dataset management. Solid understanding of BI, data warehousing, and database optimisation. To More ❯

Data Architect - London - Databricks - 110k + Bonus I'm looking for a hands-on Data Architect ready to shape the next generation of data platforms - blending architecture, data modelling, and AI innovation in a fast-moving, flat-structured tech environment. Is this what you're looking for: Azure Databricks, ADF, Power BI … SQL - everything built in Azure. Innovation-first culture: Work directly with senior tech leaders on projects using unstructured data into powerful insights. Modernised environment: Microservices, data lakes, and service-oriented architecture. Competitive package: Up to £110,000 + 3-8% bonus, hybrid working (typically 1-2 days in office), and excellent benefits. What you'll do … Architect and deliver scalable data solutions on Azure Databricks. Take full ownership of data modelling - conceptual, logical, and physical. Set data governance, quality, and optimisation best practices. Collaborate closely with engineering and data leaders to evolve the cloud data ecosystem. Contribute to cutting-edge AI projects shaping the future of More ❯

Head of Data Engineering - Azure & Databricks - Remote - Up to £100,000 A forward-thinking and nationally recognised organisation, known for its commitment to innovation and data-driven decision-making, is seeking a Head of Data Engineering to lead its growing data function. With a strong culture of collaboration, investment in cutting-edge … a clear roadmap for digital transformation, this company offers an exciting environment for technical leaders to make a real impact. Key Responsibilities: Lead and mentor a team of data engineers, fostering a culture of innovation and excellence. Architect and implement scalable data solutions using the Azure tech stack and Databricks. Collaborate with cross-functional teams to … best practices are followed. Requirements: Proven experience in leading data engineering teams. Strong expertise in Azure Data Services (e.g., Data Factory, Synapse, Azure Datalake) and Databricks. Comfortable balancing strategic leadership with occasional hands-on technical work. Excellent stakeholder management and communication skills. Benefits: Competitive salary up to £100,000. Opportunity to shape the data More ❯

Data Engineering Team Lead - Remote - Databricks - Azure - 80k Join a Leading Microsoft Consultancy Driving Data Innovation I'm working with a well-established Microsoft Partner with an incredible project pipeline, rapid growth, and a reputation for delivering Tech for Good. They're working on cutting-edge projects using emerging technologies like Microsoft Fabric and Azure Databricks. … We're looking for a Data engineering team lead who combines hands-on technical expertise with leadership skills to mentor a talented team and deliver exceptional solutions for our clients. What You'll Do Lead and mentor a team of Technical Consultants, driving engagement, growth, and alignment with our culture. Oversee resource planning, scheduling, and performance management. Collaborate … Project Management teams to scope and deliver projects. Ensure consistent delivery of technical solutions aligned with best practices and standards. Support technical delivery when needed, including designing scalable data solutions in Microsoft/Azure environments. Contribute to innovation through cloud migrations, data lakes, and robust ETL/ELT solutions. What We're Looking For Hands-on More ❯

We are searching for one of our key clients a Senior Data Platform Engineer to support and optimise large scale data ecosystems across PostgreSQL, Snowflake and Greenplum. This is a high-impact role within a modern digital environment, ideal for someone who thrives on complex data challenges and enterprise-grade engineering. Youll be responsible … for designing scalable data models, optimising performance across multiple database technologies, and enabling seamless data ingestion pipelines. Expect to work in a cloud-driven setting with Azure, modern tooling, and critical data platforms that underpin major transformation programmes. Key skills required Deep knowledge of PostgreSQL, Snowflake and Greenplum Snowflake internals, schemas, modelling, data lakes and integration patterns Data ingestion using Informatica, Talend and similar ETL tooling Strong experience handling JSON, XML, CSV and multi-source datasets Patroni expertise for HADR and streaming replication Backup, recovery, tuning and optimisation across Postgres, Snowflake and Greenplum Understanding of Azure environments If youre ready to join a forward-thinking organisation delivering enterprise-level More ❯