51 to 75 of 180 Data Lake Jobs in London

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders to define and implement data product solutions that … are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that are robust, reusable, and value-driven. Location: Uxbridge, UK. Main Responsibilities Solution Architecture & Design Design end-to-end architecture … for data products, including ingestion, transformation, storage, access, and visualization layers. Define architectural standards, patterns, and principles for data product development. Ensure solutions are scalable, modular, reusable, and aligned with enterprise architecture and data strategy. Lead the selection and integration of appropriate technologies and platforms (e.g., data lakes, warehouses, real-time processing More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. This role plays a key part in defining our data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The … ideal candidate will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data storage solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. This role plays a key part in defining our data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The … ideal candidate will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data storage solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data More ❯

Data Engineer (Microsoft Azure) Location: London/Hybrid 2-3 days in office Type: 6 months contract Rate: £250 to £275/a day PAYE About the Role We are seeking a Data Engineer to support the design, build, and maintenance of modern data solutions on the Microsoft Azure platform. You will play a … key role in ensuring data is accessible, secure, and efficient, while collaborating with stakeholders to deliver solutions that meet strategic business needs. This is an exciting opportunity for someone motivated to learn, develop, and contribute to large-scale transformation initiatives in a dynamic environment. Key Responsibilities Support the development of data pipelines and storage solutions Assist … engineering. Strong understanding of data integration and management practices. Experience with Microsoft Azure Data Services (Fabric desirable). Knowledge of Data Lake, Power BI, SQL. Business Entity Mastering, Data Taxonomy and Data Dictionary. Knowledge of CI/CD Familiarity with ETL processes and best practices. Key Competencies More ❯

Data Engineer (Microsoft Azure) Location: London/Hybrid 2-3 days in office Type: 6 months contract Rate: £250 to £275/a day PAYE About the Role We are seeking a Data Engineer to support the design, build, and maintenance of modern data solutions on the Microsoft Azure platform. You will play a … key role in ensuring data is accessible, secure, and efficient, while collaborating with stakeholders to deliver solutions that meet strategic business needs. This is an exciting opportunity for someone motivated to learn, develop, and contribute to large-scale transformation initiatives in a dynamic environment. Key Responsibilities Support the development of data pipelines and storage solutions Assist … engineering. Strong understanding of data integration and management practices. Experience with Microsoft Azure Data Services (Fabric desirable). Knowledge of Data Lake, Power BI, SQL. Business Entity Mastering, Data Taxonomy and Data Dictionary. Knowledge of CI/CD Familiarity with ETL processes and best practices. Key Competencies More ❯

Data Engineer - Databricks Initial 7-month Contract Role Remote Working £600 - £650, Inside IR35 We're partnering with a Global IT Partner who are looking for a Data Engineer to design and develop scalable data pipelines in Azure Databricks. As a Data Engineer, you will be responsible for: Lead end-to-end … migration of data lakes to Azure with a core focus on Databricks Design and implement data pipelines in Azure Databricks, optimising for performance, cost, and scalability Refactor and modernise existing data models to integrate with Power BI Coordinate phased migrations to ensure zero disruption to live operations Replace legacy tools by consolidating workflows within … strong focus on building scalable data pipelines Expertise in Azure Databricks, including building and managing ETL pipelines using PySpark or Scala Solid understanding of Apache Spark, Delta Lake, and distributed data processing concepts Hands-on experience with Azure Data Lake Storage, Azure Data Factory, and Azure Synapse Analytics Proficiency in More ❯

Data Engineer (Microsoft Azure) Location: London/Hybrid 2-3 days in office Type: 6 months contract Rate: £250 to £275/a day PAYE About the Role We are seeking a Data Engineer to support the design, build, and maintenance of modern data solutions on the Microsoft Azure platform. You will play a … key role in ensuring data is accessible, secure, and efficient, while collaborating with stakeholders to deliver solutions that meet strategic business needs. This is an exciting opportunity for someone motivated to learn, develop, and contribute to large-scale transformation initiatives in a dynamic environment. Key Responsibilities Support the development of data pipelines and storage solutions Experience … aligns with governance, controls, and technical standards. Proven experience in data engineering. Strong understanding of data integration and management practices. Knowledge of Data Lake, Power BI, SQL. Familiarity with ETL processes and best practices. Key Competencies Motivated to learn and grow in a dynamic environment. Strong organisational and technical skills with excellent attention More ❯

Data Engineer (Microsoft Azure) Location: London/Hybrid 2-3 days in office Type: 6 months contract Rate: £250 to £275/a day PAYE About the Role We are seeking a Data Engineer to support the design, build, and maintenance of modern data solutions on the Microsoft Azure platform. You will play a … key role in ensuring data is accessible, secure, and efficient, while collaborating with stakeholders to deliver solutions that meet strategic business needs. This is an exciting opportunity for someone motivated to learn, develop, and contribute to large-scale transformation initiatives in a dynamic environment. Key Responsibilities Support the development of data pipelines and storage solutions Experience … aligns with governance, controls, and technical standards. Proven experience in data engineering. Strong understanding of data integration and management practices. Knowledge of Data Lake, Power BI, SQL. Familiarity with ETL processes and best practices. Key Competencies Motivated to learn and grow in a dynamic environment. Strong organisational and technical skills with excellent attention More ❯

Data Engineer (Microsoft Azure) Location: London/Hybrid 2-3 days in office Type: 6 months contract Rate: £250 to £275/a day PAYE About the Role We are seeking a Data Engineer to support the design, build, and maintenance of modern data solutions on the Microsoft Azure platform. You will play a … key role in ensuring data is accessible, secure, and efficient, while collaborating with stakeholders to deliver solutions that meet strategic business needs. This is an exciting opportunity for someone motivated to learn, develop, and contribute to large-scale transformation initiatives in a dynamic environment. Key Responsibilities Support the development of data pipelines and storage solutions Experience … aligns with governance, controls, and technical standards. Proven experience in data engineering. Strong understanding of data integration and management practices. Knowledge of Data Lake, Power BI, SQL. Familiarity with ETL processes and best practices. Key Competencies Motivated to learn and grow in a dynamic environment. Strong organisational and technical skills with excellent attention More ❯

Data Engineer (Microsoft Azure) Location: London/Hybrid 2-3 days in office Type: 6 months contract Rate: £250 to £275/a day PAYE About the Role We are seeking a Data Engineer to support the design, build, and maintenance of modern data solutions on the Microsoft Azure platform. You will play a … key role in ensuring data is accessible, secure, and efficient, while collaborating with stakeholders to deliver solutions that meet strategic business needs. This is an exciting opportunity for someone motivated to learn, develop, and contribute to large-scale transformation initiatives in a dynamic environment. Key Responsibilities Support the development of data pipelines and storage solutions Experience … aligns with governance, controls, and technical standards. Proven experience in data engineering. Strong understanding of data integration and management practices. Knowledge of Data Lake, Power BI, SQL. Familiarity with ETL processes and best practices. Key Competencies Motivated to learn and grow in a dynamic environment. Strong organisational and technical skills with excellent attention More ❯

Data Engineer (Power BI) | 6 Month Contract | Outside IR35 We're seeking a Data Engineer with experience in Power BI to help build and optimise data pipelines and deliver high-quality datasets for business intelligence. You'll ensure that large, complex data flows seamlessly into the reporting layer, enabling analysts and stakeholders … to uncover insight. Location: London Contract: 6 Months (OIR35) Rate: £325-400 p/day Key Responsibilities: Designing and maintaining scalable ETL/ELT pipelines . Integrating data from multiple sources into a centralised warehouse (SQL Server, PostgreSQL, or Snowflake). Working with Azure Data Factory and cloud-native tooling for data orchestration. Structuring … product owners to align engineering outputs with business requirements. Key Skills: Strong SQL skills and experience with relational databases. Hands-on experience with Azure (ADF, Synapse, Data Lake) or AWS/GCP equivalents. Familiarity with scripting languages (Python, PySpark). Knowledge of data modelling and warehouse design (Kimball, Data Vault). Exposure to More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar is desirable Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary of More ❯

Inside IR35 | Contract until end of May | US time zone (2:30 pm - 10:30 pm UK) A global IT reseller is delivering a large-scale Data Lake project in Azure and is seeking an experienced Senior Python Developer to support data engineering and ingestion framework development. You'll work closely with technical and business … ingestion pipelines, leveraging Databricks and modern Azure data services. Key skills: Strong hands-on Python development experience Proven background with Databricks and Azure Data Lake Experience with data ingestion, ETL frameworks, and data engineering best practice Comfortable collaborating across global teams and time zones This is a remote contract role More ❯

Role Title: Data Solutions Architect (GCP) Business Unit: Data Management Role Overview This strategic, client-facing role sits within a growing Data Management practice and focuses on leading cloud-based data architecture initiatives, particularly on Google Cloud Platform (GCP). The Data Solutions Architect will collaborate with senior stakeholders to … modernise data platforms, accelerate cloud transformation, and unlock business value through data and AI. This is a technical leadership position-not hands-on coding-but one that requires deep architectural expertise, strong consulting skills, and the ability to influence C-suite decision-making. The role also involves significant pre-sales engagement, translating client needs into solution … and proposal narratives. Collaborate with sales, pricing, and delivery teams to shape commercially viable and technically sound solutions. Enterprise Solution Design Architect and oversee the delivery of scalable data platforms (data lakes, lakehouses, warehouses) using GCP technologies such as BigQuery, Cloud Storage, Databricks, and Snowflake. Cloud Data Strategy Lead cloud migration and modernisation strategies More ❯

Overview Join Chambers and Partners as a Manual Data QA Analyst and play a key role in ensuring the integrity of our data across industry-leading products and platforms. You’ll be responsible for validating complex data flows, particularly within our Databricks environment through meticulous manual testing. This is a critical position within our … growing Technology & Data team, ideal for someone passionate about data quality and eager to make an impact in a globally respected organisation. Experience with Power BI and/or Data Lakehouse architectures would be a strong advantage. Main Duties and Responsibilities Testing Execution : Conduct detailed manual tests to validate data flows and … ensure seamless integration of new data solutions into existing systems. Skills and Experience Proven experience in testing data migrations, database implementations, and Data Lake environments. Familiarity with cloud environments, especially Azure, is highly desirable. Strong knowledge of SQL and experience in writing complex queries for data validation and testing. Proficiency in More ❯

Data Engineering Lead (Azure) London (3 days in office) Up to £105,000 + 5% Bonus + Benefits Are you ready to take the lead on building a cutting-edge data platform? We're seeking a Data Engineering Lead to shape and grow data engineering capabilities at a global, forward-thinking organisation. … a modern Azure-based platform, lead a talented team, and make a direct impact on business-wide decision making. Why this role? Spearhead the creation of a new data platform from the ground up. Balance hands-on engineering with team leadership and mentoring. Collaborate with analysts, data scientists, and business leaders to deliver impactful solutions. Hybrid … remote flexibility the rest. Join a supportive and inclusive culture, with a global footprint and a focus on innovation. What you'll be doing: Designing and building scalable data pipelines to support analytics, reporting, and machine learning. Leading the implementation of Azure data solutions and ensuring robust ETL/ELT processes. Defining architecture strategies that allow More ❯

Senior Data Architect Location: London (Hybrid - 2 days/week onsite) Salary: Flexible, depending on experience Employment Type: Permanent Overview Our client, is seeking a highly experienced Senior Data Architect to lead the design and evolution of their enterprise data architecture. This is a strategic role focused on building scalable, secure, and future-proof … data solutions that support business growth and innovation. The ideal candidate will bring deep expertise in data modelling , Databricks , and Azure-based architecture , with a strong ability to translate complex requirements into robust technical solutions. Key Responsibilities Design and implement conceptual, logical, and physical data models (3NF, Kimball, Data Vault) Architect and … optimise data platforms including data lakes , lakehouses , and data warehouses Lead the development of metadata-driven ingestion and transformation pipelines Ensure compliance with GDPR and internal data governance policies Collaborate with engineering and delivery teams to define and align technical direction Oversee the full data lifecycle-from strategy and design More ❯

Senior Data Architect Location: London (Hybrid - 2 days/week onsite) Salary: Flexible, depending on experience Employment Type: Permanent Overview Our client, is seeking a highly experienced Senior Data Architect to lead the design and evolution of their enterprise data architecture. This is a strategic role focused on building scalable, secure, and future-proof … data solutions that support business growth and innovation. The ideal candidate will bring deep expertise in data modelling , Databricks , and Azure-based architecture , with a strong ability to translate complex requirements into robust technical solutions. Key Responsibilities Design and implement conceptual, logical, and physical data models (3NF, Kimball, Data Vault) Architect and … optimise data platforms including data lakes , lakehouses , and data warehouses Lead the development of metadata-driven ingestion and transformation pipelines Ensure compliance with GDPR and internal data governance policies Collaborate with engineering and delivery teams to define and align technical direction Oversee the full data lifecycle-from strategy and design More ❯

growing capability and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB . Essential … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data using APIs, writing SQL queries etc. Experience in processing large amounts of structured and unstructured data, including integrating data from multiple sources through ingestion and curation functions on AWS cloud using AWS native or custom programming More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Mid-Level Azure Data Engineer - Investment Management - London/Hybrid We're partnered with a small but forward-thinking Investment Management company in London that's continuing to evolve its data capabilities. They're now looking for a Mid-Level Azure Data Engineer to join a team of five engineers and analysts who are … driving the build and optimisation of a modern Azure-based data platform. This is a great opportunity for someone who enjoys working end-to-end across the data lifecycle and wants to have real influence in a close-knit, collaborative environment. You'll be working with the latest Azure technologies to help the business make smarter … environment that values collaboration, learning, and innovation What we're looking for Hands-on experience with the Azure Data Engineering stack (ADF, Databricks, Synapse, Data Lake) Strong skills in SQL and Python (PySpark experience is a bonus) Experience building and optimising ETL/ELT pipelines A background in Financial Services is a plus, but not More ❯

Principal Data Architect - Hybrid - London - No Sponsorship Available About the Role We are seeking an experienced and visionary Principal Data Architect to join a leading consultancy in the financial services sector. This strategic role involves leading complex, high-profile data initiatives that drive innovation and transformation for major financial institutions. The Company Our client … Known for fostering an entrepreneurial culture and championing diversity, they empower their teams to deliver impactful solutions in a collaborative and inclusive environment. Key Responsibilities Lead large-scale data architecture projects, providing strategic direction and expert guidance. Partner with senior technology leaders to develop and implement modern data strategies. Design and deliver innovative solutions for data … architecture, strategy, and implementation. Strong expertise in cloud technologies (AWS, Azure, GCP) with relevant certifications highly desirable. In-depth knowledge of data modeling, data lake design, and metadata management tools. Proven ability to design secure, scalable, and cost-effective data solutions in cloud ecosystems. Experience in the financial services sector, with a More ❯