101 to 125 of 276 Data Lake Jobs in the UK

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Mid-Level Azure Data Engineer - Investment Management - London/Hybrid We're partnered with a small but forward-thinking Investment Management company in London that's continuing to evolve its data capabilities. They're now looking for a Mid-Level Azure Data Engineer to join a team of five engineers and analysts who are … driving the build and optimisation of a modern Azure-based data platform. This is a great opportunity for someone who enjoys working end-to-end across the data lifecycle and wants to have real influence in a close-knit, collaborative environment. You'll be working with the latest Azure technologies to help the business make smarter … environment that values collaboration, learning, and innovation What we're looking for Hands-on experience with the Azure Data Engineering stack (ADF, Databricks, Synapse, Data Lake) Strong skills in SQL and Python (PySpark experience is a bonus) Experience building and optimising ETL/ELT pipelines A background in Financial Services is a plus, but not More ❯

Principal Data Architect - Hybrid - London - No Sponsorship Available About the Role We are seeking an experienced and visionary Principal Data Architect to join a leading consultancy in the financial services sector. This strategic role involves leading complex, high-profile data initiatives that drive innovation and transformation for major financial institutions. The Company Our client … Known for fostering an entrepreneurial culture and championing diversity, they empower their teams to deliver impactful solutions in a collaborative and inclusive environment. Key Responsibilities Lead large-scale data architecture projects, providing strategic direction and expert guidance. Partner with senior technology leaders to develop and implement modern data strategies. Design and deliver innovative solutions for data … architecture, strategy, and implementation. Strong expertise in cloud technologies (AWS, Azure, GCP) with relevant certifications highly desirable. In-depth knowledge of data modeling, data lake design, and metadata management tools. Proven ability to design secure, scalable, and cost-effective data solutions in cloud ecosystems. Experience in the financial services sector, with a More ❯

This role involves designing, developing, and maintaining robust data pipelines to support analytics within the industrial and manufacturing sector. The successful candidate will be heavily involved in supporting our cloud migration transition. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and Ireland We are a testing, inspection, certification, and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Data Engineer will be responsible for but not limited to: Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database, Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

This role involves designing, developing, and maintaining robust data pipelines to support analytics within the industrial and manufacturing sector. The successful candidate will be heavily involved in supporting our cloud migration transition. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and Ireland We are a testing, inspection, certification, and … We serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Data Engineer will be responsible for but not limited to: Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database, Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

Senior Fabric Developer Data & Analytics Consultanc **y London/Hybri** d SDG Group is a global Consulting firm specialising in Data & Analytics. We are committed to unlocking an organisations' potential and hidden value by offering in-depth analytics expertise that empowers our clients' business models to become successful data-driven enterprises. Innovation is in … will play a pivotal role in designing, developing, and deploying enterprise-grade solutions using Microsoft Fabric. You will work closely with clients and internal teams to build scalable data pipelines, semantic models, and visualizations that support advanced analytics and business intelligence initiatives. Must be a willing to learn other Technology Stacks, Data Bricks, Sn **owflake. What … Lakehouse, Powe - r BI, etc.).Strong proficiency in SQL, DAX, and Powe - r Query (M).Experience with Azure Data Services (e.g., Azure Synapse, Azure Data Lake, - Azure SQL).Solid understanding of data modelling, ETL processes, and BI a - rchitecture.Familiarity with CI/CD pipelines, DevOps, and version control - (e.g., Git).Excellent communication and More ❯

Senior Data Engineer Rate: up to £450/day Outside IR35 Contract Length: 6 Months (with likely extension) Location: Hybrid - 1 day per week onsite in Central London Working hours: 9am - 5pm - Monday - Friday An established international organisation is seeking a Senior Data Engineer to join their growing Data & Middleware function, driving innovation and … excellence across complex data ecosystems. This is a fantastic opportunity to shape the future of a large-scale data transformation programme, working on high-impact projects that enable data-driven decision-making. Responsibilities for the Senior Data Engineer: Design, build, and maintain scalable data pipelines and architectures, ensuring reliability, performance … efficiency, scalability, and cost optimisation Essential Skills for the Senior Data Engineer: Proficient with Databricks and Apache Spark, including performance tuning and advanced concepts such as Delta Lake and streaming Strong programming skills in Python with experience in software engineering principles, version control, unit testing and CI/CD pipelines Advanced knowledge of SQL and data More ❯

Contract Data Engineer - Azure, Databricks, SQL, Python 6 Weeks Outside IR35 £500-£600 per day Remote (occasional travel to Manchester or Glasgow) My client is delivering a high-impact data migration programme and is looking for a Data Engineer to join on a 6-week contract. This role will suit someone who thrives in … fast-moving delivery environments and has hands-on experience with modern data engineering tools. The Role Join a focused delivery team to execute a business-critical data migration Build, optimise and maintain data pipelines using Azure and Databricks Translate business requirements into technical solutions that ensure data accuracy, integrity and security Deliver … data engineering and automation Proven experience of data migration projects, ideally at enterprise scale Experience with Databricks and the wider Azure stack (Data Lake, Synapse, ADF) Solid understanding of data integration, transformation, and validation If you are an experienced Data Engineer who can hit the ground running and deliver More ❯

Industry: Financial Services/Highly regulated environment Job Summary: We are searching for an Enterprise Architect on behalf of a progressive financial services firm. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure, with Data architecture as the cornerstone of their digital ecosystem. This is a greenfield opportunity … to establish enterprise-wide data governance frameworks, design scalable data platforms. you'll define architectural standards that enable advanced analytics, AI/… ML capabilities, and regulatory compliance while solving complex data integration, quality, and lineage challenges. Deep knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI. This role is perfect for a strategic thinker who can bridge business objectives with technical execution, translating data challenges into architectural More ❯

prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary The Azure Stack BI Developer will play a key role in managing data integrations between our business and our parent company, ensuring the accuracy, reliability, and high quality of data outputs. This role involves designing and developing ETL solutions, maintaining … our data architecture, and supporting critical business processes. The ideal candidate will have a strong technical background, as well as excellent communication skills to engage with both technical and non-technical stakeholders. Role Responsibilities Support and manage integrations between our company and the parent company, ensuring smooth data exchanges and process flows. Design and develop ETL … solutions that are robust, scalable, and efficient, focusing on accuracy and data consistency. Maintain and optimize existing data architecture, ensuring data integrity and performance are maintained to the highest standards. Validate and quality-check all outputs before delivering data to stakeholders, ensuring high levels of accuracy and reliability. Collaborate with both internal More ❯

prejudice, racism, sexism, harassment, bullying and any other form of marginalisation in our workplaces. Role Summary The Azure Stack BI Developer will play a key role in managing data integrations between our business and our parent company, ensuring the accuracy, reliability, and high quality of data outputs. This role involves designing and developing ETL solutions, maintaining … our data architecture, and supporting critical business processes. The ideal candidate will have a strong technical background, as well as excellent communication skills to engage with both technical and non-technical stakeholders. Role Responsibilities Support and manage integrations between our company and the parent company, ensuring smooth data exchanges and process flows. Design and develop ETL … solutions that are robust, scalable, and efficient, focusing on accuracy and data consistency. Maintain and optimize existing data architecture, ensuring data integrity and performance are maintained to the highest standards. Validate and quality-check all outputs before delivering data to stakeholders, ensuring high levels of accuracy and reliability. Collaborate with both internal More ❯

Overview Transform how leading brands leverage their data with Deloitte Digital. As a Salesforce Data Cloud and Martech Solution Architect, you will design and implement innovative data-driven solutions that power exceptional customer experiences. You will be a key player in architecting and delivering complex Martech solutions built on the Salesforce platform, integrating Data Cloud with other marketing technologies to create a unified customer view. Your expertise in data modelling, integration, and data governance will be crucial in helping clients unlock the full potential of their data assets, driving improved marketing ROI and enhanced customer engagement. Experience with large-scale data migration projects and … or culture. You will work with outstanding digital talent across disciplines to innovate and create great solutions for iconic brands. We are seeking a dynamic and skilled Salesforce Data Cloud Solution Architect with a unique blend of technical expertise and strategic acumen. The ideal candidate should possess profound knowledge in Salesforce Data Cloud as well as More ❯

Overview Transform how leading brands leverage their data with Deloitte Digital. As a Salesforce Data Cloud and Martech Solution Architect, you will design and implement innovative data-driven solutions that power exceptional customer experiences. You will be a key player in architecting and delivering complex Martech solutions built on the Salesforce platform, integrating Data Cloud with other marketing technologies to create a unified customer view. Your expertise in data modelling, integration, and data governance will be crucial in helping clients unlock the full potential of their data assets, driving improved marketing ROI and enhanced customer engagement. Experience with large-scale data migration projects and … or culture. You will work with outstanding digital talent across disciplines to innovate and create great solutions for iconic brands. We are seeking a dynamic and skilled Salesforce Data Cloud Solution Architect with a unique blend of technical expertise and strategic acumen. The ideal candidate should possess profound knowledge in Salesforce Data Cloud as well as More ❯

About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other engineering teams to ensure seamless data flow and accessibility, supporting data-driven decision-making. Our systems are designed … to handle large volumes of data, maintain quality and integrity, and provide robust APIs for fast, ergonomic data retrieval. About the Role In this role you will: Collaborate with cross-functional teams to deliver data solutions that support diverse trading activities. Take full ownership of data products, guiding them from initial concept … trading Experience with Linux-based, concurrent, high-throughput, low-latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelor or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent work experience For more More ❯

Head of Data Science (hands on) - FinTech Head of Data Science (hands on) - FinTech Head of Data Science (hands on) - FinTech Head of Data Science role with a fast growth B2B FinTech company, backed by multiple Billionaires and major global investment firm. You'll join an existing team of 2 Data Scientists in a wider business of 35 staff currently, and report into the Chief Product Officer. The CEO is a former Data Scientist so you'll be able to exchange notes! The Head of Data Science will work on: Credit risk models: working with the Chief Risk Officer to create advanced machine learning models … create the best environment for data and analytics whether that's to create rapid models that can be deployed in production or create a data lake using AWS Lake formation Apply now for this Head of Data Science role with rapid growth FinTech More ❯

Senior Platform Engineer £500-£600 per day Outside IR35 6-months Join one of the UK's leading online retailers as they evolve their next-generation data platform. This is an opportunity to shape the backbone of a modern data ecosystem, empowering analysts, ML engineers, and data scientists to deliver smarter, faster insights at … scale. The Role You'll play a key role in designing and engineering platform services that treat data as a core product. This means building scalable, secure, and observable systems that help teams confidently leverage data across the business. You'll work closely with a wide range of technical and non-technical partners to deliver resilient … Nice to Have Experience rolling out data governance and observability frameworks, including lineage tracking, SLAs, and data quality monitoring. Familiarity with modern data lake table formats such as Delta Lake, Iceberg, or Hudi. Background in stream processing (Kafka, Flink, or similar ecosystems). Exposure to containerisation and orchestration technologies such as Docker More ❯

Business Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Product Owner (Technical and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has worked … SIGNIFICANT products for large enterprise businesses. If you have come from the Big 4 on the Professional Services circuit, even better! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details Experience required: Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management:Demonstrated expertise More ❯

Business Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Product Owner (Technical and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has worked … SIGNIFICANT products for large enterprise businesses. If you have come from the Big 4 on the Professional Services circuit, even better! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details... Experience required: Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management: Demonstrated expertise More ❯

Technical Data Lead Central London Up to 150,000+ Benefits My client is seeking a Technical Data Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading insurance firm in London. This role requires a strong technical background in integration and data architectures, as well as … leadership experience managing both technical teams and client relationships. Key Skills & Experience: Proven experience as a Platform Technical Lead, Data Architect, or similar role, leading enterprise data platforms at scale. Strong technical expertise in Azure, AWS, Snowflake, Databricks, Data Lakes, and Kafka. Deep understanding of modern data platform architectures, including Lakehouse, Kappa … and Lambda. Experience designing and managing secure, scalable, and governed data platforms. Strong knowledge of Data Governance frameworks, access control, and compliance in enterprise environments. Experience with end-to-end data integration patterns and enterprise-grade data modeling. Knowledge of Data Fabric and Data Mesh concepts, with practical More ❯

Technical Data Lead Central London Up to £150,000+ Benefits My client is seeking a Technical Data Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading insurance firm in London. This role requires a strong technical background in integration and data architectures, as well as … leadership experience managing both technical teams and client relationships. Key Skills & Experience: Proven experience as a Platform Technical Lead, Data Architect, or similar role, leading enterprise data platforms at scale. Strong technical expertise in Azure, AWS, Snowflake, Databricks, Data Lakes, and Kafka. Deep understanding of modern data platform architectures, including Lakehouse, Kappa … and Lambda. Experience designing and managing secure, scalable, and governed data platforms. Strong knowledge of Data Governance frameworks, access control, and compliance in enterprise environments. Experience with end-to-end data integration patterns and enterprise-grade data modeling. Knowledge of Data Fabric and Data Mesh concepts, with practical More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

The Senior Data Engineer will play a pivotal role in developing and optimising data pipelines, ensuring the seamless flow of information across the organisation. The successful candidate will also be heavily involved in supporting our cloud migration project. Client Details Based in Manchester City Centre, we are a leader in our field in the UK and … serve over 35,000 customers with services like electrical testing, asset management, non-destructive testing (NDT), and inspections for infrastructure, manufacturing, and healthcare facilities. Description The Successful Senior Data Engineer will be responsible for but not limited to: · Development and implement data … and reporting solutions from our Dynamics, in-house and 3rd party sources, using the latest Microsoft technologies: Azure Synapse Analytics & Azure Data Factory, Azure Data Lake, Azure SQL Database Support older Microsoft Technologies whilst we are in transition: SSIS and SSRS. Supporting change and migration efforts. Work with other members of the team or directly More ❯

We are looking for a skilled data engineer to help build and maintain our data infrastructure. The ideal candidate will have expertise working with cloud data platforms and architecting robust and scalable data pipelines. This role is for contractors! Tasks As a Senior Data Engineer, you will work cross-functionally … to intake, process, transform, and store large amounts of data from various sources. You will build and maintain the core data infrastructure that powers the organisation's advanced analytics, machine learning applications, and data-driven decision-making. This role requires strong technical skills, problem-solving abilities, and excellent communication with stakeholders at all levels. … Requirements 10+ years of experience with building and maintaining data warehouses, data lakes, and other large-scale data storage systems Knowledge of ETL processes and data transformation techniques Ability to design and develop data aggregation and integration processes across different systems and environments Understanding of data architecture patterns More ❯