76 to 100 of 255 Data Lake Jobs in the South East

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

to technology. We are investing in our people, and the processes enabled by digital, to evolve and transform the student and staff experience at UAL. The Head of Data Architecture is a new senior leadership role within the Architecture and Data team, responsible for establishing and leading a new Data Architecture function within the … Digital & Technology directorate. The Head of Data Architecture will play a critical role in delivering the university’s 2032 Strategy by enabling data-driven decision-making, enhancing analytics capabilities, and embedding a culture of data governance and stewardship. You will be tasked with building a high-performing team and developing a robust operating model … that supports the university’s strategic goals. This includes designing and implementing a comprehensive data governance framework, ensuring data quality, and creating secure, scalable data systems that support planning, performance, and innovation across UAL. Working closely with senior leaders, academic colleges, and professional services, you will ensure that data is treated as More ❯

deliver innovative, reliable, and secure AI solutions that significantly improve operational efficiency and strategic business outcomes. Key Responsibilities: Technical Implementation of GenAI Capabilities Analyze, organize, and transform raw data into structured, usable formats. Build and maintain data systems, pipelines, and algorithms for advanced analytics and AI. Conduct complex data analysis to uncover trends, insights … and optimization opportunities. Prepare datasets for prescriptive and predictive modeling . Design, prototype, and validate GenAI applications aligned with business objectives. Combine data from multiple sources, ensuring data quality and reliability. Rapidly prototype user experiences for validation and testing. Implement LLMOps and automate workflows for AI lifecycle management. Build scalable, secure, and cost-efficient AI solutions … in cloud platforms - particularly Microsoft Azure and Databricks . Experience with tools and services such as: Azure Machine Learning, Azure AI Services, Azure OpenAI, AI Search, Data Lake Storage, Data Factory, Databricks, HDInsight, Azure Synapse Analytics, Azure SQL Database, Functions, and Azure DevOps. Strong programming skills in Python, Java, Scala, R, or .NET/C# More ❯

deliver innovative, reliable, and secure AI solutions that significantly improve operational efficiency and strategic business outcomes. Key Responsibilities: Technical Implementation of GenAI Capabilities Analyze, organize, and transform raw data into structured, usable formats. Build and maintain data systems, pipelines, and algorithms for advanced analytics and AI. Conduct complex data analysis to uncover trends, insights … and optimization opportunities. Prepare datasets for prescriptive and predictive modeling . Design, prototype, and validate GenAI applications aligned with business objectives. Combine data from multiple sources, ensuring data quality and reliability. Rapidly prototype user experiences for validation and testing. Implement LLMOps and automate workflows for AI lifecycle management. Build scalable, secure, and cost-efficient AI solutions … in cloud platforms – particularly Microsoft Azure and Databricks . Experience with tools and services such as: Azure Machine Learning, Azure AI Services, Azure OpenAI, AI Search, Data Lake Storage, Data Factory, Databricks, HDInsight, Azure Synapse Analytics, Azure SQL Database, Functions, and Azure DevOps. Strong programming skills in Python, Java, Scala, R, or .NET/C# More ❯

deliver innovative, reliable, and secure AI solutions that significantly improve operational efficiency and strategic business outcomes. Key Responsibilities: Technical Implementation of GenAI Capabilities Analyze, organize, and transform raw data into structured, usable formats. Build and maintain data systems, pipelines, and algorithms for advanced analytics and AI. Conduct complex data analysis to uncover trends, insights … and optimization opportunities. Prepare datasets for prescriptive and predictive modeling . Design, prototype, and validate GenAI applications aligned with business objectives. Combine data from multiple sources, ensuring data quality and reliability. Rapidly prototype user experiences for validation and testing. Implement LLMOps and automate workflows for AI lifecycle management. Build scalable, secure, and cost-efficient AI solutions … in cloud platforms – particularly Microsoft Azure and Databricks . Experience with tools and services such as: Azure Machine Learning, Azure AI Services, Azure OpenAI, AI Search, Data Lake Storage, Data Factory, Databricks, HDInsight, Azure Synapse Analytics, Azure SQL Database, Functions, and Azure DevOps. Strong programming skills in Python, Java, Scala, R, or .NET/C# More ❯

deliver innovative, reliable, and secure AI solutions that significantly improve operational efficiency and strategic business outcomes. Key Responsibilities: Technical Implementation of GenAI Capabilities Analyze, organize, and transform raw data into structured, usable formats. Build and maintain data systems, pipelines, and algorithms for advanced analytics and AI. Conduct complex data analysis to uncover trends, insights … and optimization opportunities. Prepare datasets for prescriptive and predictive modeling . Design, prototype, and validate GenAI applications aligned with business objectives. Combine data from multiple sources, ensuring data quality and reliability. Rapidly prototype user experiences for validation and testing. Implement LLMOps and automate workflows for AI lifecycle management. Build scalable, secure, and cost-efficient AI solutions … in cloud platforms particularly Microsoft Azure and Databricks . Experience with tools and services such as: Azure Machine Learning, Azure AI Services, Azure OpenAI, AI Search, Data Lake Storage, Data Factory, Databricks, HDInsight, Azure Synapse Analytics, Azure SQL Database, Functions, and Azure DevOps. Strong programming skills in Python, Java, Scala, R, or .NET/C# More ❯

Principal Data Architect Location: London (Hybrid) Contract Type: Permanent Shape the strategy. Build the architecture. Drive data transformation. About the Role We are looking for a Principal Data Architect to lead and deliver large-scale data architecture initiatives across enterprise clients within the financial services sector. This senior consulting position involves defining … data strategies, designing robust architectures, and implementing scalable, cloud-based platforms. The successful candidate will also help evolve and strengthen the organisations data architecture practice. Key Responsibilities Lead agile data transformation programmes focused on cloud and modern data architecture. Define and implement enterprise-wide data strategies that enable scalability and … cross-business alignment. Design, build, and optimise data platforms leveraging cloud-native technologies (AWS, Azure, or GCP). Integrate key data management capabilities, including governance, metadata, privacy, and cataloguing. Act as a trusted advisor, translating complex technical concepts into clear business outcomes. Required Skills and Experience 10+ years of professional experience in data architecture More ❯

Principal Data Architect Location: London (Hybrid) Contract Type: Permanent Shape the strategy. Build the architecture. Drive data transformation. About the Role We are looking for a Principal Data Architect to lead and deliver large-scale data architecture initiatives across enterprise clients within the financial services sector. This senior consulting position involves defining … data strategies, designing robust architectures, and implementing scalable, cloud-based platforms. The successful candidate will also help evolve and strengthen the organisations data architecture practice. Key Responsibilities Lead agile data transformation programmes focused on cloud and modern data architecture. Define and implement enterprise-wide data strategies that enable scalability and … cross-business alignment. Design, build, and optimise data platforms leveraging cloud-native technologies (AWS, Azure, or GCP). Integrate key data management capabilities, including governance, metadata, privacy, and cataloguing. Act as a trusted advisor, translating complex technical concepts into clear business outcomes. Required Skills and Experience 10+ years of professional experience in data architecture More ❯

Principal Data Architect Location: London (Hybrid) Contract Type: Permanent Shape the strategy. Build the architecture. Drive data transformation. About the Role We are looking for a Principal Data Architect to lead and deliver large-scale data architecture initiatives across enterprise clients within the financial services sector. This senior consulting position involves defining … data strategies, designing robust architectures, and implementing scalable, cloud-based platforms. The successful candidate will also help evolve and strengthen the organisation's data architecture practice. Key Responsibilities Lead agile data transformation programmes focused on cloud and modern data architecture. Define and implement enterprise-wide data strategies that enable scalability … and cross-business alignment. Design, build, and optimise data platforms leveraging cloud-native technologies (AWS, Azure, or GCP). Integrate key data management capabilities, including governance, metadata, privacy, and cataloguing. Act as a trusted advisor, translating complex technical concepts into clear business outcomes. Required Skills and Experience 10+ years of professional experience in data More ❯

Principal Data Architect Location: London (Hybrid) Contract Type: Permanent Shape the strategy. Build the architecture. Drive data transformation. About the Role We are looking for a Principal Data Architect to lead and deliver large-scale data architecture initiatives across enterprise clients within the financial services sector. This senior consulting position involves defining … data strategies, designing robust architectures, and implementing scalable, cloud-based platforms. The successful candidate will also help evolve and strengthen the organisation’s data architecture practice. Key Responsibilities Lead agile data transformation programmes focused on cloud and modern data architecture. Define and implement enterprise-wide data strategies that enable scalability … and cross-business alignment. Design, build, and optimise data platforms leveraging cloud-native technologies (AWS, Azure, or GCP). Integrate key data management capabilities, including governance, metadata, privacy, and cataloguing. Act as a trusted advisor, translating complex technical concepts into clear business outcomes. Required Skills and Experience 10+ years of professional experience in data More ❯

Private Equity Fund Programme Delivery Director for AI and Data projects London HQ, 200 employees £120K to £150K base + Bonus Onsite 4 Days a week - London, must be living within commuting distance to the central London office. New Programme Director role. with a Private Equity Fund, building a greenfield in-house AI and Data technical … consistent way of working across the organisation, ensuring that programmes and projects consistently deliver measurable business outcomes. Key Responsibilities: Working with the portfolio companies - building bespoke AI, ML, Data services Be the bridge between the internal software development team and outbound Portfolio teams Establish a cohesive delivery operating model Implement structured mechanisms for programme and project planning Programme … Leadership and Execution Stakeholder Engagement & Communication Change Management Data Transformation Managing internal Project Managers Projects include: AI, Dashboards, Cloud Infrastructure, Data pipelines, Data Lake, Data models. Experience & Background Proven track record of implementing world-class programme management and delivery frameworks at scale, from portfolio planning through to day-to-day execution More ❯

Private Equity Fund Programme Delivery Director for AI and Data projects London HQ, 200 employees £120K to £150K base + Bonus Onsite 4 Days a week - London, must be living within commuting distance to the central London office. New Programme Director role. with a Private Equity Fund, building a greenfield in-house AI and Data technical … consistent way of working across the organisation, ensuring that programmes and projects consistently deliver measurable business outcomes. Key Responsibilities: Working with the portfolio companies - building bespoke AI, ML, Data services Be the bridge between the internal software development team and outbound Portfolio teams Establish a cohesive delivery operating model Implement structured mechanisms for programme and project planning Programme … Leadership and Execution Stakeholder Engagement & Communication Change Management Data Transformation Managing internal Project Managers Projects include: AI, Dashboards, Cloud Infrastructure, Data pipelines, Data Lake, Data models. Experience & Background Proven track record of implementing world-class programme management and delivery frameworks at scale, from portfolio planning through to day-to-day execution More ❯

Private Equity Fund Programme Delivery Director for AI and Data projects London HQ, 200 employees £120K to £150K base + Bonus Onsite 4 Days a week - London, must be living within commuting distance to the central London office. New Programme Director role. with a Private Equity Fund, building a greenfield in-house AI and Data technical … consistent way of working across the organisation, ensuring that programmes and projects consistently deliver measurable business outcomes. Key Responsibilities: Working with the portfolio companies - building bespoke AI, ML, Data services Be the bridge between the internal software development team and outbound Portfolio teams Establish a cohesive delivery operating model Implement structured mechanisms for programme and project planning Programme … Leadership and Execution Stakeholder Engagement & Communication Change Management Data Transformation Managing internal Project Managers Projects include: AI, Dashboards, Cloud Infrastructure, Data pipelines, Data Lake, Data models. Experience & Background Proven track record of implementing world-class programme management and delivery frameworks at scale, from portfolio planning through to day-to-day execution More ❯

Data Engineer, Azure London/Hybrid £competitive + bonus + excellent benefits Azure, Fabric, Python Data Engineer with extensive cloud experience is sought by thriving financial services organisation in the City of London. As part of the central data platform team, you will be responsible for developing the Data Engineering standards to … be followed by federated data teams across the business. Within these standards our client is looking to create a Data Engineering development environment that has the flexibility to ensure engineers work as efficiently as possible while operating within the security constraints outlined by the business. Responsibilities Work with Product Owners to establish product requirements. Design and … engineering tools on a variety of complex products. Python Semantic Models Azure Data Factory Azure Synapse SQL Server ETL/ELT Database Design Data Warehousing Datalake/Lakehouse For a full consultation on this exciting new opportunity, get in touch with Arc IT today More ❯

Data Architect- £100,000 - Hybrid We're looking for a Data Architect to take a leading role in designing and evolving the backbone of our data ecosystem. This is a strategic, high-impact role where your expertise will define how we model, store, and use data across the business. You'll shape … the technical direction of our data landscape-developing scalable, secure, and future-ready systems that enable insight, innovation, and growth. What You'll Do Design and implement scalable data architectures, models, and integration frameworks. Lead the definition of the "As-Is" and "To-Be" data platform vision, ensuring alignment with business goals. Oversee the … end-to-end data lifecycle-from modelling and ingestion to governance, storage, and delivery. Ensure compliance with GDPR and data protection standards. Collaborate with engineering, delivery, and business teams to translate strategic objectives into technical solutions. Provide technical leadership and guidance across data initiatives, influencing best practice and architectural standards. Safeguard the integrity, availability More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Mid-Level Azure Data Engineer - Investment Management - London/Hybrid We're partnered with a small but forward-thinking Investment Management company in London that's continuing to evolve its data capabilities. They're now looking for a Mid-Level Azure Data Engineer to join a team of five engineers and analysts who are … driving the build and optimisation of a modern Azure-based data platform. This is a great opportunity for someone who enjoys working end-to-end across the data lifecycle and wants to have real influence in a close-knit, collaborative environment. You'll be working with the latest Azure technologies to help the business make smarter … environment that values collaboration, learning, and innovation What we're looking for Hands-on experience with the Azure Data Engineering stack (ADF, Databricks, Synapse, Data Lake) Strong skills in SQL and Python (PySpark experience is a bonus) Experience building and optimising ETL/ELT pipelines A background in Financial Services is a plus, but not More ❯

Were looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless data … transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining … the roadmap, proposing scalable Azure-native solutions, and collaborating with the Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure More ❯