26 to 50 of 120 Data Lake Jobs in the City of London

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … Modelling. 7+ years of hands-on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. Experience on Data Modelling, architecture, implementation & Testing. Experienced in designing & implementation of End-to-End Data More ❯

Microsoft Fabric Consultant Location: London/Hybrid Job Type: Salary: £65,000 to £75,000 + 10% Bonus, Pension, 25 days holiday, health + other benefits Microsoft Fabric | Data Modelling | Azure | Power BI Overview: A leading Data & Analytics consultancy is seeking a Microsoft Fabric Consultant to join their growing team. This is a hands-on role … focused on designing and delivering enterprise-grade solutions using Microsoft Fabric technologies. You’ll work closely with clients and internal teams to build scalable data pipelines, semantic models, and visualizations that support advanced analytics and business intelligence. This is an opportunity for you to own the new fabric division which will be focusing on clients who are going … Microsoft Fabric (Data Factory, Lakehouse, Power BI) Strong proficiency in SQL, DAX, and Power Query (M) Experience with Azure Data Services (Synapse, Data Lake, Azure SQL) Solid understanding of data modelling, ETL processes, and BI architecture Familiarity with CI/CD pipelines, DevOps, and version control (Git) Excellent communication and stakeholder More ❯

Senior Consultant – Data Architecture (Management Level) Location: London (Hybrid) | Practice Area: Data & Analytics | Type: Permanent Design the vision. Architect the strategy. Drive enterprise transformation. The Role We’re looking for a Senior Consultant in Data Architecture to lead the design and delivery of scalable, cloud-enabled data solutions for enterprise clients. You … ll define architecture strategies, shape data platforms, and guide organisations through modernisation initiatives that turn data into a strategic asset. This is a client-facing leadership role at the intersection of technology, strategy, and delivery. Key Responsibilities Lead client engagements focused on data architecture and modernisation. Define enterprise data strategies, architecture principles … and implementation roadmaps. Design and deliver cloud-native data platforms (AWS, Azure, GCP) and integration frameworks. Embed governance, security, and metadata management into architecture design. Translate complex technical concepts into business outcomes for stakeholders. Oversee project delivery and mentor junior consultants. Required Experience 4+ years’ experience in data architecture, data engineering, or enterprise data More ❯

Senior Consultant – Data Architecture (Management Level) Location: London (Hybrid) | Practice Area: Data & Analytics | Type: Permanent Design the vision. Architect the strategy. Drive enterprise transformation. The Role We’re looking for a Senior Consultant in Data Architecture to lead the design and delivery of scalable, cloud-enabled data solutions for enterprise clients. You … ll define architecture strategies, shape data platforms, and guide organisations through modernisation initiatives that turn data into a strategic asset. This is a client-facing leadership role at the intersection of technology, strategy, and delivery. Key Responsibilities Lead client engagements focused on data architecture and modernisation. Define enterprise data strategies, architecture principles … and implementation roadmaps. Design and deliver cloud-native data platforms (AWS, Azure, GCP) and integration frameworks. Embed governance, security, and metadata management into architecture design. Translate complex technical concepts into business outcomes for stakeholders. Oversee project delivery and mentor junior consultants. Required Experience 4+ years’ experience in data architecture, data engineering, or enterprise data More ❯

Remote Data Architect sought by a well-established company in their industry; our client is seeking an adept professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. This unique opportunity is offered on a … remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: - Leading the design and implementation of innovative cloud data platforms. - Setting standards … business intelligence roles. - Proficiency in ETL and data pipeline design, with a technology-agnostic approach. - A solid understanding of data warehouse and data lake principles. - Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known for innovation and excellence. More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

deliver innovative, reliable, and secure AI solutions that significantly improve operational efficiency and strategic business outcomes. Key Responsibilities: Technical Implementation of GenAI Capabilities Analyze, organize, and transform raw data into structured, usable formats. Build and maintain data systems, pipelines, and algorithms for advanced analytics and AI. Conduct complex data analysis to uncover trends, insights … and optimization opportunities. Prepare datasets for prescriptive and predictive modeling . Design, prototype, and validate GenAI applications aligned with business objectives. Combine data from multiple sources, ensuring data quality and reliability. Rapidly prototype user experiences for validation and testing. Implement LLMOps and automate workflows for AI lifecycle management. Build scalable, secure, and cost-efficient AI solutions … in cloud platforms – particularly Microsoft Azure and Databricks . Experience with tools and services such as: Azure Machine Learning, Azure AI Services, Azure OpenAI, AI Search, Data Lake Storage, Data Factory, Databricks, HDInsight, Azure Synapse Analytics, Azure SQL Database, Functions, and Azure DevOps. Strong programming skills in Python, Java, Scala, R, or .NET/C# More ❯

deliver innovative, reliable, and secure AI solutions that significantly improve operational efficiency and strategic business outcomes. Key Responsibilities: Technical Implementation of GenAI Capabilities Analyze, organize, and transform raw data into structured, usable formats. Build and maintain data systems, pipelines, and algorithms for advanced analytics and AI. Conduct complex data analysis to uncover trends, insights … and optimization opportunities. Prepare datasets for prescriptive and predictive modeling . Design, prototype, and validate GenAI applications aligned with business objectives. Combine data from multiple sources, ensuring data quality and reliability. Rapidly prototype user experiences for validation and testing. Implement LLMOps and automate workflows for AI lifecycle management. Build scalable, secure, and cost-efficient AI solutions … in cloud platforms – particularly Microsoft Azure and Databricks . Experience with tools and services such as: Azure Machine Learning, Azure AI Services, Azure OpenAI, AI Search, Data Lake Storage, Data Factory, Databricks, HDInsight, Azure Synapse Analytics, Azure SQL Database, Functions, and Azure DevOps. Strong programming skills in Python, Java, Scala, R, or .NET/C# More ❯

Principal Data Architect Location: London (Hybrid) Contract Type: Permanent Shape the strategy. Build the architecture. Drive data transformation. About the Role We are looking for a Principal Data Architect to lead and deliver large-scale data architecture initiatives across enterprise clients within the financial services sector. This senior consulting position involves defining … data strategies, designing robust architectures, and implementing scalable, cloud-based platforms. The successful candidate will also help evolve and strengthen the organisation’s data architecture practice. Key Responsibilities Lead agile data transformation programmes focused on cloud and modern data architecture. Define and implement enterprise-wide data strategies that enable scalability … and cross-business alignment. Design, build, and optimise data platforms leveraging cloud-native technologies (AWS, Azure, or GCP). Integrate key data management capabilities, including governance, metadata, privacy, and cataloguing. Act as a trusted advisor, translating complex technical concepts into clear business outcomes. Required Skills and Experience 10+ years of professional experience in data More ❯

Principal Data Architect Location: London (Hybrid) Contract Type: Permanent Shape the strategy. Build the architecture. Drive data transformation. About the Role We are looking for a Principal Data Architect to lead and deliver large-scale data architecture initiatives across enterprise clients within the financial services sector. This senior consulting position involves defining … data strategies, designing robust architectures, and implementing scalable, cloud-based platforms. The successful candidate will also help evolve and strengthen the organisation’s data architecture practice. Key Responsibilities Lead agile data transformation programmes focused on cloud and modern data architecture. Define and implement enterprise-wide data strategies that enable scalability … and cross-business alignment. Design, build, and optimise data platforms leveraging cloud-native technologies (AWS, Azure, or GCP). Integrate key data management capabilities, including governance, metadata, privacy, and cataloguing. Act as a trusted advisor, translating complex technical concepts into clear business outcomes. Required Skills and Experience 10+ years of professional experience in data More ❯

Private Equity Fund Programme Delivery Director for AI and Data projects London HQ, 200 employees £120K to £150K base + Bonus Onsite 4 Days a week - London, must be living within commuting distance to the central London office. New Programme Director role. with a Private Equity Fund, building a greenfield in-house AI and Data technical … consistent way of working across the organisation, ensuring that programmes and projects consistently deliver measurable business outcomes. Key Responsibilities: Working with the portfolio companies - building bespoke AI, ML, Data services Be the bridge between the internal software development team and outbound Portfolio teams Establish a cohesive delivery operating model Implement structured mechanisms for programme and project planning Programme … Leadership and Execution Stakeholder Engagement & Communication Change Management Data Transformation Managing internal Project Managers Projects include: AI, Dashboards, Cloud Infrastructure, Data pipelines, Data Lake, Data models. Experience & Background Proven track record of implementing world-class programme management and delivery frameworks at scale, from portfolio planning through to day-to-day execution More ❯

Private Equity Fund Programme Delivery Director for AI and Data projects London HQ, 200 employees £120K to £150K base + Bonus Onsite 4 Days a week - London, must be living within commuting distance to the central London office. New Programme Director role. with a Private Equity Fund, building a greenfield in-house AI and Data technical … consistent way of working across the organisation, ensuring that programmes and projects consistently deliver measurable business outcomes. Key Responsibilities: Working with the portfolio companies - building bespoke AI, ML, Data services Be the bridge between the internal software development team and outbound Portfolio teams Establish a cohesive delivery operating model Implement structured mechanisms for programme and project planning Programme … Leadership and Execution Stakeholder Engagement & Communication Change Management Data Transformation Managing internal Project Managers Projects include: AI, Dashboards, Cloud Infrastructure, Data pipelines, Data Lake, Data models. Experience & Background Proven track record of implementing world-class programme management and delivery frameworks at scale, from portfolio planning through to day-to-day execution More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining … the roadmap, proposing scalable Azure-native solutions, and collaborating with the Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining … the roadmap, proposing scalable Azure-native solutions, and collaborating with the Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure More ❯

A leading global investment firm is seeking a Market Data Engineer to join its London-based team and help build robust, scalable tick data infrastructure that powers systematic trading strategies across asset classes. This is a high-impact engineering role focused on designing and optimizing real-time and historical market data pipelines in a … cloud-native environment. You'll work closely with trading and quant teams to ensure data is clean, fast, and accessible - enabling research, signal generation, and execution at scale. What You'll Do Build and maintain high-performance tick data pipelines for ingesting, processing, and storing large volumes of market data. Work with time-series databases (e.g. … access and retrieval. Design scalable cloud-native solutions (AWS preferred) for market data ingestion and distribution. (Bonus) Integrate Apache Iceberg for large-scale data lake management and versioned data workflows. Collaborate with trading and engineering teams to define data requirements and deliver production-grade solutions. Implement robust data More ❯

A leading global investment firm is seeking a Market Data Engineer to join its London-based team and help build robust, scalable tick data infrastructure that powers systematic trading strategies across asset classes. This is a high-impact engineering role focused on designing and optimizing real-time and historical market data pipelines in a … cloud-native environment. You'll work closely with trading and quant teams to ensure data is clean, fast, and accessible - enabling research, signal generation, and execution at scale. What You'll Do Build and maintain high-performance tick data pipelines for ingesting, processing, and storing large volumes of market data. Work with time-series databases (e.g. … access and retrieval. Design scalable cloud-native solutions (AWS preferred) for market data ingestion and distribution. (Bonus) Integrate Apache Iceberg for large-scale data lake management and versioned data workflows. Collaborate with trading and engineering teams to define data requirements and deliver production-grade solutions. Implement robust data More ❯

Senior Architect - (Data Enterprise Architecture) Salary: Up to £130,000 Hybrid: 3 days a week Industry: Financial Services/Highly regulated environment Job Summary: We are searching for an Enterprise Architect on behalf of a progressive financial services firm. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure … with Data architecture as the cornerstone of their digital ecosystem. This is a greenfield opportunity to establish enterprise-wide data governance frameworks and design scalable data platforms. You'll define architectural standards that enable advanced analytics, AI/… ML capabilities, and regulatory compliance while solving complex data integration, quality, and lineage challenges. Deep knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI. This role is perfect for a strategic thinker who can bridge business objectives with technical execution, translating data challenges into architectural More ❯

Senior Architect - (Data Enterprise Architecture) Salary: Up to £130,000 Hybrid: 3 days a week Industry: Financial Services/Highly regulated environment Job Summary: We are searching for an Enterprise Architect on behalf of a progressive financial services firm. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure … with Data architecture as the cornerstone of their digital ecosystem. This is a greenfield opportunity to establish enterprise-wide data governance frameworks and design scalable data platforms. You'll define architectural standards that enable advanced analytics, AI/… ML capabilities, and regulatory compliance while solving complex data integration, quality, and lineage challenges. Deep knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI. This role is perfect for a strategic thinker who can bridge business objectives with technical execution, translating data challenges into architectural More ❯

Business Product Owner, Data Analytics, Azure, Data Engineering, AI, ML, Azure, Mainly Remote Product Owner (Technical and Business) required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has worked … SIGNIFICANT products for large enterprise businesses. If you have come from the Big 4 on the Professional Services circuit, even better! The platform primarily serves two key personas: Data and Intelligence Delivery specialists, who manage data ingestion, transformation, and orchestration processes, and Assurance professionals, who use the analysers to enhance audit quality and client service. This … DATA HEAVY Product Owners who have managed complex, Global products. Read on for more details Experience required: Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management:Demonstrated expertise More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a hedge fund or HFT shop, you’ll know what this … role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to … building the core platform used by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯