1 to 25 of 55 Data Lake Jobs in the City of London

we are looking for a Head of BI to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with … years' experience in Business Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation . Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation … of BI will work within a modern, cloud-based BI ecosystem , including : Data Integration: Fivetran , HVR, Databricks , Apache Kafka, Google BigQuery , Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST API Advanced Analytics More ❯

Role: Senior or Lead Data Architect Location: UK-wide, with a preference towards London Salary: £80,000 - £130,000 + Bonus + Benefits Package Clearance: Must be eligible to work in the UK We’re working with a world-leading consultancy that’s delivering cutting-edge data and cloud architecture across some of the UK’s … most recognisable enterprises. As their Data & Intelligence practice continues to expand, we’re looking for experienced Senior Data Architects as well as proven Lead Data Architects to join the team. Whether your strength lies in hands-on solution architecture or enterprise-wide strategy, there’s a place for you to lead, shape and scale … modern data capabilities across sectors like public services, finance, telco, manufacturing, and retail. About the Role You’ll be embedded into high-impact client projects, defining, designing, and delivering modern data platforms, from initial strategy and modelling through to governance, integration, and delivery. Roles are tailored to experience, Senior Architects will lead solution and delivery workstreams More ❯

Senior Data Engineering Consultant - MS Fabric - London - Hybrid - £80k My client are an emerging Microsoft-partnered consultancy looking to expand their data engineering team. If you are an expert data engineer with Microsoft products and a consultancy background, this should be a great fit for you. Salary and Benefits Competitive salary of up to … working (2-3 days in London-based office) Competitive annual leave package Private medical care Health insurance And many more Role and Responsibilities Possess a wide range of data engineering skills, with a focus on having delivered in Microsoft Fabric Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused … colleagues. Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. Delivering high-quality pieces of work, proven ability to escalate problems to client/senior team members where necessary and propose possible solutions. Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge More ❯

Fast Track and published in The Sunday Times each September, celebrates Britain's private mid-market growth companies with the biggest performance. Purpose : We are seeking an experienced Data Engineer to join our growing team. In this role, you will be responsible for overseeing the planning, development, and design of data engineering processes within a customer … facing data warehousing product. This product plays a critical role in delivering analytics solutions for both the State and Commercial sectors. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. You will build predictive … years Experience in Data Engineering Strong Data Engineer Language Skills (Python, SQL, Javascript) Experience of Azure, AWS or GCP cloud platforms and Data Lake/Warehousing Platforms such as Snowflake, Iceberg etc Experience of various ETL and Streaming Tools (Flink, Spark) Experience of a variety of data mining techniques (APIs, GraphQL More ❯

Product Owner (Data & Analytics) London Hybrid - 3 days pw onsite £60,000 to £75,000 We currently have an exciting opportunity for a Data Product Owner to join a one-of-a-kind customer centric organisation in the not-for-profit space, whose solutions support customers and their families across the UK. In this role, you … ll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business … stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring More ❯

Location: London Contract Type: Contract Working Model: Hybrid Overview: We are seeking an experienced Data Architect to join our growing data team and lead the design and implementation of scalable, secure, and high-performance data solutions. You’ll play a key role in architecting modern data platforms using Snowflake , SQL , Python , and … leading cloud technologies to support advanced analytics, reporting, and machine learning initiatives across the business. Key Responsibilities: Design and maintain end-to-end data architectures, data models, and pipelines in Snowflake and cloud platforms (AWS, Azure, or GCP). Develop and optimize scalable ELT/ETL processes using SQL and Python. Define data governance … tools (e.g., Airflow, dbt) and version control (Git). Solid understanding of data governance, security, and compliance frameworks . Nice to Have: Experience with data lake architectures (Delta Lake, Lakehouse). Familiarity with BI/visualization tools (Tableau, Power BI, Looker). Knowledge of streaming data tools (Kafka, Kinesis). Background in More ❯

The Opportunity A leading global consultancy organisation is seeking a skilled Data Architect to design and deliver robust, scalable data platforms on Google Cloud Platform (GCP). The ideal candidate will bring extensive experience in building and maintaining large-scale data warehouses, ensuring high standards of data quality, and adhering to best … practices in data architecture. Key Responsibilities Define and develop the overall data strategy in line with client requirements and compliance standards. Lead and mentor a team of data engineers to implement scalable and efficient data solutions. Translate business needs into technical solutions by collaborating with both technical and non-technical stakeholders. Ensure … data platforms follow GCP best practices for performance, reliability, and security. Required Skills and Experience Proven background in designing data warehouse and data lake architectures. Demonstrable experience in building and operating large-scale data platforms on Google Cloud Platform, with a focus on data quality at scale. Hands-on More ❯

Job Title: Data Engineer (Fabric, Synapse & ADF) Location: Remote (UK-based candidates only) Contract: 3–6 Month Rolling Contract IR35 Status: Outside IR35 Day Rate: £500–£600 per day Overview: We’re looking for an experienced Data Engineer to join a dynamic team working across a variety of exciting data projects. This role involves … a blend of greenfield builds, brownfield enhancements, and support of existing solutions, giving you the chance to work across the full data engineering lifecycle. This is a remote-based position, open to UK-based candidates only, and is offered on an Outside IR35 basis. Key Responsibilities: Design, build, and maintain scalable data pipelines using Microsoft Fabric … brownfield projects. Comfortable working independently in a remote setup. Strong communication and stakeholder engagement skills. Nice to Have: Experience with other Azure services such as Azure Data Lake, Databricks, or Power BI. Familiarity with DevOps/DataOps processes and tools. Microsoft Certified: Fabric Analytics Engineer Associate Start Date: ASAP or July start acceptable Apply now to join More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical … functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the … firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the … front-office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to … streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for new data solutions More ❯

London/Hybrid | 💷 £750/day | 🗓 12-Month Rolling | ✅ Outside IR35 Our client, a leading Investment Management firm, is looking for a contract Data Engineer with strong Python and Databricks skills to help drive their data platform modernisation. You’ll be working on business-critical data pipelines and analytics infrastructure, supporting both investment and … operations teams. This is a hands-on role in a fast-moving environment, ideal for someone who thrives in financial services. What you’ll be doing: Building scalable data pipelines in Python and Databricks Designing data models to support analytics, reporting & regulatory needs Working with cloud-based data platforms (Azure preferred … Partnering closely with data analysts, quants, and tech teams Tech you’ll be using: Python (strong hands-on coding essential) Databricks/Spark Azure Data Lake/Delta Lake SQL/ETL frameworks CI/CD tools and version control (Git, Azure DevOps) What we’re looking for: Strong commercial experience as a Data More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … experience in implementing solutions around Synpase, Azure Data Factory, Onelake, and Fabric. Excellent understanding of Microsoft SQL Server and data modelling, An understanding of One Lake, Data Factory, Notebooks, Fabric (MUST), and Data Pipelines. Strong understanding of the wider Microsoft solution stack. Strong hands-on experience in Data Warehouse … and Data Lake technologies, preferably around Azure. This role is an urgent requirement; there are limited interview slots left. If interested, send an up-to-date CV to Shoaib Khan - S.Khan@Tenthrevolution.com or call 0191 338 7493 for a catch-up in complete confidence. TRG's Data Team offers more opportunities across the UK than More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

Data Engineering Manager | Top Brokerage in London | £110,000 - £120,000 Base + Bonus I'm looking for an experienced Data Engineering Manager to join a leading Brokerage in Central London and lead an initial team of 2 Senior Data Engineers. You will be responsible for managing large-scale data pipelines, ensuring … data quality and integrity, and supporting cross-functional teams with reliable and scalable data solutions—primarily using Microsoft Azure, Python, Databricks , as well as the integration of Microsoft Fabric . This role will require 3 days a week onsite in their state of the art office and will remain a technically hands on role. Key Responsibilities … Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure Synapse). Use Python for data manipulation, transformation, and automation tasks. Collaborate with data More ❯

My client is based in the London area are currently looking to recruit for an experienced AWS Databricks Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Data Architect to join their team. They … the market. Your role will include: Responsible for designing and implementing effective Architectural solutions around the AWS Severless Technologies (S3, Lambda, Athena, Kafka) and Databricks including Data Lake and Data Warehousing. Assess database implementation procedures to ensure they comply with GDPR and data compliance. Guide, influence and challenge the technology teams and stakeholders … Terraform, Excellent understanding of Data Modelling & Kinesis An understanding of SQL/database management. Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around AWS. My client is providing access to; Hybrid 2 days (London), 28 Days Holiday, Plus Bank Holiday Private Medical Health Pension Scheme And More... This role More ❯

Senior Engineering Manager – Data Platform Tech Stack Knowledge - Databricks, Kafka, AWS 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager – Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform — encompassing experimentation frameworks, event ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities … Partner with cross-functional stakeholders in Product, Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1–2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and More ❯

Our client a London based Technology and Data Engineering leader have an opportunity in a high growth AI Lab for an ‘AI Engineering Researcher' A UK based 'Enterprise' Artificial Intelligence organisation, focussing on helping accelerate their clients journey towards becoming 'AI-Optimal' - starting with significantly enhancing its abilities in leveraging AI & machine intelligence to outperform traditional competition. The … expanding research team of exceptional PhD computer scientists, software engineers, mathematicians & physicists, to use a unique multi-disciplinary approach to solving enterprise-AI problems. Principal Activities of role: Data Pipeline Development: • Design, develop, and maintain ETL processes to efficiently ingest data from various sources into data warehouses or data lakes. • Data Integration and Management: Integrate data from disparate sources, ensuring data quality, consistency, and security across systems. Implement data governance practices and manage metadata. • System Architecture: Design robust, scalable, and high-performance data architectures using cloud-based platforms (e.g., AWS, Google Cloud, Azure). • Performance Optimization: Monitor, troubleshoot, and optimize data More ❯

A leading, technology-focused, multi-strategy Hedge Fund are seeking a Senior Data Engineer (Front Office) to join their innovative and highly experienced team Essential Skills: 5+ years of experience with a proven track records of building data platforms Expert-level Python and SQL skills (C++ experience is a plus, but not essential) Interest in contributing … merging technology and research to solve some of the most complex challenges and deliver high-quality returns. This flexible role (2 days WFH) involves building and supporting bespoke data solutions for Quants and Traders, and developing a scalable, global Data Lakehouse used by multiple trading … desks. You’ll design and implement data pipelines in Python within an AWS cloud environment, working on data modelling for large-scale Data Lake and OLAP systems. Key responsibilities will include optimising performance in cross-region setups, ensuring data completeness and quality, and contributing to the software and infrastructure design. This More ❯

result in low levels of production issues Awareness of industry best practice and new and upcoming technology trends Full solution architectural understanding across networking and software Experience of data programmes and data technologies, ideally gained within an enterprise scale organisation or within technology or development team or similar. Technical exposure to and/or experience in … a range of technologies and architectural best practice concepts, specifically Data … Engineering Design Snowflake expert with hands-on experience of data modelling and best practises MS Azure Data Stack - Data Factory, Data Lake Storage, Azure SQL, Azure ML, Power BI Automation of CICD pipelines across different technologies including Power BI, Snowflake and the Azure Data Stack Data Science More ❯

Data Scientist Hybrid – London (3 days a week) Up to £75,000 + Pension + Share Scheme About the Role We’re working with a professional services firm undergoing a major data transformation, now looking to bring on board their first in-house Data Scientist . Reporting directly into the CFO, you’ll take … the lead on developing and managing the firm’s data infrastructure, starting with the continued build-out and integration of their data lake. You’ll work on high-impact reporting and analytics projects, and long-term, deliver commercially focused data science solutions such as price optimisation and revenue forecasting. This is a hands-on … uncover opportunities to use data more effectively across the organisation. Key Responsibilities Build and manage data pipelines and infrastructure, including a developing data lake Support reporting projects and ongoing Power BI development Deliver commercial data science solutions (e.g., forecasting, optimisation) Integrate data from a variety of internal systems and More ❯

Azure Data Architects x 2 The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk and shorten … and support staff. Mostly remote some Ad hoc travel (London) Eligble for BPSS or SC clearance Digital Transformation Project About the Role: We are seeking highly skilled Azure Data Architects who have worked for the NHS to join our dynamic team. In this role, you will be responsible for designing and implementing end-to-end cloud solutions on … such as: Azure Synapse Analytics Azure Data Factory Azure Databricks Azure SQL & Cosmos DB Azure Purview (for Data Governance) Azure Blob Storage & Data Lake Azure Event Hubs & Streaming Analytics Hands-on experience with data integration, ETL/ELT pipelines, and batch/real-time processing. Strong knowledge of data More ❯

Data Platforms Product Owner | Technical Data Background | Banking/Cards/Insurance | London (hybrid) | £600/day (Inside IR35) | 6 month initial contract Our London based Financial Services client is looking for a Technical Data Platforms Product Owner to work on a large project. You'll have a solid data/tech … background, preferably in Financial Services. You'll have the ability to write the User Stories for the Data Engineers and tell the Architect what you need in the Data Model - and you'll define the data platforms roadmap. You will also have good experience around ADF, Azure DataBricks, and Snowflake - plus your knowledge will … include ETL processes, Data Governance, Data Warehouses, Data Marts, and Data Lakes. Key Skills & Experience: Product Owner Data Platforms Roadmap User Stories Snowflake Azure Data Factory/Azure Data Bricks Data Models Great Communication skills This role would be based in the City of More ❯

Senior Data Engineer London/Hybrid 2 days per week Permanent Salary: Up to £90,000 We have partnered with a leading investment firm who are seeking a Senior Data Engineer. They have garnered a strong reputation in delivering solutions across the full investment life cycle. They are looking for a skilled and hands-on Senior … Data Engineer to design and build scalable data pipelines to support evolving business and technology needs. This is a key role and will contribute significantly to the company's vision of becoming a data-centric organisation. The ideal candidate will have demonstrable experience with the modern Azure tech stack and a deep understanding of … ingesting and transforming data from diverse internal and external sources. Key Responsibilities: Design and implement robust data solutions to support a modern cloud-native data warehouse. Provide technical leadership and identify effective solutions for complex data-related challenges. Perform and participate in peer reviews of design, code, and tests, ensuring high-quality More ❯

We’re looking for a Senior Data Engineer to join a high-performance trading firm operating at the forefront of the digital assets space. This is a hands-on role within a global data engineering team, with the opportunity to shape how data is handled across the business. You'll design and build scalable … data pipelines, manage modern cloud-native infrastructure, and ensure data is reliable, secure, and accessible in a fast-paced environment. Responsibilities: Build and maintain efficient, scalable ETL/ELT pipelines for both real-time and batch processing. Design and manage data storage solutions across databases, warehouses, and data lakes. Integrate data from APIs, streaming platforms, and legacy systems. Optimize data infrastructure for performance, cost, and observability. Implement data governance, access control, and security best practices. Collaborate with engineering and business teams to deliver high-impact solutions. Contribute to CI/CD workflows, documentation, and team-wide tooling improvements. Requirements: 8+ years of experience in data More ❯