101 to 125 of 1,171 Data Lake Jobs in the UK

Social network you want to login/join with: We are the leading independent provider of harmonised Level 3 historical data and analytics to the world’s most sophisticated capital market participants. BMLL offers banks, brokers, asset managers, hedge funds and global exchange groups immediate and flexible access to the most granular Level 3, T+1 order book data … will have a tangible effect on the business, with a blend of data science, sales, and marketing. Advanced Resources: Access to a petabyte-scale data lake and an award-winning data science environment to drive your analysis. High-Impact Projects: Contribute to high-impact initiatives, working with a diverse range of clients. Innovation … and gather feedback that shapes the evolution of the product. Leverage Advanced Resources: Assist in technical prototyping for external partners and clients, utilizing a petabyte-scale data lake and cutting-edge data science tools. Contribute to Product Development: Support the product team in the development and management of the product roadmap, generating ideas, and actively More ❯

healthcare, research, and education as we look to establish and develop a hub for our wide-ranging innovation work across the Trust. We recognise that the Trust's data represents one of our most potent assets to support innovation, as well as research and quality improvement. But we have yet to fully exploit its potential. Our new Clinical … Data Science and Engineering Unit will be the vital engine room for curating, sharing and utilising our data for novel purposes outside of the routine operations of hospital. It will work collaboratively with the Trust's core digital and data functions, performance and analytics, clinical and operational staff, academics and commercial partners to discover … structures Skills Essential Confidence and skilled in adapting to new software and programming language Skilled in implementation and optimization of data management systems (Databases/Datasets/DataLakes/Lakehouses) Ability to design and implement data pipeline technologies to extract sensitive information from databases/datasets to help understand a process or solve a problem and More ❯

Job Description My client, based in the London area, is currently looking to recruit an experienced Lead GCP Data Architect to join their team. They are a leader within the consulting space, experiencing growth and looking to enhance their team. Backed by a major multi-asset firm, they aim to strengthen their financial position and are adopting cutting … edge technologies, including Gen AI. Your role will include: Enterprise Architecture & Delivery: Spearhead design and implementation of scalable data ecosystems—spanning data lakes, lakehouses, and warehouses—using platforms such as GCP, BigQuery, Snowflake, Synapse, or Microsoft Fabric. Cloud Transformation Strategy: Lead cloud adoption and modernization initiatives across GCP, utilizing infrastructure-as-code (e.g., Terraform), CI/… Strong knowledge of data modeling (physical, logical, conceptual). Understanding of enterprise-level architecture. Hands-on experience with GCP data warehouse and data lake technologies. My client offers: Hybrid work (2 days in London) 28 days holiday plus bank holidays Private medical health insurance Pension scheme And more... This is an urgent role More ❯

My client is based in the London area are currently looking to recruit for an experienced Lead GCP Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Lead Data Architect to join their team.They … AI within their organisation are looking to utilise the newest technologies on the market. Your role will include: Enterprise Architecture & Delivery: Spearhead the design and implementation of scalable data ecosystems-spanning data lakes, lakehouses, and warehouses-leveraging platforms such as GCP, BigQuery Snowflake, Synapse, or Microsoft Fabric. Cloud Transformation Strategy: Lead cloud adoption and modernization initiatives … Excellent understanding of Data Modelling (Physical, Logical, Conceptual), An understanding of Enterprise Level Architetcure, Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around GCP. My client is providing access to; Hybrid 2 days (London), 28 Days Holiday, Plus Bank Holiday Private Medical Health Pension Scheme And More... This role More ❯

Social network you want to login/join with: Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers and … processes with organisational goals and regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2, and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure Data Factory), Azure … DB, Azure Synapse, Azure Data Lake, and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction and transformation. Prior experience with Data warehousing and Data modelling (Star Schema More ❯

London/Hybrid | 💷 £750/day | 🗓 12-Month Rolling | ✅ Outside IR35 Our client, a leading Investment Management firm, is looking for a contract Data Engineer with strong Python and Databricks skills to help drive their data platform modernisation. You’ll be working on business-critical data pipelines and analytics infrastructure, supporting both investment and … operations teams. This is a hands-on role in a fast-moving environment, ideal for someone who thrives in financial services. What you’ll be doing: Building scalable data pipelines in Python and Databricks Designing data models to support analytics, reporting & regulatory needs Working with cloud-based data platforms (Azure preferred … Partnering closely with data analysts, quants, and tech teams Tech you’ll be using: Python (strong hands-on coding essential) Databricks/Spark Azure Data Lake/Delta Lake SQL/ETL frameworks CI/CD tools and version control (Git, Azure DevOps) What we’re looking for: Strong commercial experience as a Data More ❯

London/Hybrid | 💷 £750/day | 🗓 12-Month Rolling | ✅ Outside IR35 Our client, a leading Investment Management firm, is looking for a contract Data Engineer with strong Python and Databricks skills to help drive their data platform modernisation. You’ll be working on business-critical data pipelines and analytics infrastructure, supporting both investment and … operations teams. This is a hands-on role in a fast-moving environment, ideal for someone who thrives in financial services. What you’ll be doing: Building scalable data pipelines in Python and Databricks Designing data models to support analytics, reporting & regulatory needs Working with cloud-based data platforms (Azure preferred … Partnering closely with data analysts, quants, and tech teams Tech you’ll be using: Python (strong hands-on coding essential) Databricks/Spark Azure Data Lake/Delta Lake SQL/ETL frameworks CI/CD tools and version control (Git, Azure DevOps) What we’re looking for: Strong commercial experience as a Data More ❯

London/Hybrid | £750/day | 12-Month Rolling | ✅ Outside IR35 Our client, a leading Investment Management firm, is looking for a contract Data Engineer with strong Python and Databricks skills to help drive their data platform modernisation. You’ll be working on business-critical data pipelines and analytics infrastructure, supporting both investment and … operations teams. This is a hands-on role in a fast-moving environment, ideal for someone who thrives in financial services. What you’ll be doing: Building scalable data pipelines in Python and Databricks Designing data models to support analytics, reporting & regulatory needs Working with cloud-based data platforms (Azure preferred … Partnering closely with data analysts, quants, and tech teams Tech you’ll be using: Python (strong hands-on coding essential) Databricks/Spark Azure Data Lake/Delta Lake SQL/ETL frameworks CI/CD tools and version control (Git, Azure DevOps) What we’re looking for: Strong commercial experience as a Data More ❯

with 5 years or more experience and have a strong working knowledge of PySpark, Azure Data Bricks, Azure Data Factory and Azure Data Lake Storage. Ideally you will be based in Aberdeen or within a commutable distance of Aberdeen as the role cannot be worked remotely. Experience required: Proven competency working with data … flows) is essential for Senior Data Engineer. Working knowledge of PySpark is essential for Senior Data Engineer Capability working with Azure Data Lake Storag e is essential for Senior Data Engineer Working knowledge of medallion data lakehouse architecture is essential for Senior Data Engineer Strong background … and utility of datasets and systems to then analyse, model and organise data from their respective source data systems into the medallion data lake for further use in reporting. Ensure data quality and data reliability: Drive improvements in data quality assessments, and ensure that data More ❯

Role: Interim Data Architect/Database Analyst Hybrid Role : 3 days on site in London Daily Rate: £650, INSIDE IR35 Security Clearance: SC Clearance The interim Data Architect/Database Analyst will serve in a dual role, split 50%/50%, to support a key government client in London by defining and implementing its data … whether it can meet future reporting requirements Assessing the feasibility and desirability of transitioning CDS to a future cloud-based Enterprise Data Warehouse/Data Lake Designing a cohesive data model and data dictionary Collaborating with business and technology stakeholders to assess, plan, and implement effective data solutions which …/manipulation Understanding of Azure SQL Database and Azure SQL Managed Instance Knowledge of Azure Data Factory (ADF) for ETL Processes Experience of Azure Data Lake and Azure Synapse Analytics Microsoft SQL Server 2018 Microsoft SQL Server Integration Services (SSIS) Microsoft SQL Server Profiler SQL Server T-SQL Programming Data Modelling, Design and More ❯

Social network you want to login/join with: Data Architect/Database Analyst, london (city of london) col-narrow-left Client: Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Role: Interim Data Architect … it can meet the future reporting requirements Assessing the feasibility and desirability of transitioning CDS to a future cloud-based Enterprise Data Warehouse/Data Lake Designing a cohesive data model and data dictionary, Collaborating with business and technology stakeholders to assess, plan and implement effective data solutions which …/manipulation Understanding of Azure SQL Database and Azure SQL Managed Instance Knowledge of Azure Data Factory (ADF) for ETL Processes Experience of Azure Data Lake and Azure Synapse Analytics Microsoft SQL Server 2018 Microsoft SQL Server Integration Services (SSIS) Microsoft SQL Server Profiler SQL Server T-SQL Programming Data Modelling, Design and More ❯

Get AI-powered advice on this job and more exclusive features. Role/Job Title: Senior GCP Data Engineer Work Location: London The Role An excellent opportunity has emerged for a Senior GCP Data Engineer to join the Cyber Security domain of an investment bank. In this role, you will be responsible for providing top-tier … data capabilities, leveraging your engineering skills, and embracing the possibilities offered by cloud technology. Key Responsibilities API Development: Design, develop, and maintain robust and scalable backend systems and APIs Data Ingestion: Develop and maintain data pipelines to extract data from various sources and load into Google Cloud environments Data Transformation … Implement data transformation processes including cleansing, normalization, and aggregation to ensure data quality and consistency Data Modeling: Develop and maintain data models and schemas to support efficient data storage and retrieval on Google Cloud platforms Data Integration: Integrate data from multiple sources (on-prem and cloud More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical … functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the … firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical … functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the … firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical … functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the … firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with More ❯

AWS Data Engineer (Must hold current SC) The Company: At Amber Labs, we are a cutting-edge UK and European technology consultancy that prioritises empowering autonomy, promoting experimentation, and facilitating rapid learning to provide exceptional value to our clients. Our company culture is centred around collaboration, where all colleagues, regardless of their role, work together to minimise risk … and shorten delivery times. Our team consists of highly-skilled cross-functional consultants, analysts, and support staff. Overview: We are looking for a highly skilled AWS Data Engineer to join our team. The ideal candidate will have expertise in designing, building, and managing scalable data pipelines on AWS. You will work closely with data … Functions, and Kinesis. Work with structured and unstructured data from multiple sources, ensuring efficient data ingestion, transformation, and storage. Develop and optimize data lake and data warehouse solutions using Amazon S3, Redshift, Athena, and Lake Formation. Implement data governance, security, and compliance best practices, including IAM roles, encryption More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python More ❯

Data Engineer – Data Consultancy A forward-thinking UK-based data consultancy is seeking talented Data Engineers to help clients unlock the full potential of their data assets. In this role, you’ll be instrumental in guiding organisations through the evolving landscape of data strategy, engineering, and analytics Key … the gap between business needs and technical solutions. Deliver high-impact work with precision, proactively identifying challenges and proposing smart, scalable solutions. Architect and maintain resilient, high-performance data pipelines (ETL/ELT) to ingest, transform, and deliver data from diverse sources. Required Skills & Experience: Deep expertise in building and deploying data solutions using … platforms like Databricks (Azure/AWS) , Microsoft Fabric , Azure Data Factory , and Azure Synapse . Solid experience with the Microsoft data stack —including SSIS , SSAS , and SSRS . A strong foundation in data disciplines such as governance , architecture , modelling , data lakes , warehousing , MDM , and BI . Advanced skills in SQL and Python More ❯

Data Science Team Lead Competitive + Bonus + Benefits Manchester, Slough or Leeds (Hybrid) Permanent full time We are seeking an experienced Data Scientist to lead a growing team as the Data Science Team Lead at IRIS Software Group. The ideal candidate wouldcoordinate the planning, development and design of Data Engineering in … a customer facing data warehousing product. The product will drive the analytics required for both the State and Commercial sector. To be successful in this role you will work with the product and engineering team to identify valuable data sources and analyse trends in the data for our customers. This is a hands on … seeking Experienced Lead Data Engineer Strong Data Engineer Language Skills (Python, SQL, Javascript) Experience of Azure, AWS or GCP cloud platforms and Data Lake/Warehousing Platforms such as Snowflake, Iceberg etc Experience of various ETL and Streaming Tools (fiveTran, Flink, Spark) Experience of a variety of data mining techniques (APIs More ❯

About the role... Do you get satisfaction out of all things data? Interested in pushing your career to the next level at one of the Sunday Times Top 100 Best Companies to Work For? Cooper Parry are seeking a skilled and proactive Data Engineer to join our growing Data & Analytics team. You will play … data from various sources such as Legacy Systems, Restful APIs, Flat files Knowledge of modern data architectures: Data warehouse, Lakehouse, Data Lake Hands-on experience with Power BI, semantic modelling, and DAX Strong SQL and data manipulation skills. Exposure to Python and PySpark is required. Experience working with open … data formats like Delta Lake, Parquet, Json, Csv. Familiarity with CI/CD pipelines, version control (e.g., Git), and deployment automation tools Bonus points if you have: Exposure to MuleSoft or other API integration tools Experience in data governance, data cataloguing, and privacy/security in cloud data environments Understanding of More ❯

talk with your recruiter to learn more. Base pay range Direct message the job poster from DiverseJobsMatter Director Of Operations/Talent Resourcing at DiverseJobsMatter As a Senior Data Engineer, you will be working as part of a multidisciplinary team to build solutions that make data accessible to enable solutions to be optimised by using an … evidence-based approach. Engaging with our clients you will design and implement data solutions ensuring solutions are integrated with internal systems and business processes. Your role in a nutshell: Act as an SME within the Hippo squad to lead, design and implement data solutions that meet business requirements. Help architects realise data system design … such as Meshes, Warehouses and Event based systems. Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems. Re-engineer, develop and optimise code to ensure processes perform optimally. Build great relationships with your team and stakeholders. Work with the Hippo community to share best practice to ensure high standards. Involved More ❯

Social network you want to login/join with: Description About the role Are you a Principal Data Engineer with a passion for big data? Do you keep up to date with cutting-edge technologies within D&A? If so, then you have a fantastic opportunity to join a multi-disciplinary team of engineers, architects, designers … and strategists as we continue to grow our Data & Analytics practice across Europe. We're looking for a Principal Data Engineer with Azure, Databricks, and PySpark to join our team in London. The ideal candidate will have a strong background in data engineering, extensive experience with Azure cloud services, and experience leading a technical … to ensure a quality single version of the truth Build end-to-end pipelines to support enterprise-wide analytics Design, develop, and implement scalable and secure data lake solutions on Azure Ensure best practices in data engineering, data integration, and ETL processes Code complex aspects of our pipeline as needed Maintain the maturity More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of Microsoft BI software development including database/reporting development, full … development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design and develop complex BI/MI solutions in line with agreed architectural principles and toolsets. Capable of working closely with … movements, including assisting with solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports and dashboards; in-line with the company data management framework and enterprise data More ❯