1 to 25 of 39 Data Lake Jobs in the Thames Valley

Role – Technology Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – UK Business Unit – DNAINS Compensation – Competitive (including bonus) Job Description We are seeking an experienced Data Modeler who can analyse and understand the existing customer data and … analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong understanding of Insurance domain concepts—including Specialized Insurance, London Market, and Regulatory Data—is … essential for success in this role. Your role In the role of a Data Modelling Lead, you will be responsible for leading the design and transformation of enterprise data models to support scalable, high-performance analytics and reporting solutions. You will analyse existing data models built on SQL Server and guide the development of More ❯

Data Solution Architect - Conceptual Data Models, Data Vault 2.0, Azure Up to £800 per day (Inside IR35) London/Hybrid 6 Months My client is an instantly recognisable Insurance brand who urgently require a Data Solution Architect with expertise in Conceptual Data Modelling, Solution Architecture specifically within Data, exceptional stakeholder management skills and experience of implementing Data Vault 2.0 to join a business-critical Programme ASAP. Your CV will need to clearly state how you are involved in the process of leading/managing/maintaining/uplifted/improving Conceptual Data Models, as well as where you have implemented Data … leading/managing/maintaining/uplifted/improving Conceptual Data Models) Strong knowledge of MS Azure stack (including Data Factory (ADF), Data Lake Storage, SQL, Azure ML and Power BI) Proven experience with Snowflake Architecture, including DevOps integration and CI/CD practices Advocate for positive personal participation in workshops, and demonstrate More ❯

Data Services Manager, Must live within 2 hours of London or Berkshire and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Financial service background mandatory. Expanding financial services client are looking … for a Data Services Manager to join their team. The role will suit a candidate who has been a manager for a couple of years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

Senior Data Engineer Job Type : Permanent Location: Hub Location (London/Reading/Birmingham/Glasgow/Leeds) Salary: £60,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge technology, and exceptional … datasets and semantic models, ensuring best practice in DAX, performance tuning, and report design. Lead the development of data architecture and standards across Azure Data Lake and Synapse environments. Contribute to the migration to Microsoft Fabric, shaping platform architecture and integration patterns. Implement and maintain data validation, monitoring, and quality frameworks. Work collaboratively … tuning. Power BI: Advanced experience managing enterprise models, datasets, and governance processes. SQL: Expert-level proficiency in query design, optimisation, and data transformation. Azure Data Lake: Deep understanding of data structures, storage layers, and integration for analytics. Microsoft Fabric (Emerging): Contribute to the organisation’s transition and adoption strategy. Git/Azure DevOps More ❯

About the Company EC Markets is building a state-of-the-art in-house data centre to power our trading, operational, and marketing intelligence. About the Role We are seeking a Senior Data Engineer to lead the technical build-out of this initiative — from designing ETL pipelines to creating a secure, scalable data warehouse … that underpins business-critical reporting and analytics. This is a high-impact role at the intersection of technology and financial insight, ideal for a senior professional with deep data engineering capabilities and proven experience supporting financial or trading-driven organisations, willing to grow into a Head of Data. Responsibilities Design, develop, and deploy a robust data … engineering or infrastructure development. Experience in the financial services or fintech sector is highly desirable. Required Skills Hands-on experience designing and implementing ETL pipelines and data lake/warehouses in cloud environments. Advanced knowledge of AWS or Azure data services (Databricks, Glue, Redshift, S3 Data Lakes, Spark, or equivalent). Strong programming More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. The Data Architect will involve data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The ideal candidate … will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data storage solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data More ❯

Job Title: Staff Data Engineer Location: London, Hybrid Salary: c.£140,000 + bonus + share options Why Apply? This is a unique opportunity to take a leading role in shaping the data strategy of a fast growing Insurtech scale-up. The role combines hands on technical work with strategic influence, allowing you to develop both … systems and people. You'll lead a small but high impact team, work across multiple business functions, and help deliver a modern, scalable data platform that drives business decisions. Responsibilities: Lead, mentor, and develop a high performing team of Data Engineers, fostering a culture of learning and excellence. Define and execute the data engineering … a fast-paced environment. Strong communication and stakeholder management skills, able to translate technical concepts into business value. Experience with real-time data processing, Data Lake or Data Mesh architectures is a plus. Curiosity about AI and its practical application to improve data workflows. What's in it for me? Competitive More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … building. You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities Define the overall data architecture strategy aligned with business transformation goals · Design scalable, secure, and integrated data models/assets · Define and build Data Modelling and architecture Framework. · Ensure … Experience on ERWIN Modelling. • Hands on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. • Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. • Experience on Data Modelling, architecture, implementation & Testing. • Experienced in designing & implementation of End-to-End Data More ❯

Role – Sr. Technology Architect Technology – Data Modelling, ERWIN Modelling, Azure Architect, PySpark Location – UK(London) Job Description Data Architect should have key understanding of building Data Models, Experience in Data Architecting and Engineering space on Spark, Pyspark, ADF, Azure Synapse and Data Lake. Your role In the role of a … You will have the opportunity to shape value-adding solutions that enable our clients to meet the changing needs of the global landscape. Responsibilities . Define the overall data architecture strategy aligned with business transformation goals Design scalable, secure, and integrated data models/assets Define and build Data Modelling and architecture Framework. Ensure … Modelling. 7+ years of hands-on experience in ADF, Azure Databricks, Azure Synapse, Spark, PySpark, Python/Scala, SQL. Hands on Experience in Designing and building Data Lake from Multiple Source systems/Data Providers. Experience on Data Modelling, architecture, implementation & Testing. Experienced in designing & implementation of End-to-End Data More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

Are you passionate about Data and Analytics (D&A) and excited about how it can completely transform the way an enterprise works? Do you have the strategic vision, technical expertise, and leadership skills to drive data-driven solutions? Do you want to work in a dynamic, fast-growing category? If so, you might be the ideal … candidate for the role in the Data and Analytics function for Global Pet Nutrition (PN) at Mars. Pet Nutrition (PN) is the most vibrant category in the FMCG sector. As we work to transform this exciting category, a new program, Digital First, has been mobilized by the Mars Pet Nutrition (PN) leadership team. Digital First places pet parents … demonstrate significant thought leadership, quality decision making, deep technical know-how, and an ability to navigate complex business challenges while building and leading a team of world class data and analytics leaders. With Digital First, PN is moving to a Product based model to create business facing digital capabilities. Develop and maintain robust data pipelines and More ❯

Job Title: Senior Data Engineer Base Location: London OR Glasgow based (Hybrid – 2 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Tax & Legal Technical Engineering function is a cornerstone of our business. We do work that matters to our local business and communities – supporting technical innovation and adoption of cutting edge solutions across … upheaval. We've proudly stood beside the institutions and businesses which make the UK what it is. Why Join the KPMG Tax & Legal Technology Engineering team as Senior Data Engineer We might be world leaders in Tax & Legal, but in many ways the engineering department feels like a start-up, with a twist. There’s the buzz of … Netsuite. Knowledge of Power Platform (Power Apps, Power Automate). Knowledge of Delta Lakehouse architectures and concepts. Experience with Azure Synapse (dedicated and serverless pools), Azure Data Lake, and Azure SQL. Familiarity working in a DevOps environment. Experience with REST APIs, including endpoint authentication and integration (e.g., Microsoft Graph APIs). To discuss this or wider Technology More ❯

Role 🧠 A fast-growing UK tech group is looking for a hands-on AI Infrastructure Engineer to design and build the systems connecting core platforms (CRM, data lake, business tools) into a unified, AI-ready architecture. This is a greenfield build role — you’ll wire together SaaS tools, automate data flows, and shape the internal … days onsite, hands-on role, fast-paced environment What You’ll Do 🔧 Design and implement end-to-end data pipelines linking core platforms (CRM → data lake → AI systems) Architect schemas and transformation layers optimized for analytics, automation, and AI workflows (RAG/internal copilots) Build Python and API integrations , using low-code/no-code … streamline operations and M&A integration processes Monitor, ensure reliability, and scale integrations and pipelines Document and modularize infrastructure for future AI engineers ✅ Must-Haves: Python & SQL experience Data engineering skills : pipeline design, data modeling, schema development Experience with API integrations, webhooks , and low/no-code automation tools (Zapier, Make, Matillion) Comfortable in AWS or More ❯

We’re looking for a highly capable and motivated Data Engineer to join a growing data team. This is a pivotal role, leading the migration of a data infrastructure from AWS to Microsoft Azure and shaping the future of their data platform. This role will play a key role in enabling seamless … data integration, transformation, and reporting across diverse sources. This is a strategic, hands on opportunity and perfect for someone who loves innovation, embraces change, and enjoys building robust, future-ready data solutions. Lead the migration of data infrastructure from AWS to Azure, defining … the roadmap, proposing scalable Azure-native solutions, and collaborating with the Solution Architect and Head of Data. Design and build data pipelines into Azure (Data Lake, Synapse, Blob Storage, Azure SQL) to ingest structured, semi-structured, and unstructured data from multiple sources and APIs. Develop and optimise ETL/ELT workflows using Azure More ❯

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a hedge fund or HFT shop, you’ll know what this … role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to … building the core platform used by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

You’ll be joining an established global commodities trading firm where world-class data analysts are already building sophisticated, high-impact models. They now need the tech muscle to take them to production. In … this crucial role, you’ll connect sophisticated analytics with scalable infrastructure, manage CI/CD pipelines, containerized systems, and AWS environments that underpin the firm’s data lake, data pipelines, and analytics platforms. You’ll build robust infrastructure, automate data ingestion, and deploy cutting-edge analytical models into live trading environments. Working alongside … brilliant analysts and engineers, you’ll shape the firm’s technical foundation and directly influence how data drives trading strategy and decision-making. Location: London, hybrid. If you’re passionate about creating tangible value through technology in a high-performance trading environment, this is where you can truly make a difference. More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading … Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data strategy in a growing fintech If you’re an experienced Azure Data Engineer who enjoys leading without losing your hands-on edge, then More ❯

of the leading organizations in the UAE specializing in healthcare and advanced technology solutions . PLEASE NOTE THAT THE ROLE IS BASED IN DUBAI! As the Director – Healthcare Data and AI Solution Architect , you will play a key leadership role in defining and driving the company’s data and AI architecture strategy , shaping the foundation for … innovation, scalability, and excellence in healthcare technology. You will design and implement a robust, secure, and future-ready data and AI ecosystem , ensuring deep integration with enterprise-wide strategies and governance frameworks. Reporting to the Executive Director of AI & Data , you’ll lead a team of architects and collaborate closely with cross-functional teams to bring … the company’s AI vision to life. Key Responsibilities Architectural Leadership Define and maintain a comprehensive and scalable data and AI architecture aligned with enterprise-wide technology strategy. Establish and enforce best practices for data storage, integration, governance, and compliance with regulatory standards. Provide strategic technical direction to architecture and engineering teams. Evaluate and enhance systems More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Designing, developing, and maintaining high-performance, scalable, and secure backend services and APIs using technologies such as Python and NodeJS. Collaborating with science teams, full stack engineers, and data engineers to understand data requirements and integrate user needs into backend services. Building and maintaining RESTful APIs to surface data in the platform, ensuring it … is findable and accessible in line with FAIR principles. Developing APIs that support future interoperability and federation for pathogen diagnostics, epidemiology monitoring, and research. Working with data engineers to build pipelines and processes that store and transform platform data for easy consumption. Implementing and managing data storage solutions including data lakes, data … as object storage, Oracle Autonomous Database, and PostgreSQL. Supporting innovation efforts by exploring new technologies such as vector databases to enable search and AI use cases. Using big data technologies like Kafka, Iceberg, and Parquet, along with managed databases including PostgreSQL and Oracle vector databases. Operating, monitoring, and maintaining Oracle Cloud infrastructure to ensure backend services are highly More ❯

/Engineer Location: 3 Days p/w Central London Rate: £450 Outside IR35 Duration: 6 Months + Extensions This role is responsible for migrating and developing modern data and analytics solutions using Microsoft Fabric and Azure technologies. The position supports enterprise-wide BI initiatives, delivering data models, pipelines, dashboards and reporting assets that enable data-driven decision-making. Key Responsibilities Lead and implement data migration into Microsoft Fabric for analytics and reporting use cases Design and build data models from multiple sources to generate actionable insights Maintain and optimise data warehouse platforms; identify and resolve issues Develop data pipelines using Fabric Pipelines, Azure Data … Lakehouse and Warehouse environments Implement CI/CD processes using Azure DevOps for secure, reliable deployment Technical Skills: Strong expertise in: Power BI and paginated reporting SQL and data architecture Dimensional modelling (star schema, snowflake, denormalised structures, SCD handling) DAX, Visual Studio and data transformation logic Azure Fabric, Azure Data Factory, Synapse, Data More ❯

for front office use, capable of calculating and distributing option sensitivities and exposures in real time. It supports dynamic pricing, stress testing, and scenario analysis for high-volume, data-intensive trading activity. As Lead Developer, you will drive the architecture and implementation of a cloud native, microservice based risk framework, ensuring scalability, performance, and accuracy across all risk … containerised microservices (Kubernetes, Docker). Infrastructure: Kafka, Terraform, Jenkins, Git, CI/CD pipelines. Data: SQL/NoSQL databases, distributed data processing, data lake environments. Quant Integration: Comfortable working with quant libraries and APIs. Ideal Profile Built cloud native risk systems that calculate and distribute option sensitivities and exposures. Proven background building from More ❯

About the Role As a Data Engineer at Futuria, you’ll play a central role in designing, building, and maintaining the scalable data infrastructure that powers our AI models and intelligent applications. You’ll collaborate with AI engineers, data scientists, and product teams to ensure the seamless flow of high-quality, reliable data that drives performance and insight across the platform. Key Responsibilities Design and implement scalable, secure, and reliable data pipelines to support procedural workflow orchestration and AI agent workflows Develop and manage robust data ingestion processes (batch and streaming) from diverse sources Collaborate with AI engineers and product teams to define data requirements … and integrate pipelines seamlessly with models and applications. Build and maintain ETL/ELT processes that ensure data integrity, consistency, and accuracy across systems. Optimize data infrastructure for performance, cost efficiency, and scalability in cloud environments. Develop and manage graph-based data systems (e.g. Kuzu, Neo4j, Apache AGE) to model and query complex relationships More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

Are you an experienced Data Analyst looking for your next opportunity in the insurance sector? **Insurance industry experience is essential** In this role, you’ll be involved in onboarding new insurance programs, enhancing data integration, and delivering impactful insights through advanced reporting tools. This is a fantastic opportunity to work in a high-performing, collaborative team … environment with the flexibility of a hybrid working model in Central London. Key Responsibilities: Design and implement ETL pipelines for data lakes, data warehouses, ODS, and data marts Collaborate with business and technical teams to onboard new insurance programs Cleanse, profile, and validate large data sets to ensure quality and consistency Develop … and maintain advanced reporting tools to support business insights Contribute to the growth and optimisation of the enterprise data infrastructure Required Experience: Insurance industry experience is essential 5+ years of hands-on ETL experience across data integration architectures Strong expertise in SQL, Azure Data Factory, JSON, XML, and Dataflows Proven experience with data More ❯