26 to 50 of 66 Data Lake Jobs in London

Role Overview We are seeking an experienced Databricks Data Engineer to design and deliver cloud-based data integration and analytics solutions within our Insurance portfolio. This is a hands-on role focused on building scalable data pipelines, optimising performance, and applying best practices … Experience 3+ years’ experience in data engineering within enterprise environments Strong expertise in Azure Databricks, ADF, Synapse, and Azure Data Lake Hands-on experience with Spark (PySpark/Spark SQL) and orchestration Strong data modelling and data warehousing knowledge Proficiency ...

client, a speciality insurance broker, are looking for a Data Analyst to join our Data Analytics team, helping transform data into actionable insights … that drive smarter decision-making across our business.What You'll Be Doing: * Extracting, transforming, and presenting data from our data lake and data marts to support business performance * Designing and delivering visually engaging reports and dashboards using Power BI * Monitoring data ...

architectures , covering data ingestion, identity resolution, segmentation, and activation Define how the CDP integrates with, Data lake/lakehouse platforms (e.g. Databricks), CRM and sales platforms (e.g. Salesforce), Marketing automation and engagement tools (e.g. Braze) Apply strong understanding of batch vs real-time data … martech and data architectures , spanning CDP and identity resolution, Marketing automation and engagement platforms, CRM and customer-facing systems, Data lake/lakehouse platforms (e.g. Databricks). Proven track record of leading discovery, requirements definition, and solution shaping in complex or ambiguous environments Previous exposure ...

Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification … Doing Managing and maintaining large-scale Hadoop clusters across on-prem environments Supporting and optimising our HDFS-based Data Lake and adjacent platform components Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie , and related tooling Partnering with engineering teams to deliver scalable, high-quality data ...

Senior Manager: Data Officer - Sought by leading bank - London - Permanent Role Overview: We are looking for a Data Officer to lead the data governance, strategy and quality across its London Branch. This is a newly created role within the Risk function, working closely with … senior stakeholders to embed a strong, enterprise-wide data governance framework. Key focus areas: Data strategy & governance, policy and standards, data ownership & stewardship, data quality management, and regulatory compliance (GDPR, risk & audit). Ideal background: 6-8+ years in data ...

Lead Data Engineer - Hybrid - London - Azure - Databricks - £85k + Bonus I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned … Work With Lead the architecture, design, and delivery of Azure Data Services solutions (Data Factory, Data Lake, Azure SQL) Provide technical leadership in Agile delivery teams, mentoring engineers and influencing architectural decisions Design and implement scalable Azure-based data solutions ...

Azure Data Platform Lead/Enterprise Data Architect West London | Hybrid (2 days onsite) | Environmental research organisation I'm recruiting on behalf of a highly respected environmental research organisation for an Azure Data Platform Lead to take ownership of its enterprise data … platforms Deep hands-on knowledge of Azure data services including Data Factory, Synapse/SQL, Data Lake/Lakehouse/Fabric and Power BI Strong background delivering governed ETL/ELT pipelines using CI/CD and DevOps practices Experience setting ...

Senior Manager – Databricks Data Engineer (Insurance) | World-Class Data & Analytics Consultancy 📍 Manchester or London (Hybrid – your choice) 💼 Permanent or Fixed-Term Contract 💰 £75,000 – £100,000 + Bonus + Excellent Benefits We’re hiring for a global, market-leading Data & Analytics Consultancy supporting enterprise … solutions across large Insurance transformation programmes, working hands-on with: Azure Databricks & Spark Azure Data Factory, Synapse & Data Lake Large-scale ETL/ELT pipelines Enterprise data modelling & governance frameworks Technical leadership and delivery assurance What We’re Looking For ✔ Senior ...

Role Title: Data Engineer Location: Hybrid/London (occasional travel required) Clearance: BPSS required to start. Must be eligible to undergo SC Clearance. Duration: 12 months Start Date: ASAP The ideal candidate will have active SC Clearance or be eligible to undergo SC Clearance. We are actively looking … secure a Data Engineer to join Experis. Experis Consultancy is a global entity with a well-established team of over 1000 consultants on assignment across 20 clients internationally. Our UK operation is expanding rapidly with ambitious growth plans for the coming years. We form part of the Manpower ...

Your new company Working for a renowned financial services organisation Your new role We're looking for a Senior Data Engineer to design and deliver scalable on prem, high-quality data solutions for low/high-level data platforms that power analytical and business … insights. This is a hands-on role suited to someone with strong data engineering and big data expertise, ideally gained within financial services. Joining leading commodities, metals, trading, and exchange group, you will support a strategic metals initiative focused on reducing on-prem platform costs ...

SENIOR DATA ENGINEER LONDON UP TO £80,000 THE COMPANY This InsurTech innovator has spent the last decade transforming the travel insurance industry, leveraging technology to provide the best tailored coverage. Experiencing rapid growth , they’re focused on scaling their data platform to support future … Snowflake, and PySpark ideally A track record of taking ownership —whether it’s revamping a data warehouse, improving a data lake, or delivering visible business impact. Apt at working in fast paced environments Background in Insurtech or other regulated industries are appreciated, but others considered ...

their financial implications. They have deep understanding of digital transformation of complex legacy IT environments to new native digital environments – focussing on Data Modernisation and AI/ML to solve enterprise IT challenges. The knowledge of IoT, DevOps, Application Modernization to solve complex process industry challenges will … technology executives Minimum 5+ years’ hands on experience with AWS Cloud (IAaS, PaaS, SaaS) and architecture models. Proven experience in designing and deploying data solutions, data architectures on AWS, with hands-on expertise in services such as EC2, S3, RDS, Redshift, Glue, Lambda, Athena and Kinesis. ...

Developer on a 12-month FTC. The focus of the role is to provide technical expertise to deliver effective BI systems across the data functions within the organisation. The focus is to ensure that the organisation develops a strong internal data-related BI environment to inform … data architecture team to enhance the accuracy of data held in the data warehouse/data lake When necessary, provide line management and deputise for senior colleagues Essential Skills and Experience: Extensive experience developing PowerBI reports, dashboards, advanced DAX expressions ...

Data Engineer with Palantir Foundry — Digital Products/Applications/Automation & Analytics Location: London, UK (Hybrid 2-3 days) Are you passionate about building scalable data platforms and driving digital transformation through analytics? A leading provider of digital and automation solutions in the technology and consulting … industry is seeking a Data Engineer to join its growing team in London. In this role, you’ll design, build, and maintain robust data pipelines across hybrid cloud environments (AWS & Azure) , supporting projects for a global enterprise with diverse business interests — spanning energy, infrastructure, automotive ...

Data Engineering Lead (SQL Snowflake Python) London/WFH to £85k Are you a skilled data technologist with strong leadership and stakeholder management skills? You could be progressing your career in a senior, hands-on Data Engineering Lead position at a global tech company … that provide data centric software solutions to major blue-chip and government organisations to enable them to discover and analyse data and customer feedback. What's in it for you: Salary to £85k Bonus Unlimited holiday allowance Flexible working (x1 day a week in London) Private ...

working on a blend of new and existing projects working with the latest tech in a greenfield large, highly scalable data lake environment. The Company: For the past 20+ years they have been a leading SaaS platform providing a full product suite of services to the securities … shape this function in the long term. The Role: The successful candidate will work across these areas: Owning the build and maintenance of their Lake house and being the 'go-to' Data person in the business. Working with stakeholders from across the business showing the possibilities that ...

Role: EU Data Manager Location: Paddington, London (Hybrid/Remote with occasional office visits) Start Date: ASAP Duration: 12-Month Contract Rate: £414.44 - £550 per day (Inside IR35) Are you a data-driven professional with a passion for the FMCG sector? We are looking … shaping the future data strategy for the region. Key Responsibilities Reporting Ownership: Act as the primary lead for the Data Lake and the SPRINT external reporting suite (managed by Red Slim). Data Strategy: Plot and map data suppliers (NielsenIQ, ePOS ...

Senior Data Engineer - Remote-First - UK-Based - Up to £60,000 Are you a passionate Data Engineer looking to make a real impact in a fast-growing, values-driven tech company? We're working with a leading Microsoft Cloud specialist that's renowned for its inclusive … travel to client sites and company events Location: UK-based Employment Type: Permanent, Full-Time What You'll Be Doing Delivering full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ ...

Data Platform Engineer - Terraform, Azure Services, ADF, Synapse £Market Rate (Inside IR35) London/Hybrid 6 months My client is an instantly recognisable firm who urgently require a Data Platform Engineer with core strengths in Building and Operating Data Platforms, and hands on expertise … Factory (ADF), including network configurations and integration runtime options Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts Ability to showcase DevOps and CI/CD capabilities Working knowledge of designing and deploying infrastructure Experience in efficient handling of large ...

Profectus Recruitment is partnered with a highly regulated financial services company to hire a strategic Data Architect. This role will play a key part in shaping enterprise-wide data governance, architecture and content management as the business continues its journey towards more modern, cloud-native platforms. … building are as important as technical capability. Hybrid working: 2 days per week on-site. What they’re looking for Strong experience in data architecture/data governance within financial services or another highly regulated environment Confident building data governance frameworks (policies, standards, stewardship ...

growing organisation is embarking on a multi-year transformation programme that will modernise core systems, overhaul data foundations, and reshape how the business operates. I’m supporting them in hiring a Senior Project Manager who can take ownership of major workstreams and bring structure, clarity, and momentum … system Delivery of a new property management platform A major data cleansing initiative and the creation of a new data lake Multi-phase pilots, user feedback cycles, and process redesign What You’ll Be Doing Building and owning end-to-end project plans from vendor ...

Data Engineer - Databricks/Fabric - Azure - Hybrid - London - £50k-£65k Are you ready to take your Data Engineering career to the next level? Join one of the UK's fastest-growing consultancies and work on cutting-edge Azure projects, next-gen lakehouse architectures, and enterprise-scale … chance to own meaningful projects, accelerate your growth, and become part of a team that's shaping the future of data engineering. Why This Role Stands Out Modern Tech Stack: Work hands-on with Azure Synapse, Databricks, and Microsoft Fabric on innovative solutions. Enterprise Impact : Deliver scalable, high ...

Data Engineer - Azure | Databricks/Fabric - Remote - £50k-£65k I'm currently supporting one of the UK's fastest-growing Microsoft data consultancies as they continue to scale their team. If you're a Data Engineer who wants to work on modern Azure projects … this could be a great fit. What You'll Be Doing In this role, you'll be central to designing and delivering modern data solutions for a range of clients: Architect and deliver scalable data solutions using Databricks, Synapse, and Microsoft Fabric Build and optimise ...

Westchester. The firm is operated with an entrepreneurial spirit and is continually seeking to improve and expand. Role We are seeking a talented Data Engineer to join the growing data team within our Quantitative Management Division This position is ideal for individuals who are passionate about … building scalable data solutions, eager to learn in a collaborative environment, and excited to work in small teams while taking advantage of opportunities to lead and enhance both themselves and their teammates. In this role, you will collaborate with experienced engineers to build and maintain our data ...

Data Platform Engineer – London (AWS, Apache Spark, AWS Glue, Iceberg, S3, RDS, Redshift, Kafka/MSK, Python, Terraform, Ansible, CI/CD, Jenkins, GitLab, Snowflake, Databricks) Working with an established FinTech client in London who is looking for a Data Platform Engineer to play … Code solutions, supported by CI/CD pipelines, to ensure consistent, repeatable deployments and strong governance. You’ll also enhance data lake integration testing, security measures, monitoring, SLAs, and operational metrics. Working for a tech driven organisation in a collaborative environment, for an organisation that values engineering ...