26 to 50 of 319 Data Lake Jobs

Data Solution Architect Associate Director

Hiring Organisation
KPMG International Limited
Location
Dublin, Ireland
Employment Type
Permanent
Salary
EUR 85,000 - 115,000 Annual
Data Solution Architect Associate Director Basic Information Location : Dublin Business Area : Consulting Description and Requirements When you join KPMG Ireland, you are joining a community of over 4,200 employees who collectively work together, both in person and virtually, to achieve their full potential. We are known … cases. Proven experience in designing architectures for structured, semi-structured, and unstructured data , leveraging technologies like Databricks, Snowflake, Apache Kafka , and Delta Lake to enable seamless data processing and analytics. Hands-on experience in data integration , including designing and optimising data ...

Data Platform Engineer

Hiring Organisation
McCabe & Barton
Location
Slough, Berkshire, UK
Employment Type
Full-time
analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Platform Engineer

Hiring Organisation
McCabe & Barton
Location
London Area, United Kingdom
analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Platform Engineer

Hiring Organisation
McCabe & Barton
Location
City of London, London, United Kingdom
analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Platform Engineer

Hiring Organisation
McCabe & Barton
Location
Central London, London, United Kingdom
Employment Type
Permanent, Work From Home
analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Engineer Manager

Hiring Organisation
Young's Employment Services Ltd
Location
West London, London, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£95,000
Data Engineer Manager Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Attractive Bonus & Benefits This newly created Data Engineer Managers position is an excellent opportunity for someone that enjoys being hands on technically as well as managing a small team … Data Engineers. It would suit those with official management experience, or potentially a Lead or Senior Engineer used to leading teams and now looking to take on more managerial responsibility. Our client is a well-established and rapidly growing global business with its headquarters based in London. ...

Data Engineer Manager

Hiring Organisation
Youngs Employment Services
Location
W12, Shepherds Bush, Greater London, Brook Green, United Kingdom
Employment Type
Permanent
Salary
£85000 - £95000/annum circ £85,000 - £95,000 + Bonus
Data Engineer Manager Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Attractive Bonus & Benefits This newly created Data Engineer Managers position is an excellent opportunity for someone that enjoys being hands on technically as well as managing a small team … Data Engineers. It would suit those with official management experience, or potentially a Lead or Senior Engineer used to leading teams and now looking to take on more managerial responsibility. Our client is a well-established and rapidly growing global business with its headquarters based in London. ...

DOMO Data Analyst

Hiring Organisation
Akkodis
Location
Stevenage, England, United Kingdom
tomorrow’s public sector skill demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span across architecture, project management … scalable ETL/ELT pipelines using modern tools and frameworks. Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, ADF). Data Governance: Understanding of GDPR, PII, and secure data management principles. Communication: Strong data storytelling skills ...

Data Engineer

Hiring Organisation
Makutu
Location
DE1, Derby, Derbyshire, United Kingdom
Employment Type
Permanent
Salary
£35000 - £45000/annum
native technologies, DevOps practices, CI/CD pipelines and agile delivery Experience with data modelling, data warehousing, data lake solutions Able to communicate effectively with senior stakeholders. Successful candidates will likely posses Azure certifications such as DP-600 and/or DP-700. … following technologies: Power BI Power Apps Blob storage Synapse Azure Data Factory (ADF) IOT Hub SQL Server Azure Data Lake Storage Azure Databricks Purview Power Platform Python ...

AWS Data Engineer

Hiring Organisation
Stackstudio Digital Ltd
Location
Ipswich, Suffolk, East Anglia, United Kingdom
Employment Type
Permanent
distribution keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue …/Iceberg for low-cost, serverless analytics. Manage Glue Data Catalog integrations and table schema management. 5. Storage (S3) & Data Lake Architecture Design secure, cost-efficient S3 data lake structures (bronze/silver/gold zones). Implement data lifecycle ...

Data Architect

Hiring Organisation
Amtis Professional Ltd
Location
Birmingham, West Midlands, United Kingdom
Employment Type
Permanent
Salary
£90,000
insights. Key Responsibilities: Lead the design and architecture of end-to-end data platforms using Azure services (e.g., Azure Data Lake, Data Factory, Synapse, Fabric, Key Vault). Architect and optimise Databricks environments for data engineering & analytics. Develop datadata estate. Skills & Experience: Strong experience architecting cloud-native data solutions on Microsoft Azure. Hands-on expertise with Databricks (Delta Lake, Spark, notebooks, cluster management). Deep understanding of data modelling, warehousing, and distributed data processing. Experience with Python/ ...

Data Architect

Hiring Organisation
The Christie NHS FT
Location
Manchester, United Kingdom
Employment Type
Fixed-Term
Salary
£55690.00 - £62682.00 a year
summary Working within the Data Engineering team which delivers and maintains data transfer pipelines between clinical/operational source systems and the Christie Central Data Repository (CCDR) enabling the delivery of high-quality business and complex clinical reporting structures from disparate systems. … seeking an experienced Data Architect with a strong background in data modelling and extensive experience of modern mainstream data platforms. This role will support the Data Engineering modernisation programme focused on automating data integration and building robust data ...

Data Architect

Hiring Organisation
AMCS Group
Location
Dublin, Ireland
Employment Type
Permanent
Salary
EUR 70,000 - 90,000 Annual
Specification: Data Architect Who we are Sustainability software specialist, AMCS, is headquartered in Ireland, with offices in Europe, USA, Canada and Australasia. With over 1,400 highly skilled employees across 22 countries, we specialize in delivering technology solutions to facilitate a carbon neutral future. What … Data Platform Architecture : Can design and justify a modern architecture, including specific technology choices among potential candidates (e.g. Azure Data Lake, Synapse or Fabric, Data Factory; Databricks; Snowflake; dbt; Power BI; etc). Preferably has experience with the Azure family of data ...

Azure Data Engineer - £250PD Outside IR35 - Remote

Hiring Organisation
Tenth Revolution Group
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£200 - £250 per day
Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … warehousing concepts and dimensional modeling Proficiency in SQL and Python Experience with Azure data services such as Azure Data Lake Storage (ADLS Gen2) , Azure Data Factory , and Azure SQL Familiarity with CI/CD pipelines and version control (Git, Azure DevOps) Experience ...

Azure Data Engineer - £250PD Outside IR35 - Remote

Hiring Organisation
Tenth Revolution Group
Location
London, United Kingdom
Employment Type
Contract
Contract Rate
£200 - £250/day
Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … warehousing concepts and dimensional modeling Proficiency in SQL and Python Experience with Azure data services such as Azure Data Lake Storage (ADLS Gen2) , Azure Data Factory , and Azure SQL Familiarity with CI/CD pipelines and version control (Git, Azure DevOps) Experience ...

Data Engineer - £350PD - Remote

Hiring Organisation
Tenth Revolution Group
Location
London, South East, England, United Kingdom
Employment Type
Contractor
Contract Rate
£300 - £350 per day
Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality … production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations ...

Data Engineer - £350PD - Remote

Hiring Organisation
Tenth Revolution Group
Location
City of London, London, United Kingdom
Employment Type
Contract
Contract Rate
£300 - £350/day
Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality … production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations ...

Experienced Data Engineer / BI Developer Prestigious Client / Home

Hiring Organisation
Integrity Recruitment Solutions Ltd
Location
Nottingham, Nottinghamshire, East Midlands, United Kingdom
Employment Type
Permanent
Experienced Data Engineer/BI Developer Prestigious Client/Home An innovative business making a significant impact within their sector, my client is going through a major business/systems transformation programme with a core focus of that being centred around their Data and BI/… cube development Data processing and ETL Data Modelling Data security Azure Data Factory, Data Lake Microsoft Fabric is a bonus, and will be gained Please forward your most recent CV to be considered and contact Stewart Lloyd at Integrity ...

Senior Data Engineer - Azure Data - Burton-on-Trent - Hybrid

Hiring Organisation
Crimson
Location
Burton-on-Trent, Staffordshire, England, United Kingdom
Employment Type
Full-Time
Salary
£60,000 - £67,000 per annum
Senior Data Engineer - Azure Data - Burton-on-Trent - Permanent - Hybrid Salary - £60,000 - £67,000 per annum This role requires 1 day/week in Burton-on-Trent, with hybrid working arrangements. Our client is seeking a highly skilled Senior Data Engineer to join … using Azure. Stay current with Azure technologies and identify areas for enhancement. Databricks (Unity Catalog, DLT), Data Factory, Synapse, Data Lake, Stream Analytics, Event Hubs. Strong knowledge of Python, Scala, C#, .NET. Experience with advanced SQL, T-SQL, relational databases. Azure DevOps, Terraform, BICEP ...

Principal Data Engineer

Hiring Organisation
VIQU Ltd
Location
Manchester, Lancashire, United Kingdom
Employment Type
Permanent
Salary
GBP 85,000 - 95,000 Annual
Role: Principal Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Principal Data Engineer

Hiring Organisation
VIQU IT Recruitment
Location
Manchester, North West, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£95,000
Role: Principal Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Head of Data/VP of Data Delivery - On Prem/Azure Migration

Hiring Organisation
William Alexander Recruitment Ltd
Location
London, United Kingdom
Employment Type
Permanent
Salary
GBP 130,000 Annual
Head of Data/VP of Data Delivery - On Prem/Azure Migration Our client, a leading specialty London Market insurer, is hiring a Head of Data/VP of Data Delivery. Sitting under the CIO, this role owns and enacts … Data & BI roadmap, driving delivery through a small but highly capable internal team and strategic third-party partners. With a roadmap focused on migrating on-prem SSIS/SSAS/SQL into Azure Data Lakes, this is a fantastic opportunity to shape and deliver modern data ...

Senior Data Engineer, Databricks, Home Based

Hiring Organisation
Fdo Consulting Limited
Location
Birmingham, West Midlands, United Kingdom
Employment Type
Permanent, Work From Home
Salary
£70,000
Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Should also have knowledge of testing, agile environments … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

Data Architect

Hiring Organisation
Hays Specialist Recruitment Limited
Location
London, South East, England, United Kingdom
Employment Type
Full-Time
Salary
£95,000 - £100,000 per annum
prestigious financial services client, we are seeking an experienced and strategicData Architect to lead the development and delivery of enterprise-wide data governance and architecture initiatives. This is a high-impact role that will shape the organisation's approach to data management, compliance, and innovation. … Strong experience in conceptual, logical, and physical data modelling. Proven track record in designing data warehouse and data lake architectures. Solid understanding of Master Data Management (MDM) principles. Integration & Engineering Skilled in developing and managing data pipelines and orchestration ...

Senior Market Data Platform Engineer (Python) | Dynamic Asset Management Leader

Hiring Organisation
Techfellow Limited
Location
Slough, Berkshire, UK
Employment Type
Full-time
granular financial datasets. You'll play a central role in shaping large-scale tick-data architecture - building pipelines, improving data-lake structures, and refining storage formats to support demanding research and trading workflows... Key Responsibilities Architect, build, and refine high-throughput pipelines capable of processing … Develop resilient, well-structured Python/OOP solutions underpinning tick-data ingestion, normalisation, storage, and replay Design and evolve data-lake patterns using Parquet and related columnar formats; introduce Iceberg-style table modelling where beneficial Implement cloud-backed processing and storage patterns - leveraging services from ...