26 to 50 of 129 Data Lake Jobs in the UK excluding London

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With As a Data Engineer at Capgemini, you'll design, build and operate reliable, scalable data pipelines and data products: the trusted foundations that … Specialist tracks (we'd love depth in one of these; you don't need all of them): Azure/Databricks Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow; and, for the AI edge, Databricks Mosaic AI, Vector Search ...

Data Engineer | Hybrid | South Wales | 3 months initially | Outside IR35 IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team … modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … Data Engineer or Solutions Architect Strong expertise in Databricks, Apache Spark, PySpark and SQL Experience designing and implementing modern data lake or lakehouse architectures Hands-on experience with Kafka Strong understanding of AWS data services, particularly Amazon S3 Experience integrating data ...

Title: HR Data Delivery Lead Role Overview A new data lake solution is being implemented and the HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role … will be accountable for connecting data from the new Oracle HCM Cloud to the new AWS Snowflake solution and unifying data layer between legacy and new HRIS system feed to data warehouse. The role ensures high-quality, timely, and governed delivery of data ...

client stakeholders and internal delivery leadership Experience with multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS, NoSQL, Graph databases, Cloud object storage & DB as a service Architecture and design concepts for ETL/ELT solutions … reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With... As a Data Engineer at Capgemini, you'll design, build and operate reliable, scalable data pipelines and data products: the trusted foundations that … Specialist tracks (we'd love depth in one of these; you don't need all of them): Azure/Databricks Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow; and, for the AI edge, Databricks Mosaic AI, Vector Search ...

Data Architect Salary: Up to £72,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 01/09/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we’d love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

summary If you enjoy turning complex, real-world data into reliable, usable information that supports better decision-making, this could be a highly rewarding role for you. At NHS Greater Manchester, we are bringing together data from across health and care partners, including NHS providers, local … develop the data pipelines that underpin our Analytics and Data Science Platform (ADSP) - a Snowflake-based data lake house used daily by analysts, data scientists, finance teams and senior leaders across the system. This is a hands-on technical role within ...

Join Barclays as a Senior Cloud Data Platform Engineer At Barclays, data is at the heart of our decision-making, innovation and customer experience. As a Senior Cloud Data Platform Engineer, you will play a critical role in designing, building and maintaining the cloud … based data platforms that power our business, enabling the secure and efficient collection, storage, processing and analysis of data at scale. Working with modern cloud technologies, you will develop and optimise data pipelines, data warehouses and data lakes, ensuring that ...

sponsorship is not available for this role. Role Overview We are seeking an experienced Business Analyst to join a large-scale R&D data engagement with a leading global pharmaceutical company, focused on the analysis, mapping, and business interpretation of raw scientific instrument and equipment data. The role … sits at the intersection of laboratory science and business/data analysis — translating raw outputs from instruments such as plate readers, Raman spectrometers, and cell counters into structured, business-relevant insights, mappings, and documentation that support downstream data and analytics initiatives across the R&D function. ...

public sector organisation is seeking a Senior Data & Reporting Engineer to join via a Consultancy to support a major cloud-based data programme focused on occupancy analytics and smart building technologies. You will play a pivotal role in designing, developing and optimising data pipelines … quality, validation and reconciliation techniques. Experience creating and optimising reporting datasets and semantic models. Knowledge of data warehouse and data lake architectures. Experience with data governance, metadata management and data lineage. Excellent analytical and problem-solving skills. Experience working within Agile ...

Senior Data Engineer Location: Newcastle upon Tyne (Hybrid) Salary: £60,000 per annum Contract: Fixed Term - 2 Years About the Role We are looking for an experienced Senior Data Engineer to lead the design, development and optimisation of modern data platforms and pipelines. This … exciting opportunity to shape how data is managed, integrated and utilised across a large and evolving organisation. Working closely with technical and business stakeholders, you will play a key role in developing scalable data solutions that enable high-quality reporting, analytics and data-driven ...

Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping them with robust data platforms. You'll also join a data team … mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key Responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value ...

STRATEGIC DATA ARCHITECTS | 6 VACANCIES | LONDON Looking for your next Data Architecture opportunity? This is a rare chance to help shape the future of enterprise data within a major organisation undergoing significant transformation. You'll play a key role in defining data … Contract Length: 12 Months Opportunities: 6 Positions Available Must be Eligible for DV Clearance What You'll Do * Define and evolve enterprise-wide data architecture and strategy. * Support the transition to a modern cloud-based data platform. * Develop and embed data standards, architecture principles ...

pipelines Developing Power BI semantic models and supporting reporting solutions Engineering robust Azure Data Factory integrations Building secure Azure Data Lake solutions Working with SQL Server and advanced SQL development Delivering API integrations across internal and third-party systems Supporting Azure DevOps and CI/… also bring strong experience across: Microsoft Fabric (essential) Azure Synapse Analytics (essential) Power BI Azure Data Factory Azure Data Lake SQL Server ETL/ELT development Azure DevOps Git Enterprise cloud data engineering AI Experience We're looking for engineers who have already ...

Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. • Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. • Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data … preferred). • Experience with AWS cloud services including S3, Glue, Lambda, IAM. • Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. • Understanding of data governance and compliance frameworks. • Experience in the healthcare sector or knowledge of NHS data ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

exciting opportunity has arisen for a Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...

Purpose of position Data sits at the heart of the company. This role ensures that Awin can fully leverage the data available across the group, enabling the development of robust reporting capabilities that support stronger commercial decision making and elevate campaign management for client facing teams. … 2+ years experience as data engineer on AI/ML project with Python Strong experience using Databricks, including Jobs, Asset Bundles, Delta Lake, and MLflow, as well as Azure data engineering tools such as Azure Data Factory and Azure Data Lake ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, the Principal … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

hiring a hands-on BI Architect to support the evolution of a cloud-based data platform, with a strong focus on data warehousing, analytics, and reporting. You'll work closely with BI Developers to design, build, and optimise end-to-end data solutions across … operating at architecture level - s trong Azure expertise across: Azure Data Factory (ADF) Azure Synapse/Azure SQL Azure Data Lake (ADLS) Exposure to Microsoft Fabric (highly desirable) Strong background in data warehousing and BI environments Excellent dimensional modelling (Kimball) experience Experience working ...