1 to 25 of 80 Data Lake Jobs in the UK excluding London

Michael Page have exclusively partnered with The Government Property Agency (GPA) to support on their continued Data Transformation programmes. The newly created role of Data Platform & Data Integrations Lead is pivotal in this strategy. The GPA is the largest property holder in government, with … warehouse Maintain existing data feeds into and out of the data estate (data integration pipelines, data lake and data warehouse) The reliability and operation of the data warehouse environment Ensuring that the GPA data warehouse ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … scalable data pipelines and ETL/ELT processes using modern cloud data engineering practices Develop and optimise data lake and data warehouse architectures on AWS Ensure high standards of data quality, governance, security and accessibility across data ...

Business Transformation team, the Senior Data Engineer will take a lead role in developing and building our cloud architecture, data lake and warehousing, and data pipelines to support the organisation's service development and improvement. The role offers the opportunity to support innovation … hours urgent care services during an important time of change and development in NHS care, with a shift to more digitised, technological and data-driven services that support the delivery of excellent healthcare services. The role will work across BrisDoc and its clinical, operational and back-office services ...

Senior Data Engineer - Azure, BI & Data Strategy Location: East Yorkshire Salary: £55,000-£65,000 depending on experience Contract Type: Permanent We're looking for a Senior Data Engineer with strong experience in Azure Data Factory, Business Intelligence and data … robust data pipelines using Azure Data Factory and the wider Azure Data ecosystem Oversee the data lake architecture, integrating sources such as SAP, Salesforce and production systems Collaborate with business stakeholders to translate reporting needs into structured, reliable data ...

secure, reliable, and efficient data pipelines using Azure Synapse Analytics, Azure Data Factory, PySpark, and Azure Data Lake Storage. The engineer will work closely with cross functional teams to translate business requirements into technical solutions that support analytics, reporting, and data … Synapse Analytics. Implement incremental loads, CDC, and real-time data ingestion when needed. Architect and manage datasets in Azure Data Lake Storage (ADLS Gen2). Optimize data storage formats (Delta, Parquet, Avro, ORC) for performance and cost. Maintain and optimize Synapse SQL Pools ...

Months The Role Your Responsibilities: (Up to 10, Avoid repetition) Experience as Solution Designer and should be currently working on Data Lake (Big Data) based projects. Guide the full lifecycle of a BI solution, including requirements impact analysis, platform selection, technical architecture design, application design … with proven expertise in delivering challenging assignment. Provide thought leadership for Data Management, Data Migration Strategy and Data Lake Solutions. Good knowledge on Data Modelling and able to translate Business requirements to Design and Data Models, technical designs ...

Lead Enterprise Data Architect Walton Park, London, Glasgow | Personal Contract (dependent on skills and qualifications) Full-time | Hybrid Competitive pension scheme – Enhanced maternity/paternity pay – Life assurance – HolidayPlus – Cycle2work Scheme & more REQ5513 The Lead Enterprise Data Architect provides strategic leadership and technical direction … data architecture, ensuring data is managed as a strategic asset. This role provides technical leadership across data platforms, AI and analytics, and integration capabilities, ensuring data is governed, resilient, high quality, and aligned to organisational and industry standards. The Lead Enterprise Data ...

into the Bronze layer, working in partnership with the Development and Application Management team.Design and optimise ETL/ELT pipeline frameworks using Databricks, Delta Lake and Azure Data Factory. * Ensure Silver and Gold layer data products are fit for purpose for analytics, pricing … ensuring compliance with industry standards. Deep expertise in data modelling - conceptual, logical and physical. Data warehousing and data lake architecture for high-performance analytics. ETL/ELT pipeline development and optimisation to support large-scale data processing. Data integration ...

Data Architect 6 month contract Glasgow 2-3 days per week £700 per day We are seeking an experienced Data Architect who can define, govern, and deliver GDPR compliant enterprise data architectures across relational (Oracle), NoSQL, unstructured data platforms, and Data Warehouse. The ideal candidate will possess strong expertise in data integration, migration, and centralisation initiatives, ensuring privacy by design across complex, distributed data landscapes. Key Responsibilities: Data Architecture & Modelling: - Define enterprise data architecture aligned with GDPR and organisational data ...

reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We’re looking for demonstrable experience in: Multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS NoSQL Graph databases Cloud object storage DB as a service Architecture and design concepts for ETL/ELT solutions ...

days/week Flexible working : Variety of flexible work patterns subject to line manager discretion e.g. Compressed 9-day fortnight. Reports to: Lead Data Engineer Deadline Note: We reserve the right to close the advert before the advertised deadline if there are a high volume of applications. Role … platform ensuring reliable data across the organisation Extensive hands-on experience designing and delivering scalable, resilient cloud-based data lake platforms using modern lakehouse architectures Drive better data governance through the creation and embedding of principles and processes Build and maintain ...

reliability for operational and reporting systems. Modern Data Platform Development Contribute to the build and enhancement of a data lake/lakehouse architecture. Work with AWS tools such as S3, Glue and Lambda. Develop robust, scalable data pipelines. Prepare clean, structured datasets … visualisation tools (Tableau desirable). Strong analytical, problem-solving and communication skills. Knowledge of data warehousing and/or data lake concepts. Any Data DevOps experience (e.g., Terraform, GitHub) would be highly beneficial. Experience & Behaviours You'll bring experience in a similar data ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

Engineer Location: Birmingham - Hybrid- 3 days onsite/week Duration: 6 months contract Pay Rate: £375 per day through FCSA Umbrella Role Description: Data Ops Engineer will be assisting Senior Data Ops Engineer responsible for inspiring and assisting Data Engineering team in designing, developing … related programming skills SQL/Python/Spark/Scala. Database technologies in relation to Data Warehousing/Data Lake/Lake housing patterns and relevant experience when handling structured and non-structured data (Information Modeler) Experience in data ...

Senior Data & Analytics Consultant - Fully Remote - Microsoft partner £60,000 - £70,000 + Bonus and the chance to have shares in the business as they move to an employee owned model. A well established MS partner who are experiencing growth through a very strong project pipeline are looking … Senior Data & Analytics Consultant to their team. The Senior Data & Analytics Consultant will play a key role in helping their customers turn data into meaningful insight and measurable impact. In this role, you will design and deliver robust data and analytics solutions ...

Data Engineer - West Yorkshire (Hybrid) Harvey Nash has partnered with a market-leading client of ours based in West Yorkshire to recruit an experienced Data Engineer . This role sits within the data team and will play a key part in designing, building … Azure SQL. Good understanding of data warehouse design , including star schema and dimensional modelling. Experience working with Azure Data Lake/Blob Storage and cloud-native data architectures. Strong proficiency in SQL , with experience designing and optimising data models and queries. ...

Data Engineer – Remote (occasional visits to Yorkshire) £55,000 - £60,000 + bonus, 35-hour work week and great benefits Joining a well-established and highly skilled Data team, an experienced Data Engineer is required to help design and develop modern cloud solutions. … that will benefit the department Requirements: 3+ years’ experience in data engineering and data warehousing. Amazon Redshift. Data Lake architectures (S3, lakehouse patterns). SQL and Power BI development experience. DAX/Data Modelling Familiarity with ELT/ETL tools. Knowledge ...

more. We do this by showcasing their talents, skills, and unique experience in an inclusive environment that helps them thrive. Job Title: Senior Data Engineer Location: Warwick (Hybrid Working) Contract: 6 Months Role Overview Our client is seeking a skilled Senior Data Engineer to lead … design, development, and maintenance of data integration solutions and data warehouse environments. This role will focus on building and optimising ETL/ELT pipelines, supporting data warehousing initiatives, and ensuring the quality, performance, and reliability of large-scale data systems. The successful ...

Location: Hessle Salary: £50,000–£60,000 depending on experience Contract Type: Permanent We're looking for a Data Engineer with experience in Business Intelligence to join a forward-thinking organisation modernising its data ecosystem. This role is ideally suited to someone operating at a strong … level, looking to deepen their technical capability while gaining exposure to more advanced data engineering and architectural concepts. As a Data Engineer, you'll work with data from systems such as SAP, Salesforce and production environments, helping to ensure it is connected, structured ...

Ready to help us pipeline our way to success? Read on to find out more about our new position, Data and Solutions Engineer . The investment arm of a market leading financial services company is expanding. With over £1 billion assets under management, we are committed to delivering … such as Azure Data Factory, Power BI, Data Pipelines, and Data Lake. Experience with Azure Data Lake and Delta Lake design pattern implementation, including file hierarchy and low-level permissions management (desirable). Experience in building CI/CD pipelines ...

data pipelines and ETL/ELT workflows Develop scalable solutions across Azure Synapse, Data Factory, and Data Lake Support the ongoing evolution of the wider Azure data platform Enhance data models and reporting layers that underpin downstream BI solutions … strong engineers with solid experience across the Microsoft data stack, particularly: Azure Synapse Azure Data Factory Azure Data Lake SQL ETL/ELT pipeline development Power BI data modelling and reporting integration Experience with SSIS, SSRS, or legacy SQL environments (desirable ...

software engineering in a data context. You'll work across the modern Azure data stack - ADF, ADLS Gen2, PySpark, Delta Lake - with increasing exposure to Microsoft Fabric as the platform matures. You'll collaborate closely with customers and internal teams to ensure data … Event Hubs, Kafka), and legacy databases into ADLS Gen2 and OneLake Develop structured data models aligned to Lakehouse, Medallion Architecture, and Delta Lake patterns Continuously profile, debug, and optimise Spark jobs, SQL queries, and Python scripts for maximum performance and cost-efficiency at scale Champion DevOps best ...

Type: Contract (Inside IR35) Duration: 6 Months Job Summary: We are looking for a Senior Technical Lead with in-depth expertise in data governance, data quality, metadata management , and a strong background in delivering solutions using the Collibra platform . You will play a pivotal role … defining solution architectures, leading Collibra configuration and integration, implementing governance workflows, and collaborating closely with enterprise architects, data stewards, and platform teams. Key Responsibilities: Solution Architecture & Design Lead the design and implementation of Collibra-based data governance solutions, including: Data Catalog Business Glossary Policy ...

Full time hours. We are happy to discuss flexible working! Top 3 skills needed for this role: Expert in building scalable, high-quality data pipelines Hands-on experience with cloud data platforms The ability to optimise, automate, and deliver reliable data solutions independently What … this role is all about: Join us as a Data Engineer and become a driving force behind high-impact, high-performance data solutions. You’ll take ownership of designing and supercharging data pipelines that keep our business moving, bringing fresh thinking and technical flair ...

Overview: We are working with a leading UK-based wealth and investment management firm seeking a skilled Data Engineer to support the build and evolution of their modern data platform. This role will focus on developing scalable data pipelines and contributing to a cloud … performance best practices are followed Required Skills & Experience: Strong experience with Azure data platform (e.g., Data Factory, Data Lake, Synapse) Hands-on expertise with Databricks (PySpark or Spark) Solid SQL development skills Experience working with Kafka for streaming data pipelines Good ...