1 to 25 of 177 Data Lake Jobs in the UK excluding London

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

allows customers to make a single monthly payment, to receive brand new equipment, and have maintenance costs taken care of. Role overview The Data Engineer will work within the data team to assist in the design, implementation, and maintenance of our Azure-based data warehouses. The data engineer will be involved in all aspects of the data warehouse, covering integration to new data sources, design and creation of new data pipelines as well as the optimization and maintenance of existing ones. They will also … Factory, Azure Databricks, Azure Synapse Analytics, and other Azure data services. Familiarity with Azure Blob Storage, Azure Data Lake, and data lake architectures. Experience working with data modelling, normalization, and star schema design for data warehouses. More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … efficient ETL (Extract, Transform, Load) data pipelines to integrate data from multiple sources into centralized repositories. Developing data lake solutions based on the medallion architecture (Bronze, Silver, Gold) to ensure structured data processing. Implementing data governance and security policies … within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to streamline workflows. Monitoring and troubleshooting data More ❯

is diverse and equitable, building a culture of collaboration and inclusion. Position Overview Ithaca Energy is accepting applications for the position of Senior Data Engineer located in our Aberdeen Office. Reporting to the Analytics and Integration Lead, the Senior Data Engineer will play a pivotal role … stakeholders and business users to understand data utility, and analyze, model, and organize data into the medallion data lake for reporting. Ensure data quality and data reliability: Drive improvements in data quality assessments, ensure effective, efficient, robust … solutions. Expertise with Synapse (notebooks and data flows) is essential. Working knowledge of PySpark is essential. Experience with Azure Data Lake Storage is essential. Understanding of medallion data lakehouse architecture is essential. Strong problem-solving skills for complex data challenges. Background More ❯

Senior Data Engineer Job Type : Permanent Location: London – Hybrid/flexible Salary: £55,000 - £70,0000 Consultant: Mags Rendle Excellent career opportunity! The Organisation TDRC are excited to be once again working with one of the UK’s leading Wealth Management firms. Through their robust infrastructure, cutting edge … and optimising Azure Data Factory (ADF) pipelines, working with SQL Server (designing and populating data schemas), Azure Data Lake, and Power BI, and integrating machine learning and AI models into our data processes. Experience with Azure Synapse Analytics is beneficial as … in implementing machine learning models within Azure Machine Learning to enhance reporting and predictive analytics. Data Storage & Processing Azure Data Lake: Knowledge of Azure Data Lake for efficient storage and retrieval of large datasets. Azure Synapse Analytics (Familiarity): Familiarity with Azure Synapse More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … a Data Engineer with a focus on Azure Cloud data Services (e.g. Azure Data Factory, Data Lake, etc.) Database Skills (MS SQL Server, MySQL, PostgreSQL, MongoDB, Cassandra or similar) Excellent SQL skills. Skills in developing data visualizations (e.g. Power … collaborate with cross-functional teams effectively. Inquisitive with an eagerness to learn. Preferred Qualifications Experience with additional Azure services like Azure Data Lake , Azure SQL Database , or Azure Databricks . Familiarity with Infrastructure-as-Code (IaC) practices. Strong knowledge of data governance and security best More ❯

daily towards creating the world we want tomorrow. Job Description: Lead Platform Engineering is responsible for architecting, building, and managing the organization's data platform foundations. This role involves designing, implementing, and maintaining scalable, reliable, and secure data platforms to support business insights, analytics, and other … Specification ( Technical Skills) : Cloud Platforms: Expert-level proficiency in Azure (Data Factory, Databricks, Spark, SQL Database, DevOps/Git, Data Lake, Delta Lake, Power BI), with working knowledge of Azure WebApp and Networking. Conceptual understanding of Azure AI Services, ML, Unity Catalog, and data … Python, and at least one additional programming language (Java, C#, C++) is desired. Proven experience with data warehousing and data lake technologies. Solid understanding of database systems (SQL, NoSQL). Platform Architecture: Able to develop and implement data platform architecture (data More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯

services we help our clients connect and communicate better with their customers. As we continue to grow, we are seeking a talented Martech Data Engineer to join our team, focusing on implementing and optimizing a fully integrated Martech stack for an international client. In this role, you'll … ll work closely with their marketing, analytics, and product teams to build and optimize a scalable architecture, including managing an Azure Data Lake Gen2, Azure Data Factory, Snowflake warehouse, and RudderStack for customer data flows. Your responsibilities will include designing and maintaining data … experience you will bring: Experience: 3+ years in data engineering or martech engineering roles. Technical Proficiency: Expertise with Azure Data Lake Gen2, Azure Data Factory and Snowflake. Experience with Looker Studio for visualization. Proficiency with RudderStack or similar customer data platforms. More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of … Microsoft BI software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design … solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports, and dashboards; inline with the company data management framework and More ❯

Join our Cardiff Bay team as a Data Warehouse Developer within the Cardiff office. You are expected, if successful, to work 50% of the week in the office. WHO ARE WE? Privately owned and independently minded, Creditsafe operates with the singular vision of powering business decisions. We do … business information accessible to all. Twenty-five years later, we've not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened up new avenues of data intelligence for businesses with machine … quality, consistency, and performance across the warehouse. Work with Azure Data Services (Synapse, Data Factory, Data Lake, SQL DB, etc.) to build scalable solutions. Implement data governance, security, and best practices for the warehouse. Develop and maintain documentation on More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and … communicating enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience … advise clients on reference architectures Design and develop scalable Databricks solutions on both Azure and AWS environments Lead the architecture and deployment of data solutions using Databricks Requirements: Expert in capturing end-user requirements and aligning technical solutions to the business objectives Experience in leading, designing, and implementing More ❯

Senior Data Architect (Azure) Insurance/ReInsurance Location: London Hybrid:3 Days a week Position Overview: As a Senior Data Architect, you will be responsible for designing, implementing, and optimising our data architecture/data lakehouse to support cloud-based ETL processes … and digital transformation projects. Key Responsibilities: Design and develop scalable data architectures for cloud-based environments. Lead the implementation of ETL processes to ensure efficient data extraction, transformation, and loading. Collaborate with stakeholders to understand business requirements and translate them into technical solutions. Ensure data quality, integrity, and security across all data platforms. Optimize data storage and retrieval processes to enhance performance and scalability. Provide technical guidance and mentorship to junior data engineers and developers. Stay up-to-date with emerging technologies and industry trends to drive More ❯

Data Engineer London (hybrid) Salary up to £80,000 per annum An exciting opportunity has arisen to join a well established organisation in the insurance space, in a challenging Data Engineer role. There will be a lot of stakeholder engagement … so the ideal candidate will have both hands on and business facing experience. Preferably in the insurance sector. Key responsibilities: Design Data Lake and Data Warehouse solutions. Design Data Models using Data Vault and Dimensional modelling methods Implement automated, reusable and … efficient batch data pipelines and streaming data pipelines Work closely with Governance and Quality teams to ensure metadata, catalogue, lineage and known solutions to data issues are optimised Work closely with other data specialists and technicians in the organisation, such as Actuarial More ❯

a Research DataOps Engineer with a passion for research delivery, to join an Oxford University spin-out and to implement a Data Lake House from the ground up. This role is critical to support the next phase of our medical imaging AI and Analytics research. The role … individuals to support a variety of data and computing needs. The successful candidate will design and build out a data lake house, whilst being expected to actively contribute to ongoing data-centric product research. The ideal candidate will: be motivated at the thought … other and acting with candour and professionalism. Responsibilities Responsibilities include some or all of the following: Design and build a secure Data Lake House infrastructure to support AI and Data Analytics Research Manage Cloud/On-premises compute resources to achieve research objectives Contribute to More ❯

become a part of a dynamic and collaborative environment, with a customer-focused culture of innovation. The Junior Product Owner role within the Data team at Sidetrade presents an exciting opportunity for individuals eager to grow their careers in a fast-paced, innovative environment. You'll be part … real value for our clients and their customers. This role plays a key part in unlocking the full potential of our Data Lake - ensuring data is transformed into actionable insights that drive ROI. We're looking for someone with a genuine passion for data … the ability to manage multiple tasks simultaneously. Eagerness to learn and adapt in a fast-paced environment. Preferred Basic understanding of data lake architecture. Preferred familiarity with agile methodologies and tools like JIRA, Confluence, or similar. Ability to write clear and concise technical documentation. What we will More ❯

Job Overview: We are seeking an experienced and dynamic Project Manager to lead the modernization of our data platform to SAP Data Sphere. This role is responsible for overseeing the end-to-end execution of the project, including planning, execution, and delivery-ensuring that the project … and technological requirements. The Project Manager will work closely with technical teams, business stakeholders, and external partners to drive the transformation from legacy data systems to a cloud-based SAP Data Sphere environment. Key Responsibilities: Develop detailed project plans, timelines, and resource allocation for the SAP … Data Sphere modernization project. Define project scope, goals, and deliverables that support business objectives in collaboration with senior management and stakeholders. Collaborate with internal stakeholders (business units, IT teams) and external partners (vendors, consultants) to ensure alignment of project goals and technical requirements. Conduct regular project meetings, updates More ❯

Job Title: Senior Data Engineer Location: Leeds, on-site 2x per week Salary: Up to £85,000 Why Apply? Our client is looking for a talented Data Engineer to play a key role in their ongoing digital transformation. This … full-time, permanent position offers the chance to develop the initial data strategy, design scalable pipelines, and create a data lake that will be central to their reporting initiatives. If you are experienced in managing cloud-based data infrastructures and eager to drive … pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup of a centralised data lake to unify data from various sources, supporting BI and analytics needs across the business. Partner with teams across the business, including Product More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

this is done on a rota basis. Job Purpose The BI Lead will be responsible for shaping and maintaining the Enterprise BI and Data warehouse estate. You'll be working with both on-prem and cloud technologies, predominantly focussed on the Microsoft stack (SQL/Azure SQL databases … Data Factory, Synapse, Power BI, Power Platform) You will play a critical role in designing, developing, implementing and maintaining robust data solutions on the Azure and Power BI platforms. You will collaborate closely with cross-functional teams to gather requirements, understand business objectives, and translate them … including performance, pastoral, training and coaching Technical Skills: Strong experience of Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps Strong SQL programming skills Strong experience with Power BI data modelling and More ❯

helping them outperform their competition through speed and innovation. Apexon brings together distinct core competencies – in AI, analytics, app development, cloud, commerce, CX, data, DevOps, IoT, mobile, quality engineering and UX, and our deep expertise in BFSI, healthcare, and life sciences – to help businesses capitalize on the unlimited … Asset Management and Everstone Capital, Apexon now has a global presence of 15 offices (and 10 delivery centers) across four continents. Job Title: Data Solution Architect Location: Newcastle Upon Tyne/Sunderland, UK The Role: We are looking for a highly skilled Data Solution Architect with … platforms and cloud data solutions . Hands-on experience designing data solutions on Azure (e.g., Azure Data Lake, Synapse, Data Factory) and AWS (e.g., Redshift, Glue, S3, Lambda) . Strong background in data architecture , including data More ❯