1 to 25 of 126 Data Lake Jobs in the UK excluding London

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

self-testing pipelines that proactively identify processing issues or discrepancies. You'll build solutions that pipe transform data into data lake storage areas, physical database models and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications. … Databricks administration and pyspark. Data Factory/Synapse Workspace - for building data pipelines or synapse analytics pipelines. Data Lake - Delta Lake design pattern implementation experience in Azure Data Lake Gen2 with file hierarchy namespace and low-level permissions management. … Architecture - Knowledge or experience in implementing, Kimball style Data Warehouse. Experience in building Metadata with Azure Purview or Data Lake Gen2. Data Quality - Experience in applying Data Quality rules within Azure Data Flow Activities. Data Transformation More ❯

to transform care delivery worldwide, ensuring every patient receives the safest, highest-quality care. Through our innovative Healthcare Operations Platform, we're connecting data to unlock trusted insights that enable improved decision-making and help deliver safer healthcare for all. At RLDatix were making healthcare safer, together. Our … efficient ETL (Extract, Transform, Load) data pipelines to integrate data from multiple sources into centralized repositories. Developing data lake solutions based on the medallion architecture (Bronze, Silver, Gold) to ensure structured data processing. Implementing data governance and security policies … within the data lake to maintain compliance and data integrity. Automating data pipeline execution and monitoring to enhance efficiency and reduce manual intervention. Developing and maintaining Python scripts for data processing, automation, and integration to streamline workflows. Monitoring and troubleshooting data More ❯

is diverse and equitable, building a culture of collaboration and inclusion. Position Overview Ithaca Energy is accepting applications for the position of Senior Data Engineer located in our Aberdeen Office. Reporting to the Analytics and Integration Lead, the Senior Data Engineer will play a pivotal role … stakeholders and business users to understand data utility, and analyze, model, and organize data into the medallion data lake for reporting. Ensure data quality and data reliability: Drive improvements in data quality assessments, ensure effective, efficient, robust … solutions. Expertise with Synapse (notebooks and data flows) is essential. Working knowledge of PySpark is essential. Experience with Azure Data Lake Storage is essential. Understanding of medallion data lakehouse architecture is essential. Strong problem-solving skills for complex data challenges. Background More ❯

and quality of work differentiates us. We always support our people and customers to achieve shared, agreed goals. Role Description As a Principle Data Architect, you will work collaboratively across all aspects of project delivery and client engagement, from pre-sales and project scope definition, to project delivery … and hypercare. You will lead the conversation with HSO's customers and define the vision for better use of data across their organisation. You will own the technical design and manage the delivery of data & analytics solutions to HSO's customers. You will be highly experienced … data modelling Exposure and experience of Azure data and analytics products and services (SQL and NOSQL databases, data lake, data factory, synapse, data bricks, PowerBI, Fabric, MDM, Purview, Profisee.) Experience of working at a senior level with technology stakeholders More ❯

The AI Engineer is a key role in the Data Platform Portfolio team, building the data platform, driving value from data across the business. With strong technical skills and business acumen to help turn millions of potential data points into actionable insights … our customer retention rates, and drive operating efficiencies across the business. The primary goals of the team are: To build and run a data platform which can create and deliver analytics to colleagues and deliver regulatory reporting. Ingest and transform data from multiple systems, modelling data … or outliers. Proficient in designing and implementing ELT pipelines using tools like dbt, with strong knowledge of data warehousing, data lake concepts, and data pipeline optimization. Skilled in SQL for data manipulation, analysis, query optimisation, and database design. Artificial Intelligence and More ❯

Head of Data – ERP Implementation Head of Data – ERP Implementation The location of the role is London (hybrid working) . The duration of the contract is 12 months . The pay rate on offer is £1000 - £1200 per day (inside IR35) . The client is a … multinational high-street retailer. Role Summary The Head of Data for the ERP Program is responsible for leading and delivering the data strategy across all phases of the ERP implementation. This role ensures the effective governance, cleansing, migration, security, and archiving of data. The incumbent will … collaborate with business and technical teams to ensure data integrity, compliance, and alignment with organizational objectives. Key Responsibilities: 1. Data Strategy & Leadership Define and execute the data strategy for the ERP program, ensuring alignment with business objectives. Provide strategic leadership on data More ❯

Company Details Required Skills & Knowledge: Solid hands-on experience with Microsoft Technology Stack (2022) Extensive experience of SQL/data warehousing Proven experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration. Experience working with Python and Power BI Proven ability of … Microsoft BI software development including database/reporting development, full development cycle Strong data modelling, problem solving, information analysis, attention to detail, flexibility of approach. The ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions. The ability to design … solution design for new and existing requirements. Collaborate with the business to understand needs. Design and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts, cubes, reports, and dashboards; inline with the company data management framework and More ❯

Join our Cardiff Bay team as a Data Warehouse Developer within the Cardiff office. You are expected, if successful, to work 50% of the week in the office. WHO ARE WE? Privately owned and independently minded, Creditsafe operates with the singular vision of powering business decisions. We do … business information accessible to all. Twenty-five years later, we've not only realised this dream, changed the market for the better, made data intelligence accessible to all businesses big and small but most importantly, opened up new avenues of data intelligence for businesses with machine … quality, consistency, and performance across the warehouse. Work with Azure Data Services (Synapse, Data Factory, Data Lake, SQL DB, etc.) to build scalable solutions. Implement data governance, security, and best practices for the warehouse. Develop and maintain documentation on More ❯

for our clients and helping them to reach for and realise their vision. Azure and Databricks Architect Slalom is seeking an experienced Azure Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional with experience in designing, developing, validating, and … communicating enterprise data solutions using Azure and Databricks. Deep experience in developing enterprise data management strategies, including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. Experience … advise clients on reference architectures Design and develop scalable Databricks solutions on both Azure and AWS environments Lead the architecture and deployment of data solutions using Databricks Requirements: Expert in capturing end-user requirements and aligning technical solutions to the business objectives Experience in leading, designing, and implementing More ❯

employer and a member of myGwork – the largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. AWS Data Engineer Support | S2 | Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to … talk to you! Join our community. We have an exciting opportunity for an AWS Data Engineer Support to join our team of analysts to create the data and insights which support the functional areas of the bank. You'll play a key role understanding the types … using ideally AWS services such as S3, Glue, Athena, EMR, Kinesis, and Lambda Understanding of the principles behind designing and implementing data lake, lake house and/or data mesh architecture Problem solving skill with basic knowledge of the change management process Demonstrates understanding More ❯

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers … regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction and More ❯

Akkodis is a global leader in engineering, technology, and R&D, harnessing the power of connected data to drive digital transformation and innovation for a smarter, more sustainable future. As part of the Adecco Group, Akkodis combines the expertise of AKKA and Modis, with over 50,000 engineers … regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction and More ❯

a Research DataOps Engineer with a passion for research delivery, to join an Oxford University spin-out and to implement a Data Lake House from the ground up. This role is critical to support the next phase of our medical imaging AI and Analytics research. The role … individuals to support a variety of data and computing needs. The successful candidate will design and build out a data lake house, whilst being expected to actively contribute to ongoing data-centric product research. The ideal candidate will: be motivated at the thought … other and acting with candour and professionalism. Responsibilities Responsibilities include some or all of the following: Design and build a secure Data Lake House infrastructure to support AI and Data Analytics Research Manage Cloud/On-premises compute resources to achieve research objectives Contribute to More ❯

become a part of a dynamic and collaborative environment, with a customer-focused culture of innovation. The Junior Product Owner role within the Data team at Sidetrade presents an exciting opportunity for individuals eager to grow their careers in a fast-paced, innovative environment. You'll be part … real value for our clients and their customers. This role plays a key part in unlocking the full potential of our Data Lake - ensuring data is transformed into actionable insights that drive ROI. We're looking for someone with a genuine passion for data … the ability to manage multiple tasks simultaneously. Eagerness to learn and adapt in a fast-paced environment. Preferred Basic understanding of data lake architecture. Preferred familiarity with agile methodologies and tools like JIRA, Confluence, or similar. Ability to write clear and concise technical documentation. What we will More ❯

Job Overview: We are seeking an experienced and dynamic Project Manager to lead the modernization of our data platform to SAP Data Sphere. This role is responsible for overseeing the end-to-end execution of the project, including planning, execution, and delivery-ensuring that the project … and technological requirements. The Project Manager will work closely with technical teams, business stakeholders, and external partners to drive the transformation from legacy data systems to a cloud-based SAP Data Sphere environment. Key Responsibilities: Develop detailed project plans, timelines, and resource allocation for the SAP … Data Sphere modernization project. Define project scope, goals, and deliverables that support business objectives in collaboration with senior management and stakeholders. Collaborate with internal stakeholders (business units, IT teams) and external partners (vendors, consultants) to ensure alignment of project goals and technical requirements. Conduct regular project meetings, updates More ❯

this is done on a rota basis. Job Purpose The BI Lead will be responsible for shaping and maintaining the Enterprise BI and Data warehouse estate. You'll be working with both on-prem and cloud technologies, predominantly focussed on the Microsoft stack (SQL/Azure SQL databases … Data Factory, Synapse, Power BI, Power Platform) You will play a critical role in designing, developing, implementing and maintaining robust data solutions on the Azure and Power BI platforms. You will collaborate closely with cross-functional teams to gather requirements, understand business objectives, and translate them … including performance, pastoral, training and coaching Technical Skills: Strong experience of Azure services such as Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps Strong SQL programming skills Strong experience with Power BI data modelling and More ❯

an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data … as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Transform Healthcare with Cutting-Edge Tech! ???? Position: Data Engineer (Python/Databricks) Location: Remote Salary: Up to £80,000 + Benefits Are you driven by a passion for health tech and innovation? Do you dream of revolutionizing clinical research through advanced technology? If so, we have an incredible … and standards to secure clinical data both in-motion and at-rest. Shape Data Workflows: Utilize Databricks components like Delta Lake, Unity Catalog, and ML Flow to ensure efficient, secure, and reliable data workflows. Key Responsibilities Data Engineering with Databricks: Design … data lakes to support data analytics and machine learning. Requirements Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow. Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration. Clinical More ❯

AWS Data Engineer S3 Data Centre of Excellence AWS Data Engineer S3 Data Centre of Excellence Country: United Kingdom Interested in part-time, job-share or flexible working? We want to talk to you! Join our community. We have an exciting opportunity … to join our Data Centre of Excellence as an AWS Data Engineer. The AWS Data Engineer will work within a team of analysts to create the data and insights which support the functional areas of the bank. You'll use a variety … perfect opportunity to develop your career. The difference you'll make: Designing, building, and maintaining our AWS Data Estate. This includes S3 lake formation, Iceburg and extends to our Snowflake platform. Designing AWS-based services and capabilities adopting appropriate modelling techniques following agreed architectures, design standards, patterns More ❯

Lead BI Developer Lead BI Developer - Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps, SQL Development, Power BI, ETL/ELT, Data Pipelines - Hybrid (Warrington) - £60-70k + excellent bonus + bens An experienced … Lead BI Developer is urgently required by my client with significant experience of designing, building, implementing and maintaining robust data solutions on Azure SQL and BI platforms. Strong knowledge of ADF, Azure Data Lakes, Azure SQL and Synapse Analytics will be needed, along with experience of … responsibility to provide third line support of solutions in production if required. Lead BI Developer - Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and Azure Synapse Analytics, Logic Apps, SQL Development, Power BI, ETL/ELT, Data Pipelines - Hybrid (Warrington More ❯

Job Description: Data Modeler (Offshore) Location: India (Remote) Experience: 10+ years About Client A leading multinational IT services and consulting company specializing in digital transformation, cloud solutions, and AI-driven innovation. With a strong global presence, the company partners with enterprises across various industries to deliver cutting-edge … technology solutions. Must Have Skills: Solid expertise in data modeling, with considerable experience in database technologies, particularly Azure Databricks, Azure Synapse, and Azure Data Factory, to support business intelligence, analytics, and reporting initiatives. Strong understanding of best practices in data modeling to ensure that … experience, with strong domain knowledge in Clinical Research Organizations and Biopharmaceutical services preferred. Proven track record of designing, developing, and maintaining complex logical data models in multiple subject areas. Proficiency in data modeling tools such as ER/Studio, ERwin, or PowerDesigner. Strong proficiency in SQL More ❯

Job Description: We are seeking a highly skilled and visionary Director of Data Platforms and Architecture to lead the design, development, and governance of our enterprise-wide Snacking data platform ecosystem. This individual will be responsible for driving platform strategy, fostering innovation, and ensuring robust data architecture that empower multiple products and capabilities to power business decisions, scalability, and operational excellence. As a strategic leader, the Director of Data Platforms and Architecture will oversee the implementation and optimization of cutting-edge data technologies & solutions, establish best practices in data … and governance, and provide technical leadership to multidisciplinary teams. You will work closely with stakeholders across business, IT, and analytics teams to align data architecture with organizational goals, enabling seamless data acquisition and advanced analytics capabilities. What will be your key responsibilities? Strategic Leadership: Develop and More ❯

Key Responsibilities My client are expanding their data and technology capabilities and seeking a skilled Data Engineer to join this growing team. The successful candidate will help ingest, cleanse, and model data into unified, analytics-ready datasets supporting Business Intelligence, machine learning, and Data … -focused role Strong hands-on experience with Azure data services, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps & Logic Apps Azure Stream Analytics Azure Resource Manager tools: Terraform, Azure Portal, Azure CLI, and Azure PowerShell … Proficient in PySpark, Delta Lake, Unity Catalog, and Python Ability to write unit and integration tests using unittest, pytest, etc. Solid understanding of software engineering principles, including SOLID design, dependency injection, code structuring, and testing Experience with version control systems and CI/CD pipelines In-depth knowledge of More ❯

being the dedicated point of contact . You will: Lead and mentor a team of 6+ Tech Leads overseeing product engineering squads delivering data-centric products Provide strategic guidance , coaching, and professional development opportunities for engineering managers to empower their teams and deliver results Establish and maintain a … culture of mentorship and leadership development, identifying and nurturing talents Drive the recruitment, retention, and development of top-tier engineering talent within the data engineering team Define and drive the overall data platform strategy with a focus on Azure Cloud to ensure that the organisation's … optimization of the data platform, leveraging Azure technologies such as Azure Data Factory, Azure Synapse Analytics, Azure Data Lake, and Azure SQL Database Ensure the data platform supports data engineering, analytics, and data science initiatives across squads More ❯