1 to 25 of 144 Data Lake Jobs in the UK excluding London

Key Responsibilities: Data Pipelines and ETL Processes ETL Design: Design and implement ETL processes within MaPS architectural patterns to extract, transform, and load data from various source systems into our reporting solutions. Pipeline Development: Develop and configure meta-data driven data pipelines using data orchestration tools such as Azure Data … unusual data profiles and establish recovery processes to maintain data integrity. Azure Services Utilise Azure Cloud based data technology platforms, Data Lake based storage & Cloud data pipeline/orchestration tools for efficient data storage, processing, and transfer. Ensure the scalability and reliability of data solutions … implementing ETL processes. Experience in using SQL to query and manipulate data. Proficiency in Azure data tooling such as Synapse Analytics, Microsoft Fabric, Azure Data Lake Storage/One Lake, and Azure Data Factory. Understanding of data extraction from vendor REST APIs. Spark/Pyspark or Python skills a bonus More ❯

Senior Data Ops Data EngineerLeeds 2/3 days per week£55,000-£67,000+ Excellent Benefits18 Months FTC with long term potential Your New Company Our large public sector organisation are seeking a senior Data Platform DataOps Engineer to serve as our clients first DataOps specialist in a growing team of Data … and DevOps teams to align operational strategies with technical and business requirements. Optimize operational performance and cost management for services including Azure Data Factory, Azure Databricks, Delta Lake, and Azure Data Lake Storage. Serve as the domain expert in DataOps by providing strategic guidance, mentoring colleagues, and driving continuous process improvements. What you will … within the Microsoft Azure ecosystem. Hands-on expertise with Azure Data Platform with components such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Delta Lake, Azure SQL, Purview and APIM. Proficiency in developing CI/CD data pipelines and strong programming skills in Python, SQL, Bash, and PySpark More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

youll be part of a diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, youll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data flows, data sourcing and data governance. Data Architects work closely with clients to understand their data requirements and take responsibility for ensuring solutions are fit for purpose. They also provide technical leadership for the rest of the team in the area of data. Data Architects may also work at the solution or … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building More ❯

youll be part of a diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, youll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data flows, data sourcing and data governance. Data Architects work closely with clients to understand their data requirements and take responsibility for ensuring solutions are fit for purpose. They also provide technical leadership for the rest of the team in the area of data. Data Architects may also work at the solution or … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building More ❯

ll be part of a diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, you'll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data flows, data sourcing and data governance. Data Architects work closely with clients to understand their data requirements and take responsibility for ensuring solutions are fit for purpose. They also provide technical leadership for the rest of the team in the area of data. Data Architects may also work at the solution or … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building More ❯

ll be part of a diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, you'll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data flows, data sourcing and data governance. Data Architects work closely with clients to understand their data requirements and take responsibility for ensuring solutions are fit for purpose. They also provide technical leadership for the rest of the team in the area of data. Data Architects may also work at the solution or … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem At Kainos, we believe in the power of diversity, equity and inclusion. We are committed to building More ❯

Embark on a transformative journey as an Enterprise Data Architect. At Barclays, our vision is clear -To define, direct and govern the bank's target data architecture (inc. shared data environment, data model and standards) in support of business strategy, ensuring that data is accurate, secure and accessible to meet … as an Enterprise Data Architect, you should have experience with: Developing architectural solutions and patterns using latest data engineering approaches, for example data lake, events, API Ability to logically model financial data Excellent written communications skills with experience using structured design languages, for example UML, Archimate or equivalent Some other highly … valued skills may include: Good stakeholder management skills up to C-level execs Understanding of data governance and data management processes and best practice You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen strategic thinking and digital and technology, as well More ❯

SQL BI Developer SQL BI Developer - SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric, Data Warehousing, Agile - Hybrid (Warrington) - £45-50k + excellent bonus + excellent bens An experienced SQL BI Developer is urgently required by my client with strong experience of … the Microsoft BI stack and Azure Services (SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric). You will be responsible for helping to build a new, best practice-based reporting solution which will function Enterprise-wide. You will be involved in the full software development … role on a product development programme using the Microsoft BI stack and Azure Services (SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric) - Work collaboratively within an Agile team of Developers, Testers and BA/Product Owners on a set of new greenfield projects - Observe object More ❯

Social network you want to login/join with: We are looking for an experienced Data Governance Lead to drive enterprise-wide data governance initiatives with a focus on modern cloud data platforms, specifically Databricks and Microsoft Azure. This role will define and enforce data policies, standards, and best practices that ensure … business objectives and compliance requirements. Collaborate with data engineering and platform teams to integrate data governance within Databricks and Azure environments, including Data Lake, Synapse, and Purview. Define and enforce data classification, access management, and lineage tracking using Azure-native and third-party tools. Lead the Data Governance Council … governance, data management, or data architecture. Hands-on experience with Databricks and/or Microsoft Azure data services (e.g., Data Lake Storage, Synapse, Purview, Azure Data Factory). Strong understanding of data governance frameworks such as DAMA-DMBOK. Familiarity with data privacy, security, and More ❯

management technical knowledge so as to be able to work across full data cycle. • Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD • Coding experience in Apache Spark, Iceberg or Python (Pandas) • Experience in change and release management. • Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: • Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB • Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) • Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. • Experience is building Data lake and building CI/CD data pipelines • A candidate is expected More ❯

Job Description - Data Architect () Data Architect - Job title: Data Architect Location: Filton/Frimley/Portsmouth Broad Oak/Scotstoun. We offer a range of hybrid and flexible working arrangements. Please speak to your recruiter about the options for this particular role Salary: Up to £72,000 depending on skills and experience What you … ll be doing: Design and implementation of the integration layer within the established Enterprise Integration & Data Warehouse (EIDW) platform Design and implementation of effective, robust data solutions Design and maintenance of conceptual, logical and physical data models Delivery and ownership of a Data Architecture strategy that underpins the Naval Ships strategy and … solutions Experience in Master Data Management and Data Governance Hands on experience working in Data Warehouse (normalised/dimensional) or Data Lake programs/projects primarily as a Data Architect or Data Modeller Strong knowledge in conventional data modelling techniques (conceptual/physical/logical More ❯

Job Description - Data Architect () Data Architect - Job title: Data Architect Location: Filton/Frimley/Portsmouth Broad Oak/Scotstoun. We offer a range of hybrid and flexible working arrangements. Please speak to your recruiter about the options for this particular role Salary: Up to £72,000 depending on skills and experience What you … ll be doing: Design and implementation of the integration layer within the established Enterprise Integration & Data Warehouse (EIDW) platform Design and implementation of effective, robust data solutions Design and maintenance of conceptual, logical and physical data models Delivery and ownership of a Data Architecture strategy that underpins the Naval Ships strategy and … solutions Experience in Master Data Management and Data Governance Hands on experience working in Data Warehouse (normalised/dimensional) or Data Lake programs/projects primarily as a Data Architect or Data Modeller Strong knowledge in conventional data modelling techniques (conceptual/physical/logical More ❯

Job Description - Data Architect () Data Architect - Job title: Data Architect Location: Filton/Frimley/Portsmouth Broad Oak/Scotstoun. We offer a range of hybrid and flexible working arrangements. Please speak to your recruiter about the options for this particular role Salary: Up to £72,000 depending on skills and experience What you … ll be doing: Design and implementation of the integration layer within the established Enterprise Integration & Data Warehouse (EIDW) platform Design and implementation of effective, robust data solutions Design and maintenance of conceptual, logical and physical data models Delivery and ownership of a Data Architecture strategy that underpins the Naval Ships strategy and … solutions Experience in Master Data Management and Data Governance Hands on experience working in Data Warehouse (normalised/dimensional) or Data Lake programs/projects primarily as a Data Architect or Data Modeller Strong knowledge in conventional data modelling techniques (conceptual/physical/logical More ❯

EIT Oxford fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are currently recruiting for a Data Architect to support the EIT Pathogen Programme. In this role, you will play a pivotal part in designing and implementing cutting-edge data architectures to support the … pathogen mission. You'll collaborate closely with cross-functional teams to understand business requirements and translate them into robust data models and architectures. As a Data Architect , you'll have the opportunity to shape the future of our data platform and collaborate with platform and product teams to deliver analytical and AI products to … architecture governance processes Essential Knowledge, Skills and Experience: Knowledge and experience of architecting and delivering modern data platform standards, tools and patterns including data lakes, lake houses, iceberg, data mesh Experience of architecting, building, and delivering modern data platforms at scale Familiar with TOGAF and other enterprise architecture frameworks Experience and More ❯

Data Architect (Contract) London, England, United Kingdom It has been determined that this role falls outside of IR35 THE ALLSAINTS TEAM At AllSaints we are in the business of feelings - making our customers feel cool and confident. If, like us, you believe in the power of a great outfit, we'd love to talk to you. We're … are a brand embarking on a very exciting plan and we are seeking new members of the team who want to contribute to this. THE ROLE As a Data Architect (contract) for Project Nova, you will be instrumental in shaping AllSaints' journey to become a truly data-driven, AI-powered organisation. You will lead the design … and implementation of our enterprise data architecture. This role is central to the Data & Integration workstream of Project Nova, building on our existing data warehouse and BI capabilities to accelerate our data transformation and enable the use of greater AI-driven insight and actions. You will ensure our data assets More ❯

that adventure. Our employees are at the heart of delivering impactful and meaningful work for our clients and helping them to reach for and realise their vision. Snowflake Data Architect Slalom is seeking an experienced Snowflake Data Architect to contribute to its growing Data Capability. The ideal candidate is a professional … with experience in designing, developing, validating and communicating enterprise data solutions using Snowflake. Deep experience in developing enterprise data management strategies including data lake/warehouse implementations, data movement, data services, data acquisition, data conversion, and archive/recovery. What will you do? Lead as …/advise clients on reference architectures Requirements: Expert in capturing end user requirements and aligning technical solutions to the business objectives Experience in leading, designing and implementing Cloud Data strategies, including designing multi-phased implementation roadmaps Significant experience (and ideally certified) in Snowflake and acted as lead data architect on at least two Snowflake implementations. Expertise More ❯

working on high-impact projects for clients across sectors, delivering intuitive, visually engaging tools that connect directly to data platforms like Microsoft Fabric’s Data Lake, Power.B.I., Qlik Sense, SQL Server, Airtable, and Databricks. The role calls for someone equally comfortable coding clean, scalable applications as they are working with APIs, shaping UI/UX … that deliver real business value. RESPONSIBILITIES Develop, test, and deploy custom web applications and dashboards, connecting to multiple enterprise data sources (e.g., Microsoft Fabric Data Lake, Power.B.I., Qlik Sense, SQL Server, Airtable, Databricks) Build advanced data visualisations using D3.JS and other JavaScript libraries to create highly interactive, responsive interfaces Integrate applications with APIs … development and integration (REST, GraphQL) Familiarity with database technologies and query languages (SQL, NoSQL) Experience working with data sources such as Microsoft Fabric’s Data Lake, Power.B.I., Qlik Sense, Airtable, and Databricks Good grasp of DevOps practices, including CI/CD pipelines and code management workflows Cloud deployment experience with Azure and/or AWS More ❯

passionate about helping our people get more out of life too; building careers with real growth, a sense of purpose, belonging and wellbeing. About the role This Principal Data Engineer role will work exclusively within our AdTech business unit whilst ensuring alignment to best practices, standards, and policies. The strategic direction is led by the Data … from this role. This role will work within the AdTech squad focusing on their priorities that will enable a consistent, efficient, and effective use of the Data Lake, Enterprise Data Warehouse, and marketing tools. Any experience with automating process and embedding re-useable patterns is interesting. As our AdTech Principal Data Engineer you … of services across AWS , Google Cloud , Celebrus and OneTrust Key Responsibilities Analysis, design, architecting and development of AdTech data solutions for deployments to the Data Lake and Data Warehouse. Actively engaging with our Data Performance Unit on strategic direction, technology, and delivery excellence. Peer/code review for other team members. More ❯

Data Lead This role can be based in either UK or Portugal Who we are? Verifile is an award-winning leading provider of CV verification and background screening services using innovative technology and methodology. We carry out background checks on candidates to enable our clients to make informed and long-term rewarding recruitment decisions. As Data Lead, youll be the driving force behind ensuring our data is accurate, secure, and fully leveraged. Youll create a single source of truth, turning information into actionable insights and uncovering opportunities that give us a competitive edge. Youll design and evolve Verifiles data infrastructure, adopting emerging technologies to boost performance and efficiency. Partnering with … approach. Experience in SaaS or platform-based businesses is a plus. Experience in data roles (data engineering, BI, analytics or architecture). Data lake storage, SQL database, NoSQL Sound understanding of database architecture and relevant underpinning concepts, including relational data modelling, frameworks, warehouse and data lake design, performance More ❯

Data Architect – Law Firm Location: London (Hybrid – at least 2 days per week in office) A leading international law firm is seeking an experienced Data Architect to own and deliver its enterprise data strategy. You’ll play a key role in shaping the firm’s approach to data architecture, governance, and analytics … helping to drive innovation with emerging technologies such as AI and Machine Learning. Key Responsibilities: Translate the firm’s data strategy into actionable roadmaps. Design and implement enterprise data models and architectures. Champion best practices in data governance, quality, and compliance. Lead the adoption of Azure-native data solutions. Collaborate with business … Requirements: Proven experience as a Data Architect, ideally in a law or professional services firm. Strong background in Azure data services (Synapse, Data Lake, Data Factory, Databricks, Purview, etc.). Expertise in data modelling, data warehousing, and data lakehouse design. Knowledge of data More ❯

Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Date: 11 Jul 2025 Company: Royal London Group Job Title: Lead Data Engineer Contract Type: Permanent Location: Edinburgh or Alderley Park Working style: Hybrid 50% home/office based Closing date: 20th August 2025 We are seeking to hire a Lead … Data Engineer to design, develop and operate automated data engineering platforms. This role will contribute to the Group by improving the speed, accuracy, consistency, repeatability, and overall quality of data processing. This reduces costs and enables the Data Automation team to focus on more complex strategic tasks. The Lead Data … processing systems. Has successfully led data platform initiatives. A good understanding of data processing technologies and tools such as Apache Spark, Data Lake, Data Warehousing and SQL Databases. Proficiency in programming languages such as Python and CICD techniques to efficiently deliver change in a consistent, controlled, and high-quality manner More ❯

About Us Makutu designs, builds and supports Microsoft Azure cloud data platforms. We are a Microsoft Solutions Partner (Azure Data & AI) and are busy building a talented team with relevant skills to deliver industry leading data platforms for our customers. The Role The Data Engineer role is key to building and growing … including the use of cloud native technologies, DevOps practices, CI/CD pipelines and agile delivery Experience with data modelling, data warehousing, data lake solutions Able to communicate effectively with senior stakeholders. Successful candidates will likely posses Azure certifications such as DP-600 and/or DP-700. Also, applicants will have experience … working with some of the following technologies: Power BI Power Apps Blob storage Synapse Azure Data Factory (ADF) IOT Hub SQL Server Azure Data Lake Storage Azure Databricks Purview Power Platform Python More ❯

Azure Data Engineer Rate - up to £450/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based in Central London. They are seeking an experienced Azure Data … Factory, Databricks (PySpark), and Azure Synapse Analytics. Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best practices in data … commercial experience as a Data Engineer delivering enterprise-scale solutions in Azure Azure Data Factory Azure Databricks (PySpark) Azure Synapse Analytics Azure Data Lake Storage (Gen2) SQL & Python Understanding of CI/CD in a data environment, ideally with tools like Azure DevOps. Experience working within consultancy or client-facing projects More ❯