26 to 50 of 152 Data Lake Jobs in the UK excluding London

About Us Makutu designs, builds and supports Microsoft Azure cloud data platforms. We are a Microsoft Solutions Partner (Azure Data & AI) and are busy building a talented team with relevant skills to deliver industry leading data platforms for our customers. The Role The Data Engineer role is key to building and growing … including the use of cloud native technologies, DevOps practices, CI/CD pipelines and agile delivery Experience with data modelling, data warehousing, data lake solutions Able to communicate effectively with senior stakeholders. Successful candidates will likely posses Azure certifications such as DP-600 and/or DP-700. Also, applicants will have experience … working with some of the following technologies: Power BI Power Apps Blob storage Synapse Azure Data Factory (ADF) IOT Hub SQL Server Azure Data Lake Storage Azure Databricks Purview Power Platform Python More ❯

Senior Data Engineer - Burton on Trent £64-67k x1 day per week on-site (Sponsorship is not provided for this opportunity) As a Senior Data Engineer, you will lead the development and optimisation of our customers Azure-based data platform, ensuring efficient, secure, and high-performing data services. You'll design … using Data Factory, Databricks, and related services. Data Architecture: Develop and optimise scalable data models, warehouses, and lakes (Azure Synapse, Data Lake Storage). Governance & Security: Enforce compliance and data protection standards (GDPR, DPA) through robust security and governance practices. Automation: Implement CI/CD pipelines and Infrastructure as … share knowledge across teams. Skills & Experience Expert in Azure Databricks (Unity Catalog, DLT, cluster management). Strong experience with Azure Data Factory, Synapse Analytics, Data Lake Storage, Stream Analytics, Event Hubs. Proficient in Python, Scala, C#, .NET, and SQL (T-SQL). Skilled in data modelling, quality, and metadata management. Experience with CI More ❯

Senior Data Engineer - Burton on Trent £64-67k x1 day per week on-site (Sponsorship is not provided for this opportunity) As a Senior Data Engineer, you will lead the development and optimisation of our customers Azure-based data platform, ensuring efficient, secure, and high-performing data services. You'll design … using Data Factory, Databricks, and related services. Data Architecture: Develop and optimise scalable data models, warehouses, and lakes (Azure Synapse, Data Lake Storage). Governance & Security: Enforce compliance and data protection standards (GDPR, DPA) through robust security and governance practices. Automation: Implement CI/CD pipelines and Infrastructure as … share knowledge across teams. Skills & Experience Expert in Azure Databricks (Unity Catalog, DLT, cluster management). Strong experience with Azure Data Factory, Synapse Analytics, Data Lake Storage, Stream Analytics, Event Hubs. Proficient in Python, Scala, C#, .NET, and SQL (T-SQL). Skilled in data modelling, quality, and metadata management. Experience with CI More ❯

building a high-impact team in Northern Ireland. The Role: You'll build robust backend services in Go that power both the data platform (data lake, pipelines, model serving) and product-facing APIs . You'll collaborate with Data Science (leaders, DS, ML engineers, data engineers) to standardize tooling, operationalize models … and real-time/batch inference * Help standardize frameworks, libraries, and best practices across DS/Eng (packaging, environments, CI/CD, testing) * Contribute to the data lake/data platform foundations (catalog, lineage, governance, access patterns) Backend APIs & Services * Build and evolve gRPC/REST APIs powering customer-facing features and internal platforms * Implement … analytics (Parquet/Arrow) Career Paths (we're hiring multiple profiles): * Go Backend (API-first): Own product APIs, performance, reliability. * Go Platform (ML-first): Focus on data lake, pipelines, model serving. * Hybrid: Split time across APIs and ML platform enablement. * Growth routes to Senior or Tech Lead as the NI team scales. Why Join: * Shape a greenfield More ❯

Job Title: Lead Data Engineer Location: York/Manchester/Leeds (3 times a week) Salary: up to £62,000 + Excellent Benefits Type: Full-Time, Permanent WRK Digital is proud to partner exclusively with a well-known, high-profile organisation on a transformative data journey. We are seeking a Lead Data Engineer to … join its dynamic Data & Business Intelligence function. This is a pivotal role in a data-driven organisation, where high-quality, well-governed, and accessible data is central to strategic and operational decision-making. As part of this first-class Data and Analytics team, you’ll play a key role in shaping how … modernise legacy systems, migrate data to the cloud, and optimise data storage and processing costs. Ensure the integrity of datasets within the data lake aligns with logical models and that data is well documented in wikis, data dictionaries, etc. Participate in data engineering sprints, develop data More ❯

POWWR are looking for a Senior Data & Reporting Engineer to join our UK engineering team and help advance POWWR’s modern data and analytics platform (MDP). In this role, you’ll design and deliver high-quality data pipelines, models, software, and reporting solutions that power product features and insights across our SaaS business. … Platform Engineering: Design, build, and orchestrate modular, declarative data pipelines using dbt , Dagster , and dlt within a Kubernetes-hosted environment . Develop and optimize Delta Lake models in Databricks/Synapse and Azure Data Lake Gen2 , ensuring scalability and ACID compliance. Maintain and enhance existing data pipelines (SQL Server, Azure … architecture teams as well as business stakeholders. Bonus Skills Knowledge of data governance and lineage tools (e.g., OpenMetadata, DataHub). Use of table formats such as Delta Lake or Iceberg. Experience with data quality frameworks (e.g., dbt, Elementary, Great Expectations). Understanding of event-driven architectures and real-time data streaming (Kafka, Event More ❯

Data Services Manager, Must live within 2 hours of London or Berkshire and be able to come in for ad-hoc meetings when required. Primarily home based though. Role 90% management and 10% technical and you will manage a team of 6. Salary £ 80000 - 85000 + good benefits. Financial service background mandatory. Expanding financial services client are looking … for a Data Services Manager to join their team. The role will suit a candidate who has been a manager for a couple of years and is looking to further develop their management career. Guiding a team of 6 you will be responsible for supporting the day to day operations of the data function, with a … mentoring, coaching, team development etc) Very strong technical skills that will include - SQL, SSIS, SSRS, SAS, Power BI, Power Platform, Azure Data Factory, Azure Data Lake, Databricks A good understanding of dimensional modelling techniques, including Kimball's Business Development Lifecycle Ability to design hybrid data solutions across on-prem and cloud data More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

health and life sciences, and transport. The Data Engineer will have experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. You will join the business at a period of huge growth. WE ALSO HAVE OPENINGS IN THE FOLLOWING AREAS – MANCHESTER, LONDON. … growing capability, and we are looking for a Data Engineer with experience in AWS cloud technologies for ETL pipeline, data warehouse and data lake design/building and data movement. AWS data and analytics services (or open-source equivalent) such as EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. What you … requirements You thrive in problem-solving and analytical thinking You enjoy collaborating with multiple stakeholders in a fast-paced environment Experience in the design and deployment of production data pipelines from ingestion to consumption within a big data architecture, using Java, Python, Scala, Spark, SQL. Experience performing tasks such as writing scripts, extracting data More ❯

Senior Data Engineer – Azure | Power BI | ADF | Synapse £60,000–£70,000 + excellent benefits Birmingham or London (1–2 days per month on-site) Leading & Growing Financial Services Organisation Are you an experienced Senior Data Engineer looking for a role where you can influence architecture, own enterprise data solutions, and shape the future … warehousing solutions. Govern and enhance enterprise Power BI datasets, semantic models, DAX performance, and reporting standards . Influence the data architecture across Azure Data Lake and wider Azure services. Play a pivotal role in the organisation’s transition toward Microsoft Fabric . Implement best-in-class data validation, monitoring, and quality frameworks … Strong proficiency in Azure Synapse Analytics , data warehousing, and SQL pools. Excellent SQL engineering capability across complex transformations and optimisation. Solid background with Azure Data Lake and cloud data architecture. Demonstrable experience delivering production-grade Azure data solutions. Clear communication skills and ability to influence technical and business teams. Experience mentoring More ❯

Data Services Manager Remote (UK-based) | Quarterly travel to London £85,000 + benefits Permanent | Full-time About the Role My client are seeking an experienced Data Services Manager to lead a high-performing data engineering function within a fast-paced financial services organisation. Reporting to the Senior Data Services Manager, you … ll drive the design, delivery, and continuous improvement of data solutions that underpin strategic decision-making and regulatory compliance. You'll manage and mentor Data Engineers, ensuring scalable, high-quality data products and operational excellence across both on-premise and cloud platforms. Key Responsibilities Lead, coach, and develop a team of Data … data solutions. Provide technical leadership across the Microsoft and Azure Data Platform (SQL Server, Power BI, Azure Data Factory, Databricks, Data Lake). Champion Data Governance , Data Quality , and Data Management best practices. Collaborate with business and technology teams to align data solutions More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Should also have knowledge of testing, agile environments and ideally finance related projects. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. More ❯

Principal Data Engineer - hyrbid (Leeds) - £70k-£80k Are you an experienced Azure Data Engineer looking to make an impact in an established financial insitution. We are seeking a hands-on professional to join a high-performing team tasked with building and enhancing a modern Azure data platform, with an expertise in Databricks. About the … architectural decisions, and support the migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders across the organization to … outputs. Opportunity to transition into a leadership role, supporting the development of junior team members. Key Skills & Experience: 5+ years of experience in Azure (ADF, Data Lake, Synapse). Strong SQL skills for data integration and reporting. Experience with Power BI for visualization and analytics. Familiarity with Python (preferred but not currently in use More ❯

On behalf of our prestigious financial services client, we are seeking an experienced and strategicData Architect to lead the development and delivery of enterprise-wide data governance and architecture initiatives. This is a high-impact role that will shape the organisation's approach to data management, compliance, and innovation. Key Responsibilities: Strategic Framework & Governance Development Design … and implement a robust data governance framework, including policies, standards, and procedures. Define data ownership models and appoint data stewards across key domains. Introduce and manage a metadata catalogue to enhance data discoverability and transparency. Establish clear retention, access, and usage policies for various data types. Governance Leadership Set up … governance best practices. Core Expertise Strong experience in conceptual, logical, and physical data modelling. Proven track record in designing data warehouse and data lake architectures. Solid understanding of Master Data Management (MDM) principles. Integration & Engineering Skilled in developing and managing data pipelines and orchestration workflows. Hands-on experience with More ❯

Overview Data & Insight Managing Consultant Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We've been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should always make a remarkable impact for our clients. We do this … helping them solve their most complex, ambiguous and strategic problems in new, inspiring and innovative ways. We collaborate with our clients to build remarkable digital products, together. The Data and Insight Practice in AND Consulting helps our clients to use data to make business choices based on evidence, design best in class technology and support them … in embedding data into their strategy and ways of working. As a Data & Insight Managing Consultant, you will be working and leading on data consulting projects with AND Digital's household name clients. Responsibilities Creating data visions & strategies for household name businesses Driving the transformation required for data-focussed ways More ❯

Purview Implementation Specialist – Azure - Inside IR35 The client is seeking a Purview Implementation Specialist to deliver the setup and integration of Microsoft Purview within their Azure data environment. The role focuses on metadata management, lineage tracking, and data quality enablement to support enterprise data governance and compliance.Key Responsibilities Configure and manage Microsoft Purview for metadata, lineage, and classification. Connect Purview to Azure and on-prem data sources (Data Lake, Synapse, SQL, Power BI, ADF). Implement and automate data quality rules, profiling, and dashboards. Enable and maintain metadata, glossary, and classification structures. Integrate Purview with ADF … and handover materials for internal teams. Skills & Experience Strong hands-on experience with Microsoft Purview implementation. Proficient in Azure data services – ADF, Synapse, SQL, Data Lake, Power BI. Good understanding of data governance, metadata, and data quality principles. Experience with automation scripting (PowerShell, ARM, Azure CLI). Excellent documentation and communication More ❯

Data Engineer Join the Team Powering the Future of Data at Vivedia Location: Sheffield - Hybrid (3 days per week) Salary : £50,000 to £60,000 depending on experience Department: Data Team At Vivedia , data isn’t just numbers — it’s the engine driving every decision, every innovation, and every customer experience. We … re growing, and we’re looking for a Data Engineer who’s ready to build the foundations of a smarter, more connected future. Why You’ll Love This Role You’ll play a pivotal role in designing, building, and optimizing the data systems that power our business. From robust pipelines to scalable platforms, your work will … help every team at Vivedia unlock insights, drive performance, and make data-driven decisions that matter. This is your chance to shape the future of our data ecosystem — and see your impact ripple across an entire organisation. What You’ll Do Build the backbone of our data universe Design, develop, and deploy scalable, secure More ❯

Midlands (Full time onsite) We are currently working with a community services provider, who require a Senior BI Manager/BI Architect with a strong understanding of Azure Data and Data Engineering tools. Reporting into the CTI as a key member of the clients newly formed Data Engineering team, you will lead the design … client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. You will be responsible for strategic & technical Leadership and will help shape and evolve the BI and … required Excellent experience in BI architecture/management and team leadership Deep expertise in Azure BI architecture and cloud services Extensive hands-on experience with Azure Fabric, SQL warehousing, DataLakes, Databricks Track record in MI/BI product development using Agile and Waterfall methods Experience managing cross-functional teams and sprint activities The role will be full time on-site More ❯

West Midlands (Hybrid working) We are currently working with a community services provider, who require a Senior BI Manager/BI Architect with a strong understanding of Azure Data and Data Engineering tools. Reporting into the CTI as a key member of the clients newly formed Data Engineering team, you will lead the design … client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. You will be responsible for strategic & technical Leadership and will help shape and evolve the BI and … data platform strategy to meet business, compliance, and care objectives. You will lead a multi-disciplinary data engineering team using Agile (Scrum) methodologies and oversee the development and scalability of the strategic data platform, along with managing the BI function and ensure alignment with business goals. Skills & experience required Excellent experience in BI architecture More ❯

Job Title: Data Architect Location: Solihull; a flexible hybrid working model which supports you as well as enabling you to work collaboratively with your colleagues Hours: Full time, Permanent A bit about us: At BNP Paribas Personal Finance, we are proud to be part of a global banking group. Our mission is simple: to provide straightforward consumer finance … purchases in a responsible way. The Role: To propose Information System (IS) level architecture solutions, ensuring their consistency, adaptability and sustainability in alignment with the UK Enterprise Architecture Data strategy. As a Data Architect within the Enterprise Architecture Team, your role will involve defining and building data architectures to enable the business to utilize … data strategically. You will ensure compliance with standards related to data architecture, management, quality, integrity, and protection. Key Responsibilities: Contribution and implementation of the data vision, designing architecture solutions that are in line with the Architecture rules and principles, long-term business objectives and compliant with data regulations (GDPR, BCBS239...) Define, in More ❯

A well-established professional services business is hiring a Head of Data to play a key role in building and optimising its modern cloud data environment. This is a technical, hands-on role with team management responsibilities – ideal for someone who wants to stay close to the tech while guiding and developing a growing team. Role … week onsite What you’ll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data governance, quality, and security Manage … experience as a Data Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people management Excellent problem-solving skills and More ❯

As a Technical Lead, you will play a key role in architecting and implementing robust data solutions within Google Cloud Platform (GCP). Full-time Closes 24/12/2025 Working within the Data Engineering department, you … will help to shape the technical direction of cloud-based solutions. Your focus will be defining the overall architecture for data ingestion from our Data Lake, including processing, storage, and analysis within GCP. By leveraging your expertise of Google BigQuery architecture and its features, you will design and implement data models optimised for … performance, scalability and best practices. You will act as the subject matter expert for development and optimisation to maintain data governance, while ensuring all designed solutions adhere to Company standards, security best practices, and regulatory requirements. This role is eligible for inclusion in the Company's hybrid working from home policy. Preferred Skills and Experience Proven experience as More ❯

A well-established professional services business is hiring a Data Engineering Manager to play a key role in building and optimising its modern cloud data environment. This is a technical, hands-on role with team management responsibilities – ideal for someone who wants to stay close to the tech while guiding and developing a growing team. Role … week onsite What you’ll be doing: Design, build, and optimise scalable data pipelines and architecture Work hands-on with PySpark, Databricks, Azure, and Data Lake to deliver high-performance solutions Translate business needs into technical requirements and data-driven solutions Ensure best practice in data governance, quality, and security Manage … experience as a Data Engineer or Senior Data Engineer with some team leadership responsibilities Strong technical expertise with PySpark, Databricks, Azure, and Data Lake Deep understanding of data architecture and ETL processes in cloud environments The ability to balance coding and technical delivery with people management Excellent problem-solving skills and More ❯

days per week onsite) We are currently working with a leading services provider, who require a Senior BI Manager/BI Architect with a strong understanding of Azure Data and Data Engineering tools. Working as a key member of a newly formed Data Engineering team, you will lead the design, development, and ongoing enhancement … client's data and reporting infrastructure. You will be the strategic owner of the Azure Data Platform, overseeing services such as Azure Data Lake, Data Warehouse, Data Factory, Databricks, and Power BI. This role would suit a hands on BI Architect who is looking to progress into a "Head … rapid career growth! Skills & experience required: Excellent experience in BI architecture Deep expertise in Azure BI architecture and Cloud services Extensive hands-on experience with Azure Fabric, SQL warehousing, DataLakes, Databricks Track record in MI/BI product development using Agile and Waterfall methods Desirable - Experience managing cross-functional teams and sprint activities Benefits: Generous and achievable bonus scheme More ❯