23 of 23 Permanent Data Lake Jobs in the North of England

Bristol, Cardiff, Edinburgh, London, Manchester Overview We are seeking to hire experienced Data Solution Architects in the Data & AI Architecture team of Deloitte's AI & Data offering. Data is the key enabler for the rapid growth journey across the Energy Resources & Industrials industries. Our team delivers transformational data solutions to … benefit our clients, their customers and any relevant government agencies or regulators. The Energy Resources & Industrial industry is undergoing a significant transformation, driven by the increasing importance of data and analytics. Enterprises are turning to decentralised data management approaches such as Data Mesh and disruptive technologies to build innovative and domain-oriented data … designing and implementing complex data solutions across areas such as data integration, data modelling, data management and governance, data Lake/Lakehouse/Data Mesh, data engineering, analytics, AI/GenAI, observability, cloud, security. Experience aligning data architecture blueprints across business units and More ❯

management technical knowledge so as to be able to work across full data cycle. - Proven Experience working with AWS data technologies (S3, Redshift, Glue, Lambda, Lake formation, Cloud Formation), GitHub, CI/CD - Coding experience in Apache Spark, Iceberg or Python (Pandas) - Experience in change and release management. - Experience in Database Warehouse design and data … ETL/ELT development in AWS preferred with experience in the following: - Strong experience in some of the AWS services like Redshift, Lambda,S3,Step Functions, Batch, Cloud formation, Lake Formation, Code Build, CI/CD, GitHub, IAM, SQS, SNS, Aurora DB - Good experience with DBT, Apache Iceberg, Docker, Microsoft BI stack (nice to have) - Experience in data warehouse design (Kimball and lake house, medallion and data vault) is a definite preference as is knowledge of other data tools and programming languages such as Python & Spark and Strong SQL experience. - Experience is building Data lake and building CI/CD data pipelines - A candidate is expected More ❯

in their ongoing digital transformation. This position offers the chance to develop the initial data strategy, design scalable pipelines from scratch, and create a data lake that will be central to reporting initiatives. If you are experienced in managing AWS based data infrastructures and eager to drive innovative solutions, this role is perfect … automated data pipelines to ingest, process, and deliver quality data across internal systems. Lead the setup and ongoing evolution of a centralised data lake in AWS to unify data from various sources, supporting BI and analytics needs. Partner with product managers, analysts, software developers, and IT to ensure data integration and reporting capabilities support business goals. Manage and optimise AWS data warehousing and lake architectures to ensure high quality, accessible data for insights. Enable efficient data processing, transformation, and analysis through best in class AWS technologies and methodologies. Identify opportunities for workflow optimisation and automation to enhance performance. Stay current More ❯

Job summary The role holder is responsible for the leading the design, development, and ongoing enhancement of organisations data infrastructure and pipelines to support advanced data collection, storage, processing, and analysis. Main duties of the job The role holder is accountable for a team of data engineers, fostering a culture of technical excellence and … continuous improvement. The role holder will work collaboratively with cross-functional teams, including analysts, software engineers, and key stakeholders, to ensure that data solutions are robust, scalable, and aligned with the strategic goals of delivering high-quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide … applicants may be required to undertake an Enhanced Disclosure via the Disclosure and Barring Service (DBS). Job description Job responsibilities Lead the design and execution of scalable data storage solutions, including databases, data warehouses, and data lakes, ensuring efficient handling of large data volumes. Oversee development and optimisation of ETL pipelines More ❯

Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote Industry: Retail & eCommerce Role: Senior Data Engineer Location: Remote Salary: £65,000 Benefits The Company We're working with one of the UK's leading retail and e-commerce brands; a business that's experiencing rapid growth and investing heavily in data, analytics, and technology to stay ahead of the competition. With millions of customers, an ever-expanding online presence, and a dynamic product offering, data is at the heart of every decision they make. Their mission is to transform how data is captured, engineered, and consumed across the organisation. Enabling & empowering smarter insights and creating … driven recruitment consultancy supporting data and technology professionals connect with forward-thinking businesses who enhance our tomorrow. Senior Data Engineer - Azure, Data Factory, Datalakes, SQL - £65,000 - Remote More ❯

Senior Data Engineer Hybrid 2x per week (Leeds, West Yorkshire) Salary to £65,000 + benefits About the Role: Our client, a tech for good organisation, is investing heavily in digital transformation and building a cloud-first, data-led approach to support major environmental goals. Think scalable pipelines, secure platforms, and data systems that … directly contribute to a greener future. As a Senior Data Engineer, you'll play a key role in designing and delivering robust, cloud-based data infrastructure. You'll work with large datasets, build scalable pipelines, and help ensure data is high quality, secure, and accessible, while mentoring more junior engineers and working closely with … Cloud data platform development and deployment. Expertise across data warehouse and ETL/ELT development in AWS preferred Experience is building a Data Lake as well as building CI/CD data pipelines Excellent communication and problem-solving skills. What's on Offer: Salary to £65,000 + benefits Hybrid working More ❯

Senior Data Engineer, Databricks, £ 60000 - 65000 + benefits. Strong Performant SQL and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role. Knowledge of testing, the finance sector or energy sector is a distinct advantage. Expanding SaaS product company are looking … for a number of Senior Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Data Architect £130,000 GBP Remote WORKING Type: Permanent Data Architect Up to £130,000 Bonus Location: Homeworker- UK Additional Locations: Belfast, Birmingham, London Type: Permanent A global leader in IT solutions in Consulting is seeking a Data Architect with experience across the UK Public sector to join their elite, fast growing Data practice & Intelligence practice. This is a key role in an award-winning Data & AI Team , using cutting-edge technology and industry -leading expertise to solve real-world problems. You'll drive driving SME data architecture strategies, in a client-facing leadership role with a focus on managing employee performance and team development. A successful … defining information handling models and capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Why Choose This Data Architect Role? Competitive salary up More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … in an agile team.Experience working in a highly regulated industry and with highly sensitive data.Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks.Experience in data science using R, Stata, or Python.Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket.Understanding of clinical trials, GCP, and GxP.What We Offer More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Databricks Data Engineer (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. … In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Are you ready to take ownership of a growing Data & BI function? This is a fantastic opportunity for a hands-on leader to shape and evolve a modern Microsoft data platform, deliver insightful analytics, and mentor a small team while remaining close to the technology.We’re looking for someone who thrives at the intersection of strategy … turning complex datasets into impactful Power BI dashboards that drive decision-making.What you’ll be doing Lead the design, optimisation, and ongoing evolution of a cloud-based Azure data estate. Build and maintain SQL models, queries, and stored procedures to deliver accurate, performant datasets. Develop and manage ETL/ELT pipelines using Azure Data Factory and … Deep expertise in Microsoft SQL Server, including T-SQL, indexing, and performance tuning. Proven experience with the Azure data stack (Data Factory, Data Lake Gen2, SQL MI, Power BI, Purview). Strong Power BI skills (advanced DAX, Power Query/M). Solid understanding of data modelling, ETL design, and relational More ❯

multi-account Organization. This should include: • Networking and DNS components, Compute, Storage and Backup platforms, Logging, Messaging, and Alerting services, Organisational account management platforms, Serverless platforms, Data Lake/Lake House platforms, services & architecture, IAM roles and policies, Security and audit tools and practices • Experience with implementing complex Terraform IaC and multi-branch CI/CD More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

days on-site) £40,000 £50,000 + benefits Were partnered with a fast-growing technology business that is undergoing a major transformation programme to modernise its data and analytics capabilities. Theyre looking for a Business Intelligence Developer who can play a key role in shaping the way data is used across the organisation. This is … an opportunity to get involved in a large-scale, complex data environment and make a tangible impact on how insights drive decision-making at a global level. What youll be doing Designing and developing Power BI dashboards and reports that provide meaningful insight and data storytelling for senior stakeholders. Working with large, complex datasets from multiple … sources, ensuring they are queried, modelled, and optimised for reporting. Collaborating with engineers and analysts to develop data pipelines and models that feed enterprise-level reporting solutions. Supporting the ongoing transformation programme , helping to break down legacy reporting structures and introduce modern BI practices. Partnering closely with commercial, finance, and operational teams to ensure reporting is aligned with More ❯

focus on stabilising the financial planning cycle, followed by implementing a scalable forecasting tool to support long-term growth. You will play a pivotal role in building robust, data-driven insights to support strategic decision-making, while ensuring that the FP&A function is positioned for sustainable and autonomous success in the future. Key Responsibilities … Deliver a financial forecast model for FY26 and beyond, supporting the FY27–FY31 Business Plan. Design, recommend, and implement a scalable forecasting solution, leveraging the existing data lake infrastructure. Drive KPI reporting and forecasting across multiple areas: Marketplace: Revenue & margin analysis, acquisition data integration, pipeline analysis, tech spend, overheads, headcount, and scenario modelling. Experiences: Weekly … Capex integration from SAP/Ariba, and scenario modelling. Central: Employee and non-employee costs, below EBITDA items, Capex, cashflow, and balance sheet reporting. Partner with finance, IT, data, and operations to deliver automated planning models and reporting dashboards. Provide in-depth cost analysis, financial simulations, and scenario modelling to support transformation initiatives. Ensure alignment and transparency in More ❯

focus on stabilising the financial planning cycle, followed by implementing a scalable forecasting tool to support long-term growth. You will play a pivotal role in building robust, data-driven insights to support strategic decision-making, while ensuring that the FP&A function is positioned for sustainable and autonomous success in the future. Key Responsibilities … Deliver a financial forecast model for FY26 and beyond, supporting the FY27–FY31 Business Plan. Design, recommend, and implement a scalable forecasting solution, leveraging the existing data lake infrastructure. Drive KPI reporting and forecasting across multiple areas: Marketplace: Revenue & margin analysis, acquisition data integration, pipeline analysis, tech spend, overheads, headcount, and scenario modelling. Experiences: Weekly … Capex integration from SAP/Ariba, and scenario modelling. Central: Employee and non-employee costs, below EBITDA items, Capex, cashflow, and balance sheet reporting. Partner with finance, IT, data, and operations to deliver automated planning models and reporting dashboards. Provide in-depth cost analysis, financial simulations, and scenario modelling to support transformation initiatives. Ensure alignment and transparency in More ❯

focus on stabilising the financial planning cycle, followed by implementing a scalable forecasting tool to support long-term growth. You will play a pivotal role in building robust, data-driven insights to support strategic decision-making, while ensuring that the FP&A function is positioned for sustainable and autonomous success in the future. Key Responsibilities … Deliver a financial forecast model for FY26 and beyond, supporting the FY27–FY31 Business Plan. Design, recommend, and implement a scalable forecasting solution, leveraging the existing data lake infrastructure. Drive KPI reporting and forecasting across multiple areas: Marketplace: Revenue & margin analysis, acquisition data integration, pipeline analysis, tech spend, overheads, headcount, and scenario modelling. Experiences: Weekly … Capex integration from SAP/Ariba, and scenario modelling. Central: Employee and non-employee costs, below EBITDA items, Capex, cashflow, and balance sheet reporting. Partner with finance, IT, data, and operations to deliver automated planning models and reporting dashboards. Provide in-depth cost analysis, financial simulations, and scenario modelling to support transformation initiatives. Ensure alignment and transparency in More ❯

focus on stabilising the financial planning cycle, followed by implementing a scalable forecasting tool to support long-term growth. You will play a pivotal role in building robust, data-driven insights to support strategic decision-making, while ensuring that the FP&A function is positioned for sustainable and autonomous success in the future. Key Responsibilities … Deliver a financial forecast model for FY26 and beyond, supporting the FY27-FY31 Business Plan. Design, recommend, and implement a scalable forecasting solution, leveraging the existing data lake infrastructure. Drive KPI reporting and forecasting across multiple areas: Marketplace: Revenue & margin analysis, acquisition data integration, pipeline analysis, tech spend, overheads, headcount, and scenario modelling. Experiences: Weekly … Capex integration from SAP/Ariba, and scenario modelling. Central: Employee and non-employee costs, below EBITDA items, Capex, cashflow, and balance sheet reporting. Partner with finance, IT, data, and operations to deliver automated planning models and reporting dashboards. Provide in-depth cost analysis, financial simulations, and scenario modelling to support transformation initiatives. Ensure alignment and transparency in More ❯

DevOps Engineer/Data Engineer – Azure Data Platform 6 Month Contract Hybrid Working - Newcastle Or Leeds £400-£450 Inside IR35 We are looking for an experienced DevOps Engineer to join our team and take a leading role in developing, supporting, and optimising our Microsoft Azure Data Platform. This is a hands-on position where … you will exercise substantial autonomy, solve complex challenges, and help shape our data platform strategy. Key Responsibilities: Develop, support, and optimise solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design, build, and maintain Infrastructure and Configuration as Code using Terraform. Implement and manage CI/CD pipelines (ideally in GitLab … for SC Clearance (must have lived and worked in the UK for the past 5 years). Strong experience with Microsoft Azure services including ADF, Synapse Analytics, and Data Lake. Additional experience with Azure DevOps. Demonstrable experience developing and supporting cloud-based applications. Proficiency with Infrastructure as Code (Terraform). Hands-on experience with CI/CD pipelines More ❯

DevOps Engineer/Data Engineer – Azure Data Platform 6 Month Contract Hybrid Working - Newcastle Or Leeds £400-£450 Inside IR35 We are looking for an experienced DevOps Engineer to join our team and take a leading role in developing, supporting, and optimising our Microsoft Azure Data Platform. This is a hands-on position where … you will exercise substantial autonomy, solve complex challenges, and help shape our data platform strategy. Key Responsibilities: Develop, support, and optimise solutions across Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake. Design, build, and maintain Infrastructure and Configuration as Code using Terraform. Implement and manage CI/CD pipelines (ideally in GitLab … for SC Clearance (must have lived and worked in the UK for the past 5 years). Strong experience with Microsoft Azure services including ADF, Synapse Analytics, and Data Lake. Additional experience with Azure DevOps. Demonstrable experience developing and supporting cloud-based applications. Proficiency with Infrastructure as Code (Terraform). Hands-on experience with CI/CD pipelines More ❯

Description As part of the Platform & AI Enablement team under GPTO Engineering, you'll report to the Sr. Director Engineering API. This team is accountable for shaping enterprise data architecture, enabling high-performance AI-driven workloads, and acting as a technical bridge between engineering and architecture. Your Impact Lead the design and delivery of platform capabilities powering enterprise … scale data processing, AI integration, and developer acceleration Partner with architects and senior engineers to set technical direction and align implementation patterns with long-term strategy Apply a product mindset to ensure platform solutions address real customer and business needs Deliver thought leadership and coding excellence across Java, React, Python, and other fit-for-purpose technologies Mentor and … technical dead-ends Contribute to technical planning, strategy, and retrospectives that shape the future of the platform Your Qualifications 12+ years of software engineering experience in enterprise-scale, data-centric, or platform environments Deep expertise in distributed data technologies such as Apache Kafka, Flink, and/or Pulsar Strong background in event-driven architectures, streaming pipelines More ❯