26 to 50 of 52 Data Lake Jobs in the North of England

Join Barclays as a Digital Customer Data Engineer, where you'll be leading the development for a new shared data platform that is transforming how individuals/organisations interact with the bank. Your role involves using the latest data and AI engineering skills to deliver a digital capability. As part of our team, you … ll also benefit from being part of a vast professional network, collaborating with industry mentors and experts. To be successful you should have experience with: Modern data engineering practices, inc. event-driven and data lake. Digital platform development, inc. experience developing colleague and customer facing applications. Banking software development. Deep technical awareness of cloud and data technology, such as Kafka, Data Bricks, microservices, API. Some other highly valued skills may include: Technical design: Analysis and documentation of system characteristics, inc. designing solutions to meet multi-faceted non-functional requirements. Communication Skills: Ability to clearly convey project goals to senior leadership, updates, and technical details to stakeholders at all levels, including non-technical More ❯

Simpson Associates transforms raw data into actionable insights that drive positive change. Our Microsoft data expertise, our specialist sector knowledge, plus our innovative and trusted advice and guidance are just some of the reasons clients choose to work with us. Our mission is to help purpose-led organisations from within the public and private sectors to … harness data as a lever for change and enable them to realise business value more quickly. We provide the full range of services to support organisations on their data transformation journey. From advisory support and data strategy, to developing Data & AI solutions, right through to providing a range of managed services. We … key data science models and how they relate to achieving business benefits. Advantageous Qualifications and Skills Microsoft Azure expertise including the use of DevOps, Data Lake, Azure Functions, Power BI. Experience in project delivery and consultancy. Prince 2 Agile or similar. Experience in Blue Light, NHS, Local Government or Social Housing sectors. Experience with MLOps More ❯

Data Engineer- Outside Ir35 - £500 daily rate- Manchester - 6 Month Role Overview: We're seeking an experienced Contract Data Engineer with a strong background in Databricks and cloud data platforms to support a high-impact data transformation programme. This hybrid role requires 2 days per week onsite in our Manchester office (non … negotiable) , with the remainder remote. You'll join a fast-paced, delivery-focused data team responsible for building and optimising scalable, production-grade data pipelines and infrastructure. Key Responsibilities: Design and implement robust, scalable ETL/ELT pipelines using Databricks and Apache Spark Ingest, transform, and manage large volumes of data from diverse sources … based projects Strong hands-on skills with Databricks , Apache Spark , and Python or Scala Proficient in SQL and working with large-scale data environments Experience with Delta Lake , Azure Data Lake , or similar technologies Familiarity with version control, CI/CD, and infrastructure-as-code tools Ability to deliver independently in a contractor capacity More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

Our Senior Data Engineers enable public sector organisations to embrace a data-driven approach by providing high-quality, cost-efficient data platforms and services tailored to clients' needs. They develop, operate, and maintain these services, ensuring maximum value for data consumers, including analysts, scientists, and business stakeholders. Key responsibilities As a Senior … Data Engineer, you may assume multiple roles based on our clients' needs. The role is highly hands-on, supporting project delivery as a senior contributor and upskilling client team members. You might also take on a technical architect role, collaborating with the MadeTech team to identify growth opportunities within the account. You'll need a drive to deliver … criteria. Enthusiasm for learning and self-development Proficiency in Git (including Github Actions) and understanding of branch strategies Experience gathering and meeting requirements from clients and users on data projects Strong experience in Infrastructure as Code (IaC) and deploying infrastructure across environments Managing cloud infrastructure with a DevOps approach Handling and transforming various data types (JSON More ❯

very best people, simple. We have a relatively small IS team dedicated to making a significant impact on our technology organization and landscape. This team collaborates to manage data, software engineering, support and administration, CRM, cloud-based services, and more to support BES Group’s continual growth. We are seeking a skilled Senior Microsoft Data Engineer … users to translate required business outcomes into value enabling solutions not only our business but also for our customers. What will you be doing? As a Senior Microsoft Data Engineer for BES Group, you will own the … development and implementation of data and reporting solutions using the latest Microsoft technologies: SQL Server Integration Services Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure SQL Database, Azure Data Factory and Power BI. This role is hybrid based in our Manchester office. You will: Work with other members of the team More ❯

BI Developer - Hybrid Working Salary : £50,000 Are you passionate about data and have a strong technical foundation in Microsoft technologies? We're on the lookout for a BI Developer with expertise in Azure and SQL-based data warehousing solutions to join our team and help design, build, and maintain scalable BI infrastructure. This is a … back-end focused role where your core responsibilities will center around data engineering, warehousing, and BI platform development - supporting and enhancing our enterprise reporting capabilities. Responsibilities: Lead the design, development, and deployment of robust BI and data warehousing solutions. Translate business requirements into clear and scalable technical specifications. Work closely with the wider Data … SSRS, Power BI Deep understanding of Azure data services, including: Azure Data Factory (must-have) Azure Synapse Analytics Azure SQL Database Azure Data Lake Storage Strong ETL/ELT pipeline design and data integration skills. Proficiency in SQL, Python, and ideally Scala. Solid experience in data modelling, schema design More ❯

ADF Data Engineer ADF Data Engineer - SQL Server 2022, ADF, ETL Pipelines, Azure Synapse Analytics, Azure SQL, Azure Data Lake, SSIS, SSAS, SSRS, Power BI, Fabric, Data Warehousing, Agile - Hybrid (Warrington) - £50k + excellent bonus + excellent bens An experienced ADF Data Engineer is urgently required by my client More ❯

and never miss the latest updates or an exclusive offer. Name Email Telephone Address Cover Note Upload CV What do you want to search? Keyword Apprenticeship Type Location Data Analyst Apprentice Apply From: 29/06/2025 Learning Provider Delivered by NOWSKILLS LIMITED Employer NO.1 COPPERPOT CREDIT UNION Vacancy Description Support the IT Manager in planning and … execution of the new data/reporting strategy and improvement initiatives. Responsible for the delivery of new reports and dashboards across the Credit Union. Develop and implement databases, data collection systems, and data engineering solutions that optimise reporting efficiency and clarity. Acquire data from primary or secondary data sources and … maintain databases/data lakes. Interpret data, analyse results using statistical techniques, and provide ongoing reports. Identify, analyse, and interpret trends or patterns in complex data sets. Filter and "clean" data by reviewing raw data, reports, and performance indicators to locate and correct code problems. Work with management to prioritise More ❯

Lead Data Architect £65,000 - 75,000 GBP Hybrid WORKING Location: Manchester, North West - United Kingdom Type: Permanent Lead Data Architect Manchester (Hybrid) Up to £75,000 DOE + Benefits An established digital consultancy is hiring a Lead Data Architect to design secure, scalable, user-centred data solutions for clients across the … You'll work in multi-disciplinary agile teams to deliver cloud-native architectures that unlock real business insight - and contribute to the governance, modelling and strategy that keeps data meaningful and accessible. What you'll be doing: Define and implement data architectures aligned with enterprise strategy Build and maintain key artefacts: ER models, data dictionaries, pipeline/lineage models Own architecture decisions and guide clients through change approval processes Champion governance and modelling standards (Kimball, warehousing best practices) Analyse source data, evaluate APIs, reverse-engineer data models Work closely with engineers to deliver cloud-based data solutions Visualise insights via tools like Power BI or Tableau More ❯

We are looking for a dedicated and enthusiastic Junior Data Analyst with a healthcare science background. The successful candidate will have a keen eye for detail, a willingness to learn and an understanding of the link between data, insights, and business decisions. The candidate will be working with research, operational and financial data. Role Develop and … implement databases, data collection systems and data engineering solutions that optimise reporting efficiency and clarity Acquire data from primary or secondary data sources and maintain databases/data lakes Interpret data, analyse results using statistical techniques and provide ongoing reports Identify, analyse, and interpret trends or patterns in … complex data sets Filter and “clean” data by reviewing raw data, reports, and performance indicators to locate and correct code problems Work with management to prioritise business and information needs Locate and define new process improvement opportunities. Collaboration – work closely with healthcare professionals to ensure data-driven insights align with clinical needs More ❯

this position will be office based The Role Joining a team of three you will be responsible for database management as well as creating complex queries to extract data for Power BI visualisation. Key responsibilities include: Work closely with stakeholders to gather requirements and deliver data solutions that support business objectives Design and maintain SQL stored … procedures and functions to improve performance and efficiency Develop and maintain reports using SSRS Visualise and analyse data to provide meaningful insights on trends and opportunities The Requirements Key requirements include: Proficiency in SQL with strong knowledge of T-SQL, including writing complex queries, stored procedures and functions Experience with SSRS and SSIS Familiarity with database design principles … insights via Power BI or similar visualisation tools Experience with Azure data tools would be an advantage i.e. Data Factory, Data Lake More ❯

like you belong, and where you are empowered to succeed. We look forward to having you join our journey - and seeing how far we can go, together! Position Data Services Engineer at Conferma is responsible for: Enhancing and maintaining the Conferma Data Platforms As a data specialist you will support in the maintenance and … deployment of Conferma application & services at a data layer.This includes a combination of Microsoft SQL databases, batch file data & Microsoft Fabric data lakes. You will possess excellent troubleshooting skills and demonstrate the ability to make key technical decisions to ensure confidentiality, integrity & security of all platform data sets. Systems Analyst responsibilities: Providing … internal and external technical support for Conferma data platforms, working closely with L1-3 support teams. Working inside the Conferma SQL release pipeline to ensure consistency & reliability of product enhancements through non-production & production environments, including undertaking code reviews and approvals prior to release. Collaborating alongside the DBA function to assess proposed changes to platform data More ❯

and never miss the latest updates or an exclusive offer. Name Email Telephone Address Cover Note Upload CV What do you want to search? Keyword Apprenticeship Type Location Data Analyst Apprentice Apply From: 26/05/2025 Learning Provider Delivered by NOWSKILLS LIMITED Employer STANDGUIDE LTD Vacancy Description Develop and implement databases, data collection systems … and data engineering solutions that optimise reporting efficiency and clarity. Acquire data from primary or secondary data sources and maintain databases/data lakes. Interpret data, analyse results using statistical techniques, and provide ongoing reports. Identify, analyse, and interpret trends or patterns in complex data sets. Filter and … clean" data by reviewing raw data, reports, and performance indicators to locate and correct code problems. Work with management to prioritise business and information needs. Locate and define new process improvement opportunities. Key Details Vacancy Title Data Analyst Apprentice Employer Description Standguide has supported individuals and employers for over 30 years. We are a More ❯

multi-account Organization. This should include: • Networking and DNS components, Compute, Storage and Backup platforms, Logging, Messaging, and Alerting services, Organisational account management platforms, Serverless platforms, Data Lake/Lake House platforms, services & architecture, IAM roles and policies, Security and audit tools and practices • Experience with implementing complex Terraform IaC and multi-branch CI/CD More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

Pro currently has an exciting opportunity for a motivated and detail-oriented individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims) using data ingestion and analysis tools such as … Intrali, Quantemplate, or Matillion. The project focuses on the extraction, transformation, and loading (ETL) of data from various sources into data warehouses and data lakes. This is an ideal role for an aspiring Data Architect in the Insurance Industry. Pro operates a hybrid working policy, with time split between home and our … Gloucester or Liverpool office. This vacancy is also suitable for a fully remote individual, as we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing, and preparing datasets for analysis. Creation and management of both Risk and Claims data maps (models) and reconciliation of results. More ❯

Your new company We are currently collaborating with one of the largest global pharmaceutical companies to recruit an SAP Finance Data & Analytics Specialist on a contract basis. This organisation is currently undergoing significant change and growth projects, and to effectively manage these transitions, they are seeking a qualified finance professional with experience in a SAP S/… Your new role Duration: 12MonthsHybrid Working: 2 days per week on-site, 3 days per week remoteOutside IR35 [Ltd Comp] or Inside IR35 [Umbrella]As a SAP Finance Data & Analytics Specialist, you will play a pivotal role in ensuring the continuity of critical Finance reporting solutions while supporting the design and implementation of the S/4 HANA … S/4 HANA vs ECC differences in FI/CO modules. Experience with analytics tools and data platforms such as PowerBI, Qlik, Azure Data Lake, Snowflake, SAP B4H, and SAP Analytics Cloud. Bachelor's or Master's degree in Finance or Accounting. What you'll get in return The role offers a competitive day More ❯

maintainable infrastructure deployments. Cloud Platform Expertise Act as SME for Azure IaaS, M365, Power Platform, and Dynamics. Support AI and analytics initiatives, including standing up a Data Lake and developing AI bots for internal and client use. Network & Data Centre Transformation Lead the redesign of network architecture, including VPNs and connectivity to Azure. Oversee the … decommissioning of on-prem data centres by migrating workloads to the cloud. Team Leadership & Mentoring Mentor a 9-person infrastructure team. Share best practices and provide guidance on cloud technologies and operational excellence. What We're Looking For Experience 5+ years in a similar Azure-focused role. Proven track record of cloud migration and re-engineering projects. Consultancy More ❯

maintainable infrastructure deployments. Cloud Platform Expertise Act as SME for Azure IaaS, M365, Power Platform, and Dynamics. Support AI and analytics initiatives, including standing up a Data Lake and developing AI bots for internal and client use. Network & Data Centre Transformation Lead the redesign of network architecture, including VPNs and connectivity to Azure. Oversee the … decommissioning of on-prem data centres by migrating workloads to the cloud. Team Leadership & Mentoring Mentor a 9-person infrastructure team. Share best practices and provide guidance on cloud technologies and operational excellence. What We're Looking For Experience 5+ years in a similar Azure-focused role. Proven track record of cloud migration and re-engineering projects. Consultancy More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯

ML solutions design, architecture and development and deployment of large scale machine learning or deep learning models and/or systems into production, including batch and real-time data processing. - Working knowledge of generative AI and hands-on experience in prompt engineering, deploying and hosting Large Foundational Models - Strong communication skills in English and Spanish with the ability … network, compute, storage, and virtualization experience - AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, SageMaker pipelines, Glue, LakeFormation, LLM, Bedrock, Datalake, MLOps, Model inference, Model Monitoring, Bedrock, and other ML services) - AWS Associate level certifications (e.g., Solutions Architect Associate, Machine Learning Associate) - Experience with automation and scripting (e.g., Terraform, Python) Amazon … We make recruiting decisions based on your experience and skills. We value your passion to discover, invent, simplify and build. Protecting your privacy and the security of your data is a longstanding top priority for Amazon. Please consult our Privacy Notice ( ) to know more about how we collect, use and transfer the personal data of our More ❯

Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high … control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies. Work with stakeholders, including … design, product, and executive teams, to address platform-related technical issues. Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.? All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to More ❯