101 to 125 of 147 Data Lake Jobs in the UK excluding London

A small and Power Platform Consultancy are looking for a Microsoft Fabric Data Engineer/Consultant to join their growing team in Winchester, and play a key role in expanding their Microsoft Fabric offering. This is a fantastic opportunity to join a collaborative and forward-thinking consultancy that is passionate about delivering cutting-edge data solutions. … You'll be working closely with clients to help them unlock the full potential of their data using Microsoft Fabric, acting as a trusted advisor and technical expert. This role is ideal for someone currently working in a consultancy or someone eager to step into their first consulting role. Ideally you'll spend most of your time in … role, you will have: Proven experience working with Microsoft Fabric or expertise in related technologies such as Power BI, Azure Synapse, Data Factory, Azure Data Lake, Notebooks etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Strong communication and stakeholder More ❯

The Role We are looking for a hands-on Azure Data Engineer who will lead the final phase of our Client's cloud migration and design the enterprise-grade data platform from the ground up. This is a hybrid role with a strong technical focusblending architecture, automation, and data engineeringto empower s next generation … across Europe, the US, and APAC. As they scale globally and accelerate their AI capabilities, they are completing their transition to the cloud and building a company-wide data platform to power insight-driven transformation for their consultants and clients Required Skills & Experience Must-Haves: 3+ years of hands-on Azure engineering experience (IaaS ? PaaS), including Infra as … data SMEguiding system administrators and upskilling junior technical team members. What You'll Achieve in Year 1 Months 312: Design and build their Azure data lake using Synapse , Fabric , or an alternative strategy. Ingest data from core platforms: NetSuite , HubSpot , and client RFP datasets. Automate data pipelines using ADF , Fabric Dataflows More ❯

A small and fast-growing Power Platform Consultancy is seeking a Microsoft Fabric Data Engineer/Consultant to join their dynamic team in London, and play a key role in expanding their Microsoft Fabric offering. This is a fantastic opportunity to join a collaborative and forward-thinking consultancy that is passionate about delivering cutting-edge data solutions. You'll be working closely with clients to help them unlock the full potential of their data using Microsoft Fabric, acting as a trusted advisor and technical expert. This role is ideal for someone currently working in a consultancy or someone eager to step into their first consulting role. In line with a hybrid working … you should have: Proven experience working with Microsoft Fabric or strong expertise in related technologies such as Power BI, Azure Synapse, Data Factory, Azure Data Lake etc. A solid understanding of data engineering principles, including data modelling, ETL/ELT processes, and data warehousing. Hands-on experience with Power More ❯

Job description The Data Program Manager required to have 15-20 yearsof experience in managing Data related projects, including at least 2 large transformation projects. The candidate should have a deep awareness of the data management life cycle, exceptional project management skills, and a solid grasp of benefits management are essential for … effectively managing and executing large/complex data-centric programs. Experience: Data Platform Modernization: Move legacy/on-premises applications, workloads, data lakes, lake houses, data warehouses, and data marts to cloud platforms Building platforms/applications that rely on the consolidation of disparate types of data from multiple source systems that need harmonization across dimension Data lifecycle management projects More ❯

and never miss the latest updates or an exclusive offer. Name Email Telephone Address Cover Note Upload CV What do you want to search? Keyword Apprenticeship Type Location Data Analyst Apprentice Apply From: 29/06/2025 Learning Provider Delivered by NOWSKILLS LIMITED Employer NO.1 COPPERPOT CREDIT UNION Vacancy Description Support the IT Manager in planning and … execution of the new data/reporting strategy and improvement initiatives. Responsible for the delivery of new reports and dashboards across the Credit Union. Develop and implement databases, data collection systems, and data engineering solutions that optimise reporting efficiency and clarity. Acquire data from primary or secondary data sources and … maintain databases/data lakes. Interpret data, analyse results using statistical techniques, and provide ongoing reports. Identify, analyse, and interpret trends or patterns in complex data sets. Filter and "clean" data by reviewing raw data, reports, and performance indicators to locate and correct code problems. Work with management to prioritise More ❯

Lead Data Architect £65,000 - 75,000 GBP Hybrid WORKING Location: Manchester, North West - United Kingdom Type: Permanent Lead Data Architect Manchester (Hybrid) Up to £75,000 DOE + Benefits An established digital consultancy is hiring a Lead Data Architect to design secure, scalable, user-centred data solutions for clients across the … You'll work in multi-disciplinary agile teams to deliver cloud-native architectures that unlock real business insight - and contribute to the governance, modelling and strategy that keeps data meaningful and accessible. What you'll be doing: Define and implement data architectures aligned with enterprise strategy Build and maintain key artefacts: ER models, data dictionaries, pipeline/lineage models Own architecture decisions and guide clients through change approval processes Champion governance and modelling standards (Kimball, warehousing best practices) Analyse source data, evaluate APIs, reverse-engineer data models Work closely with engineers to deliver cloud-based data solutions Visualise insights via tools like Power BI or Tableau More ❯

This is a pivotal role in a growing energy business with serious ambitions around data. You’ll shape how data is collected, governed, and used to drive decisions — across operations, risk, and customer delivery. It’s hands-on, strategic, and full of opportunity to lead from the front. What You’ll Be Doing: Designing and developing robust data pipelines to centralise and clean data from multiple sources Building conceptual and physical data models to support reporting and analysis Championing data governance and implementing controls to ensure quality and compliance Developing automated ETL solutions using Microsoft Azure tools Leading best practice in engineering standards, code quality, and peer review Supporting teams … training sessions and knowledge sharing Main Skills Needed: Proven experience in data engineering, ideally 5+ years Advanced SQL skills and strong knowledge of Azure (Data Lake, Synapse, SQL Server) Comfortable with Python, C#, and working with APIs Familiar with cloud data platforms (Azure essential; AWS useful) Confident designing data architecture and More ❯

Senior Data Engineer Up to £95,000 + benefits | Hybrid (3 days a week in City of London) A global financial services firm is hiring a Senior Data Engineer to join their Brokerage technology team. You'll be building and maintaining the data pipelines that underpin their £1bn+ broking business - with a strong focus … on improving brokerage data quality, optimising commercial analysis, and supporting complex client agreements. This is a hands-on engineering role working closely with stakeholders and system owners. You'll be expected to code daily (Python), manage Airflow pipelines (MWAA), build ETL processes from scratch, and improve existing workflows for better performance and scalability. Key responsibilities Design and build … of systems, workflows, and configs Tech environment Python, SQL/PLSQL (MS SQL + Oracle), PySpark Apache Airflow (MWAA), AWS Glue, Athena AWS services (CDK, S3, data lake architectures) Git, JIRA You should apply if you have: Strong Python and SQL skills Proven experience designing data pipelines in cloud environments Hands-on experience with Airflow More ❯

this position will be office based The Role Joining a team of three you will be responsible for database management as well as creating complex queries to extract data for Power BI visualisation. Key responsibilities include: Work closely with stakeholders to gather requirements and deliver data solutions that support business objectives Design and maintain SQL stored … procedures and functions to improve performance and efficiency Develop and maintain reports using SSRS Visualise and analyse data to provide meaningful insights on trends and opportunities The Requirements Key requirements include: Proficiency in SQL with strong knowledge of T-SQL, including writing complex queries, stored procedures and functions Experience with SSRS and SSIS Familiarity with database design principles … insights via Power BI or similar visualisation tools Experience with Azure data tools would be an advantage i.e. Data Factory, Data Lake More ❯

Here at Halton Housing, we are looking for an experienced Data Developer to work across our vibrant organisation. What You'll Do: Coding DAX Measures and Dimensional Models Developing & delivering visually compelling … Power BI Dashboards & Reports to specification Developing and maintaining SSRS reports Developing & maintaining ETL pipeline solutions in Azure Data Factory and SSIS, utilising Azure Data Lake & Dev Ops Providing second & third line support for Data Team and own allocated support tickets Monitoring the Data Warehouse load and performance Providing high quality … documentation on Data Engineering solutions & Insight Datasets What You'll Need: Demonstrable SQL experience (T-SQL, SSMS) with a good understanding of Data Warehousing concepts Degree/professional qualification in a relevant business discipline and/or demonstrable experience in delivery in this area Ability to follow defined processes and procedures in an accurate and consistent More ❯

like you belong, and where you are empowered to succeed. We look forward to having you join our journey - and seeing how far we can go, together! Position Data Services Engineer at Conferma is responsible for: Enhancing and maintaining the Conferma Data Platforms As a data specialist you will support in the maintenance and … deployment of Conferma application & services at a data layer.This includes a combination of Microsoft SQL databases, batch file data & Microsoft Fabric data lakes. You will possess excellent troubleshooting skills and demonstrate the ability to make key technical decisions to ensure confidentiality, integrity & security of all platform data sets. Systems Analyst responsibilities: Providing … internal and external technical support for Conferma data platforms, working closely with L1-3 support teams. Working inside the Conferma SQL release pipeline to ensure consistency & reliability of product enhancements through non-production & production environments, including undertaking code reviews and approvals prior to release. Collaborating alongside the DBA function to assess proposed changes to platform data More ❯

Azure Cognitive Services to address specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI, machine learning, and Azure services … s AI strategy and innovation efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. Ensure that operational issues are identified, recorded, monitored and resolved. Align all … with Azure AI solutions, including Azure OpenAI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience with Azure Data More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that’s tackling one of modern medicine’s biggest challenges. They … DNA sequencing tech in play, they’re solving incredibly complex problems at the intersection of science and software. What you’ll be doing: Coming in as the Senior Data Engineer, you’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform.You’ll be leading on … the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. You'll be collaborating closely with engineers and scientists, helping to bridge the gap between their experiments and actionable data. That might mean streaming data More ❯

and never miss the latest updates or an exclusive offer. Name Email Telephone Address Cover Note Upload CV What do you want to search? Keyword Apprenticeship Type Location Data Analyst Apprentice Apply From: 26/05/2025 Learning Provider Delivered by NOWSKILLS LIMITED Employer STANDGUIDE LTD Vacancy Description Develop and implement databases, data collection systems … and data engineering solutions that optimise reporting efficiency and clarity. Acquire data from primary or secondary data sources and maintain databases/data lakes. Interpret data, analyse results using statistical techniques, and provide ongoing reports. Identify, analyse, and interpret trends or patterns in complex data sets. Filter and … clean" data by reviewing raw data, reports, and performance indicators to locate and correct code problems. Work with management to prioritise business and information needs. Locate and define new process improvement opportunities. Key Details Vacancy Title Data Analyst Apprentice Employer Description Standguide has supported individuals and employers for over 30 years. We are a More ❯

SAP Finance Data & Analytics Specialist ( Interim State Management) Luton - 12 months - outside IR35 - £580 per day The SAP Finance Data & Analytics Specialist wiill be responsible for ‘keeping the lights on’ for all the critical Finance global & local reporting solutions. Apply data, analytics, process, and object expertise to support interim state and S/… design, acting as an integral part of the Data and Analytics design team, considering both business process and analytics requirements. You will be managing 7 non-SAP analytics applications and responding to changes driven by the ongoing S4 Transformation' Essential Skills – 15 + years of experience in SAP Finance projects. Two or more full life-cycle S/…/4HANA and ECC in the FI/CO module functionalities. Experience and knowledge of Analytics tools and Data Warehouses like PowerBI, Qlik, Azure Data Lake, Snowflake, SAP B4H, SAP Analytics Cloud etc. Bachelor’s or master’s degree in finance or accounting or accounting qualifiction Desirable Skills Experience or knowledge in FP&A tools More ❯

Data Analyst - PowerBI Developer and MS Fabric Specialist Data Analyst - PowerBI Developer and MS Fabric Specialist Europe United Kingdom Full time Permanent Share Data Analyst - PowerBI Developer and MS Fabric Specialist Aberdeen We are currently recruiting for a talented PowerBI Developer and MS Fabric Specialist to support the delivery of digital data … Solid understanding of Power BI, DAX, Power Query and data modelling best practices Solid understanding of Power BI security models Demonstratable experience with Azure Data Lake, Synapse and MS Fabric Minimum 4 years hands on experience delivering Power BI solutions working across all ecosystems, dataflows, dashboards, performance tuning Proven experience supporting digital system or software … implementation, we drive efficiency and improvement and reduce risk, and help established, and emerging businesses achieve their goals. The Core29 BI Team develop reporting solutions to cultivate a data-oriented culture within an organisation and empower business decision-making at all levels based on quantifiable fact. More ❯

Data Engineers ?? Cambridge/Hybrid 2x per week onsite | ?? £60,000£75,000 | ?? SC or DV Clearance Required Were working with a specialist technology consultancy delivering cutting-edge solutions into the UKs most secure government environments. Due to continued growth, theyre looking for a talented Data Engineer to join their secure data team and … help solve complex, high-impact challenges. The role Youll design and develop secure data pipelines and platforms, working on projects that process sensitive, mission-critical information. This is an opportunity to apply your technical skills in an environment where your work has a direct impact on national security. What youll be doing: Build and optimise scalable data … workflows and processes What were looking for: 5+ years of experience in data engineering or related roles Proficiency in Python, Java, Golang, Spark, Azure, Synapse Analytics, SQL, Datalake Technology, PySpark, Python, Azure Functions, Azure Data Factory Nice to have: Scala. Familiarity with Kepler geospatial visualisation tool, or other similar tools, and experience working with geospatial data More ❯

multi-account Organization. This should include: • Networking and DNS components, Compute, Storage and Backup platforms, Logging, Messaging, and Alerting services, Organisational account management platforms, Serverless platforms, Data Lake/Lake House platforms, services & architecture, IAM roles and policies, Security and audit tools and practices • Experience with implementing complex Terraform IaC and multi-branch CI/CD More ❯

Reviews and health checks Mentor junior consultants Build strong customer relationships Support managed services as required Essential Requirements 3+ years consulting/managed services experience Solid Data Lake experience with AWS data solutions (Redshift, Glue, Athena, Lake Formation) Advanced AWS skills (EC2, S3, VPC, IAM, Lambda) Infrastructure as Code experience (CloudFormation/Terraform) AWS More ❯

+ a range of benefits to support your finances, wellbeing and family. Working Pattern: Permanent Full Time Flexible First options available The role As a Forecasting Data Scientist, you are responsible for analysing energy forecasting and settlements data to support business decisions. You will - Perform energy forecasting and settlements data analysis, ensuring outputs meet … and deadlines to support informed business and commercial decisions. - Develop and maintain new and/or existing Python-based machine learning models to interrogate large volumes of settlements data to forecast future energy consumption. - Working with a high degree of independence, implement novel solutions or appropriate mitigations as required by changing circumstance or requirement to ensure analysis remains … knowledge of VBA and SQL would also be preferable. - Competent user of specific Azure data related resources (or similar) including: Databricks and Storage Account (Data Lake). - The ability to plan and develop new and existing models or analytical tools with a logical approach to design and maintenance. - Advanced skills when using Microsoft Excel, with More ❯

trading platforms, and/or IBA systems). Architecting solutions with Microsoft Azure technologies, Sales force (including Force.com) technologies and modern data platforms (e.g. Data lake house architecture) and Business Intelligence (e.g. Microsoft Power BI) technologies Knowledge of Enterprise Architecture tools (experience in BizzDesign) Good knowledge and awareness of enterprise-grade CRM, HR and Finance More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

Pro currently has an exciting opportunity for a motivated and detail-oriented individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims) using data ingestion and analysis tools such as … Intrali, Quantemplate, or Matillion. The project focuses on the extraction, transformation, and loading (ETL) of data from various sources into data warehouses and data lakes. This is an ideal role for an aspiring Data Architect in the Insurance Industry. Pro operates a hybrid working policy, with time split between home and our … Gloucester or Liverpool office. This vacancy is also suitable for a fully remote individual, as we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing, and preparing datasets for analysis. Creation and management of both Risk and Claims data maps (models) and reconciliation of results. More ❯

Pro currently has an exciting opportunity for a motivated and detail-oriented individual to join its Insurance Services team as a Data Analyst within the Digital Services area. The job holder will be involved in building data mapping processes for various bordereaux (both Risk and Claims) using data ingestion and analysis tools such as … Intrali, Quantemplate, or Matillion. The project focuses on the extraction, transformation, and loading (ETL) of data from various sources into data warehouses and data lakes. This is an ideal role for an aspiring Data Architect in the Insurance Industry. Pro operates a hybrid working policy, with time split between home and our … Gloucester or Liverpool office. This vacancy is also suitable for a fully remote individual, as we support home working. Main Duties and Responsibilities Data collection and processing; gathering data from various sources, pre-processing, and preparing datasets for analysis. Creation and management of both Risk and Claims data maps (models) and reconciliation of results. More ❯