76 to 100 of 104 Data Lake Jobs in the UK excluding London

SNG's ambitious Corporate Plan identifies the important role that data, digital and technology plays in our future success. SNG's CIO function will enable us to leverage the investments we have already made and embrace new technology frontiers to create a modern, digitally connected business; one that delivers maximum impact and value for our customers and people. … Collaborating with Data and Analytics colleagues to maximise SNG's investment in the Microsoft product stack, in particular Azure Data Factory and Data Lake Maintaining Integration code repositories within Azure DevOps Troubleshooting integration issues, using the required tooling, and debugging processes to diagnose and resolve. What you'll need You should have previous … and maintaining Integration services. You'll also need: Experience with Workday integration tooling (Studio, EIB, API) Proven experience working with large, complex datasets, covering structured, unstructured, semi structured data Clear communication skills with the ability to build strong relationships with stakeholders at all levels Desirable Experience with Cloud-based integration services (Data Factory, Functions, Logic Apps More ❯

or Leadership role Strong knowledge of SQL Server, SSIS, SSAS, ETL pipelines Experience would be highly useful with PowerBI, Azure services (Data Factory, Synapse, Data Lake), CI/CD, and DevOps Strong communication skills with the ability to bridge technical and business discussions. Collaborative mindset with experience driving results in dynamic environments. Knowledge of Front More ❯

multi-account Organization. This should include: • Networking and DNS components, Compute, Storage and Backup platforms, Logging, Messaging, and Alerting services, Organisational account management platforms, Serverless platforms, Data Lake/Lake House platforms, services & architecture, IAM roles and policies, Security and audit tools and practices • Experience with implementing complex Terraform IaC and multi-branch CI/CD More ❯

This is an exciting opportunity for a Senior Data Engineer to contribute to impactful projects within the Business Services industry. Based in Manchester, this role focuses on designing, building, and optimising data pipelines and systems to support analytics and decision-making. Client Details We are a client acquisition agency with a focus on the legal sector … transparency, integrity, and a clear, results-oriented approach. We take pride in delivering carefully profiled leads that align with your specific requirements. We are looking for a Senior Data Engineer to support us as we continue to build and develop or data ecosystem. This role requires someone who is comfortable wearing many hats, from building out … pipelines, to supporting architectural decision making, to project and stakeholder management. In return the successful candidate will play a key role in helping us deliver our data strategy and take on more responsibility as the business continues to grow. Description The successful Senior Data Engineer will be responsible for, but not limited to: Design and maintain More ❯

join our software group and help build the next generation AI-driven scientific platform. In this role, you will design, build, and optimize backend systems that power intelligent, data-driven applications. You will focus on creating high-performance APIs, architecting scalable data management tooling, and ensuring the reliability of services that integrate advanced AI frameworks with … You'll work closely with ML researchers, platform engineers, and scientists to develop systems that can handle diverse workloads and scale seamlessly, including structured SQL database, data lake houses, and vector databases. This is an opportunity to apply your deep backend expertise to a cutting-edge AI platform with real scientific impact. If you are passionate about … Building Design & Build APIs: Design and build high-performance, secure, and well-documented APIs that integrate with AI-driven applications. Database Architecture & Scaling: Architect schemas and manage diverse data systems (SQL, NoSQL, Vector DBs, and others) for optimal performance and scalability. Backend Systems Development: Drive the implementation of backend services, focusing on performance, maintainability, and reliability. Performance & Reliability More ❯

Enterprise/Business Architect (Data-Focused) - Inside IR35 - West Midlands (1 Day/Week Onsite) Contract Role | Excellent Rates | Strategic & Hands-On | Immediate Start We're looking for a seasoned Enterprise/Business Architect with a strong background in data-rich environments and a proven ability to blend strategic thinking with hands-on delivery . This … is not a traditional BA role - it's architectural, impactful, and delivery-focused. What You'll Bring: Proven experience in enterprise/business architecture , ideally within data-heavy organisations Strong understanding of data design, governance, and quality Solid grasp of the end-to-end project lifecycle - from idea to execution Technically literate and comfortable rolling … up your sleeves to deliver , not just advise Experience supporting RFPs , building scoring models , and evaluating data tools Exposure to Microsoft Azure (e.g., Synapse, Data Lake, Purview) and Microsoft D365 is beneficial but not essential You won't be building databases or designing org charts. Instead, you'll focus on strategic architecture with real influence More ❯

days on-site) £40,000 £50,000 + benefits Were partnered with a fast-growing technology business that is undergoing a major transformation programme to modernise its data and analytics capabilities. Theyre looking for a Business Intelligence Developer who can play a key role in shaping the way data is used across the organisation. This is … an opportunity to get involved in a large-scale, complex data environment and make a tangible impact on how insights drive decision-making at a global level. What youll be doing Designing and developing Power BI dashboards and reports that provide meaningful insight and data storytelling for senior stakeholders. Working with large, complex datasets from multiple … sources, ensuring they are queried, modelled, and optimised for reporting. Collaborating with engineers and analysts to develop data pipelines and models that feed enterprise-level reporting solutions. Supporting the ongoing transformation programme , helping to break down legacy reporting structures and introduce modern BI practices. Partnering closely with commercial, finance, and operational teams to ensure reporting is aligned with More ❯

a large, well-known organisation who are a reputable force within their industry. Your new role You will be responsible for the delivery, integration, and operation of IT data services aligned with business strategy, compliance standards, and technical architecture. Partner with business stakeholders to deliver IT services aligned with strategic goals. Lead planning and integration of data solutions and application environments. Ensure operational excellence using ITIL and ISO27001 standards. Collaborate globally to define data and architecture standards. Manage vendor performance and service levels. Champion data governance and compliance across the UK organisation. Oversee budgets, resource planning, and delivery timelines. Lead and develop a high-performing IT data management team. … Identify and mitigate risks to ensure compliance with group policies. What you'll need to succeed Experience in IT consulting and service delivery. Strong knowledge of data engineering, Azure Data Factory & Data Lake. Experience with Agile and automation technologies. Proven leadership in managing teams and third-party vendors. Excellent communication, strategic thinking, and problem More ❯

a large, well-known organisation who are a reputable force within their industry. Your new role You will be responsible for the delivery, integration, and operation of IT data services aligned with business strategy, compliance standards, and technical architecture. Partner with business stakeholders to deliver IT services aligned with strategic goals. Lead planning and integration of data solutions and application environments. Ensure operational excellence using ITIL and ISO27001 standards. Collaborate globally to define data and architecture standards. Manage vendor performance and service levels. Champion data governance and compliance across the UK organisation. Oversee budgets, resource planning, and delivery timelines. Lead and develop a high-performing IT data management team. … Identify and mitigate risks to ensure compliance with group policies. What you'll need to succeed Experience in IT consulting and service delivery. Strong knowledge of data engineering, Azure Data Factory & Data Lake. Experience with Agile and automation technologies. Proven leadership in managing teams and third-party vendors. Excellent communication, strategic thinking, and problem More ❯

Insight Analyst - UK Remote - Charity - £35,764 We're seeking an Insight Analyst to join a dynamic data and insight team within a leading UK charity. This role goes beyond traditional data analysis: you'll work with large-scale databases, building and maintaining tables and views, ensuring data integrity, and uncovering insights that drive … strategic decisions. You'll collaborate with the architecture team to understand data flows and help shape reporting and analytics processes. This is a technically-focused role, with a strong emphasis on SQL and Power BI. You'll investigate the source of data faults, develop solutions to complex problems, and help the team make sense of large … change. Key Skills & Experience: Strong SQL expertise and experience working with large, complex datasets. Proficiency in Power BI (or similar BI tools such as Tableau) and understanding of data visualisation principles. Experience in data warehousing, data lakes, or Microsoft Stack environments; Azure Synapse knowledge is a plus. Ability to translate business requirements into technical More ❯

on a number of exciting transformation initiatives. The successful candidate will work across a variety of projects, including ERP upgrades, implementation of a new middle-office management system, data projects, and finance/operations enhancements. You will play a key role in capturing requirements, shaping solutions, and ensuring successful delivery alongside colleagues, technical teams, and stakeholders. Key Responsibilities … and operations teams to design and improve workflows, including authorisation and approval processes. Support data-focused initiatives, including the expansion of the organisation s data lake and enabling automatic customer report generation. Collaborate with development teams to ensure requirements are translated into effective solutions. Produce clear and concise documentation, including requirement specifications, user stories, and … business and technical teams. Support User Acceptance Testing (UAT), ensuring solutions meet business needs. Contribute to change management activities to help embed new systems, processes, and tools. Provide data analysis and reporting to support informed decision-making. Key Skills & Experience: Proven experience as a Business Analyst within complex, multi-stakeholder environments. Strong understanding of the project lifecycle and More ❯

on a number of exciting transformation initiatives. The successful candidate will work across a variety of projects, including ERP upgrades, implementation of a new middle-office management system, data projects, and finance/operations enhancements. You will play a key role in capturing requirements, shaping solutions, and ensuring successful delivery alongside colleagues, technical teams, and stakeholders. Key Responsibilities … and operations teams to design and improve workflows, including authorisation and approval processes. Support data-focused initiatives, including the expansion of the organisation’s data lake and enabling automatic customer report generation. Collaborate with development teams to ensure requirements are translated into effective solutions. Produce clear and concise documentation, including requirement specifications, user stories, and … business and technical teams. Support User Acceptance Testing (UAT), ensuring solutions meet business needs. Contribute to change management activities to help embed new systems, processes, and tools. Provide data analysis and reporting to support informed decision-making. Key Skills & Experience: Proven experience as a Business Analyst within complex, multi-stakeholder environments. Strong understanding of the project lifecycle and More ❯

NoSQL database modelsExperience with CI/CD, Git, and configuration management tools Nice-to-haves include cloud/database certifications, experience in security & compliance audits , and exposure to data lakes or real-time analytics . What’s in it for you Salary in the region of £40,000 – £50,000 The chance to join a growing technology business More ❯

and identity management. Experience with Copilot Studio and building custom Copilot agents or plugins. Familiarity with REST APIs, JSON, OAuth, and integration with enterprise systems (e.g., CRM, ERP, data lakes). Knowledge of prompt engineering, grounding techniques, and responsible AI principles. Excellent communication and stakeholder engagement skills, with the ability to convey complex technical concepts to non-technical More ❯

Data Management and Business Intelligence Lead - Remote working - IT Enterprise Platform and Business Intelligence Lead Strong experience of within the fields of Data Management, Application Estates and Business Intelligence platforms required for a role that will develop into a Senior Management Position. The focus will be on driving clarity, alignment, and performance across these domains. You … is not the primary expectation, your ability to understand technical landscapes and translate business needs into actionable direction will be critical to success. Required Skills: - Strong understanding of data management principles, including governance, quality, security, and life cycle. Solid grasp of enterprise applications and how they support operational and strategic business functions. Familiarity with Business Intelligence (BI) tools … and reporting platforms (eg, Power BI) Understanding of IT service delivery models, especially in outsourced or hybrid environments. Knowledge of data integration and interoperability between systems (eg, APIs, Middleware, data lakes/warehouses). Desirable Awareness of cloud-based platforms (eg, Azure) and their implications for data and application strategy. Familiarity with data More ❯

Data Analyst (Power BI, Azure) - Near Edinburgh Hybrid Having placed a number of people into their teams ourselves, Lorien's long standing client based near Edinburgh - a leader in their industry with a growing and consistently award-winning product line - have asked us to help them in their searches for a Data Analyst to join their … truly a rewarding opportunity, and everyone in the team feels part of that journey. Here's a snapshot of the duties involved: Developing/maintaining metrics & reporting, analysing data and relaying relevant information collected Modernising the business' reporting processes and implementing automation to reduce manual reliance wherever possible while monitoring, auditing and improving data quality Offering … in the queue, craft relevant solutions and train them on how to use them Collaborate with the wider IT function to ensure reports are in line with necessary data infrastructure in place from Databases to Data Lakes/Factory/and more The kind of skills they're looking for: Strong Power BI skills with the More ❯

public sector standards.Experience in Xsiam correlation/playbooks.Excellent communication skills, able to articulate technical concepts to diverse audiences. Technical requirements Proven experience with Cortex XDR, Cortex Data Lake, and Cortex XSOAR.Solid understanding of cloud security, network/system security fundamentals, and scripting for automation. Desirable Qualifications Familiarity with compliance and security standards (GDPR, HIPAA, NIST).Familiarity with More ❯

public sector standards. Experience in Xsiam correlation/playbooks. Excellent communication skills, able to articulate technical concepts to diverse audiences. Proven experience with Cortex XDR, Cortex Data Lake, and Cortex XSOAR . Solid understanding of cloud security , network/system security fundamentals, and scripting for automation. Desirable: Familiarity with compliance and security standards (GDPR, HIPAA, NIST). More ❯

bases (10,000+ users). Create/manage security playbooks and knowledge of public sector standards. Experience in Xsiam correlation/playbooks and Cortex XDR, Cortex Data Lake, and Cortex XSOAR. Strong cloud security, network/system security fundamentals, and scripting for automation. Familiar with NIST SC Clearance - Candidates holding active SC will benefit of a quick More ❯

ll join the Platform & AI Enablement team within our GPTO Engineering organization, reporting to the Sr. Director Engineering API. The team is responsible for building and supporting the data and AI platforms that underpin our industry-leading Business Planning Software solutions. This is a highly hands-on role focused on designing, building, and operating scalable systems that integrate … event-driven, batch & streaming data flows, and AI capabilities into the platform. Your Impact Build and maintain core platform capabilities that support high-throughput batch, streaming, and AI-powered workloads. Develop resilient, observable, and scalable systems using Apache Kafka, Flink, Pulsar, and cloud-native tools. Collaborate with AI/ML engineers to operationalize models and enable generative AI … use cases such as prompt-based insights or automation. Deliver reliable integrations with data lakes, event stores, and analytics systems, ensuring data flows efficiently across the business planning ecosystem. Contribute full-stack code where needed, including React-based frontends and backend services in Java and Python. Write clean, maintainable, well-tested code with an emphasis on More ❯

Copilot Studio and Azure OpenAI. Ensure interoperability across the broader Microsoft ecosystem, including Power BI, Power Automate, and Security Copilot. Define and enforce governance standards for Copilot usage, data access, and prompt management. Work closely with security and compliance teams to ensure adherence to organisational and regulatory requirements. Monitor and manage permissions, data boundaries, and responsible … identity management. Experience with Copilot Studio and building custom Copilot agents or plugins. Familiarity with REST APIs, JSON, OAuth, and integration patterns with enterprise systems (e.g., CRM, ERP, data lakes). Understanding of prompt engineering, grounding techniques, and responsible AI principles. More ❯

We're working with a hi-tech simulation/data-analytics company which services the defence and security market. They are looking to expand their in-house software engineering capability with the addition of a Full Stack Software Developer. This mid-level role that would suite developers with ideally 3-6 years' experience, please still apply if your … performance Supporting ongoing system integration, testing, and documentation What We're Looking For: Strong back-end development experience (ideally in Python), particularly working with both structured and unstructured data (e.g. SQL, NoSQL, data lakes). Proficient in modern front-end technologies (HTML/CSS, JavaScript, React or similar). Experience working collaboratively as part of a More ❯

Weareisseekinganexperienced DataArchitect topartnerwithleadingfinancialservicesclientsindeliveringinnovative,scalable,andsecuredatasolutions. Whatyoulldo: Collaboratewithclientstoassessdataneeds,designarchitectures,anddeveloproadmapsalignedtobusinessanddatastrategies. Translatebusinessrequirementsintorobust,compliant,andfuture-prooftechnicalsolutions. Designandimplementdatawarehousingsolutions,datalakes,andETLprocesses. Ensurealignmentofdataarchitecturewithorganisationalgoalsandregulatorystandards. Keepaheadofemergingtechnologiesandbestpracticesindataarchitecture,analytics,andcloudplatforms. Essential: Strongunderstandingofthefinancialservicesindustry. Extensiveknowledgeofscalable,efficient,andsecuredataarchitecture. Experiencewithdatawarehousing,datalakes,ETLprocesses. Proficiencyinlogicalandphysicaldatamodelling. Knowledgeofcloudplatforms(AWS,Azure,GoogleCloud,Snowflake). Excellentcommunicationandstakeholdermanagementskills. ProactiveapproachtoemergingtechnologiesandMicrosofttechstack. More ❯

Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high … control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies. Work with stakeholders, including … design, product, and executive teams, to address platform-related technical issues. Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.? All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to More ❯

Skills/requirements Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments. Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services. Establish best practices for cloud security, scalability, and performance. Manage and configure vendor product deployments, ensuring the setup and maintenance of environments. Ensure high … control. Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements. Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes. Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies. Work with stakeholders, including … design, product, and executive teams, to address platform-related technical issues. Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.? All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to More ❯