20 of 20 Data Lake Jobs in the North of England

risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience in Big Data and Data Lake environments , including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will … automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence Big Data & Data Lake Testing Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets Validate large-scale ...

Experience Essential Advanced experience of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake technologies Advanced knowledge of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake … query optimization, complex Stored procedures/views/functions) Knowledge of supporting & developing Microsoft Azure ETL pipeline solutions, triggers, connections/data lake, data bricks, power apps/automate. Experience of supervising/mentoring junior members of the team. Desirable Experience of NHS information ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

seeking an experienced Lead Cybersecurity Engineer to join a global Cybersecurity Science & Analytics team responsible for developing next-generation cybersecurity and data analytics capabilities. This is an excellent opportunity for a hands‐on engineer with expertise in Azure Cloud, Data Engineering, Platform Engineering and DevOps … following technologies: Cloud & Infrastructure Microsoft Azure Azure Active Directory (Azure AD) Azure Data Factory Azure Databricks Azure Data Lake Azure Storage Azure Functions Azure Monitor Azure Logic Apps Kubernetes Azure DevOps Programming & Automation Python PowerShell Bash Terraform SQL Kusto Query Language (KQL) GitHub CI/ ...

Senior Data Engineer Location: Newcastle upon Tyne (Hybrid) Salary: £60,000 per annum Contract: Fixed Term - 2 Years About the Role We are looking for an experienced Senior Data Engineer to lead the design, development and optimisation of modern data platforms and pipelines. This … exciting opportunity to shape how data is managed, integrated and utilised across a large and evolving organisation. Working closely with technical and business stakeholders, you will play a key role in developing scalable data solutions that enable high-quality reporting, analytics and data-driven ...

exciting opportunity has arisen for a Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst - SQL, Office-based, Salford, Manchester. Skillset: Must haves; SQL Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to join our team in the role of Senior Data Scientist, Data Platforms. The Financial Crime (FC) Data Platforms team’s role is to manage data products, processes … prioritisation of use cases based on risk, value and feasibility. Manage the inventory, capacity, development and security of the Compliance data lake Support Product Owners to ensure effective stakeholder engagement and user interaction at all levels leading to informed and well-judged trade-offs and priority decisions ...

Data moves fast, and the businesses that win are the ones whose data can keep up with their ambition. That is the problem this role exists to solve, and it is a genuinely interesting one.As our Senior Data Engineer at Protein Works, you will … help them generate impactful business insights and analysis Taking day-to-day responsibility for the quality, security and performance of our Data Lake and Warehouse Building and maintaining robust CI/CD processes for data pipelines using tools such as Cloud Build and GitHub, raising ...

client is looking to appoint a Business Systems & Data Manager to take ownership of the systems that underpin the group's operations and be a key part of moulding the data environment. Our client, the Ashcourt Group, is one of the fastest growing businesses … applications. There is also scope to develop the SQL estate, integrating the systems into it, with a view to implementing a data lake in time. The role will act as a bridge between IT and business users to help translate complex data concepts into actionable ...

looking for a passionate Junior Data Analyst. The successful candidate will have a keen eye for detail, a willingness to learn and an understanding of the link between data, insights, and business decisions. Thebestofnorthwest is a leading business marketing, networking, and community platform dedicated to helping … local businesses. Role Develop and implement databases, data collection systems and data engineering solutions that optimise reporting efficiency and clarity. Acquire data from primary or secondary data sources and maintain databases/data lakes. Interpret data, analyse results ...

Data Engineering Manager (hands on) - Manchester I'm working with a hypergrowth business in Manchester who are looking for a Data Engineering Manager. They have new PE investment behind them and a major transformation project is underway. This is a hands-on leadership role sitting … centre of a significant data platform transformation. You will be running the data engineering squad, responsible for delivering the data infrastructure, pipelines, and reporting capabilities the wider business depends on. They are moving away from traditional batch processing toward a real-time, event-driven ...

operating across more than 60 countries and territories. With millions of customers worldwide, the organisation is investing heavily in digital transformation, cloud technologies, data, AI, and cybersecurity to deliver secure, resilient, and innovative banking services on a global scale. Job Responsibilities/Objectives Design end-to-end technical … solutions for cybersecurity applications and large-scale data platforms. Produce and maintain architecture documentation including High-Level Designs (HLDs), Low-Level Designs (LLDs), Architecture Decision Records (ADRs), and reference architectures. Define reusable architecture patterns and technical standards across an open-source data platform. Evaluate emerging technologies ...

HSBC is seeking a Senior Data Scientist for Data Platforms in the UK. You will design and deploy data-driven solutions to enhance crime detection and regulatory compliance, working across FC data lakes and cloud environments. Lead data analysts, collaborate … with senior stakeholders, and ensure data quality and security while shaping the future of data platforms within Financial Crime. #J-18808-Ljbffr ...

knowledge of industrial automation with consultative sales to deliver end-to-end solutions from data acquisition to analytics and data lake architectures. You will engage with utility stakeholders, design architectures, and deliver workshops, ensuring cybersecurity and integration across device to enterprise systems. #J-18808-Ljbffr ...

designs and sign off on solutions Define acceptance criteria to confirm requirements are met Map how CNAPP integrates with other systems (e.g. reporting, data lakes) Experience & Technical Skills 5+ years as a Business/Technical Analyst in cybersecurity, security, or compliance platforms Hands-on knowledge of vulnerability scanning ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...

equally at home articulating a multi-year architecture roadmap to C-suite executives and diving deep into integration patterns, diverse platform configurations and data flows when the moment demands it. The individual must have 10-15 years of experience in life sciences manufacturing/industrial sector … commercial manufacturing. Key Responsibilities Architecture Strategy & Governance Define, own and evolve the enterprise architecture vision, strategy, and multi-year roadmaps spanning business, application, data, integration and process flow from Lab to Plant. Establish and enforce architectural principles, policies, guardrails, and reference architectures that enable solution architects and product ...