15 of 15 Data Lake Jobs in the North of England

risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience in Big Data and Data Lake environments , including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will … automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence Big Data & Data Lake Testing Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets Validate large-scale ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

Principal Data Engineer Lead the design and delivery of a modern cloud-based data platform, driving engineering standards, architecture, and innovation across a growing data function. The Opportunity This is a senior technical leadership role responsible for shaping data engineering strategy, architecture … best practices across multiple product domains. Working within a modern cloud environment and Data Mesh architecture, you will drive the development of scalable, secure, and high-performing data solutions while mentoring engineers and influencing technical direction. Key Responsibilities Provide technical leadership across data engineering ...

Data Engineer Location: Newcastle upon Tyne Salary: Up to £80,000 The Opportunity We are seeking a Data Engineer to join a growing data team responsible for developing and maintaining a modern cloud-based data platform. This role offers the opportunity … work on large-scale data challenges, build robust data solutions and contribute to the continued evolution of the organisation's data capabilities. The successful candidate will play a key role in designing, developing and optimising data pipelines that support reporting, analytics ...

Title: Data Engineer Location: Sunderland, UK (Hybrid: Up to 2 days per week in the office) Experience Required: 7-9 years Salary: Competitive Work Eligibility: Please note that we cannot offer visa sponsorship for this role. About the Role We are seeking talented and motivated Data … Data Engineer or in a similar role, with expertise in Azure cloud services. Experience with Azure services like Azure Data Lake and Azure Databricks. Proficiency in designing and managing ETL processes using Notebooks. Experience with Power BI for semantic model creation and report development. Familiarity ...

Data moves fast, and the businesses that win are the ones whose data can keep up with their ambition. That is the problem this role exists to solve, and it is a genuinely interesting one. As our Senior Data Engineer at Protein Works … help them generate impactful business insights and analysis Taking day-to-day responsibility for the quality, security and performance of our Data Lake and Warehouse Building and maintaining robust CI/CD processes for data pipelines using tools such as Cloud Build and GitHub, raising ...

looking for a passionate Junior Data Analyst. The successful candidate will have a keen eye for detail, a willingness to learn and an understanding of the link between data, insights, and business decisions. Thebestofnorthwest is a leading business marketing, networking, and community platform dedicated to helping … local businesses. Role Junior Data Analyst Job Duties Junior Data Analyst responsibilities involve taking part in full lifecycle analysis to include requirements, activities and design. Junior Data Analysts will develop data analytics and reporting solutions. They will also monitor performance and quality ...

Senior Data Engineer – eDV Cleared Locations: Manchester, Gloucester or London (Full-Time, Permanent, Onsite) We are partnering with a leading defence and technology organisation to recruit an experienced Senior Data Engineer to join their highly specialised engineering teams across Manchester, Gloucester or London. This … Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch, S3 and Data Lake architectures. Containerisation and orchestration experience using Docker, Kubernetes and/or OpenShift. Knowledge of testing frameworks, engineering standards and software development best practices. Experience ...

client is looking to appoint a Business Systems & Data Manager to take ownership of the systems that underpin the group's operations and be a key part of moulding the data environment. Our client, the Ashcourt Group, is one of the fastest growing businesses … applications. There is also scope to develop the SQL estate, integrating the systems into it, with a view to implementing a data lake in time. The role will act as a bridge between IT and business users to help translate complex data concepts into actionable ...

Role Summary We are seeking a seasoned Voice AI Lead Architect with strong Data Architecture expertise to lead the design and implementation of next-generation Voice/Agentic AI solutions for a leading banking client on GCP . This role combines conversational AI, data strategy … customer engagement , acting as a trusted advisor to drive intelligent, data-driven IVR transformation . Key Responsibilities Act as the onsite Voice AI and Data Architecture lead , building strong relationships with banking stakeholders across business, data, and IT teams. Design and deliver Voice ...

looking for an Analytics Engineer to join our client's high-performing Business Intelligence team, helping to build scalable, high-quality data solutions that power reporting, dashboards and self-service analytics across the business. Working closely with BI Developers and business stakeholders, you'll design and optimise …/ELT pipelines, develop curated data models, and translate business requirements into reliable backend data solutions. This is a fantastic opportunity for someone who enjoys solving complex data challenges and wants to work with modern cloud technologies in a collaborative, forward-thinking environment. What ...

lead the design and implementation of our clients Adobe Martech ecosystem, with a focus on Adobe Experience Platform (AEP), Real-Time Customer Data Platform (RTCDP), and Adobe Journey Optimizer (AJO). The role will be responsible for defining scalable architecture, enabling real-time customer data capabilities … ensuring alignment with enterprise standards. Lead end-to-end solution architecture for Adobe Martech platforms (AEP, RTCDP, AJO). Define data architecture, ingestion patterns, and activation frameworks across channels. Translate business requirements into scalable architecture, data models, and integration designs. Design and govern identity management, segmentation ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...