12 of 12 Permanent Data Lake Jobs in the North of England

risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience in Big Data and Data Lake environments , including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will … automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence Big Data & Data Lake Testing Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets Validate large-scale ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

Principal Data Engineer Lead the design and delivery of a modern cloud-based data platform, driving engineering standards, architecture, and innovation across a growing data function. The Opportunity This is a senior technical leadership role responsible for shaping data engineering strategy, architecture … best practices across multiple product domains. Working within a modern cloud environment and Data Mesh architecture, you will drive the development of scalable, secure, and high-performing data solutions while mentoring engineers and influencing technical direction. Key Responsibilities Provide technical leadership across data engineering ...

Data Engineer Location: Newcastle upon Tyne Salary: Up to £80,000 The Opportunity We are seeking a Data Engineer to join a growing data team responsible for developing and maintaining a modern cloud-based data platform. This role offers the opportunity … work on large-scale data challenges, build robust data solutions and contribute to the continued evolution of the organisation's data capabilities. The successful candidate will play a key role in designing, developing and optimising data pipelines that support reporting, analytics ...

Title: Data Engineer Location: Sunderland, UK (Hybrid: Up to 2 days per week in the office) Experience Required: 7-9 years Salary: Competitive Work Eligibility: Please note that we cannot offer visa sponsorship for this role. About the Role We are seeking talented and motivated Data … Data Engineer or in a similar role, with expertise in Azure cloud services. Experience with Azure services like Azure Data Lake and Azure Databricks. Proficiency in designing and managing ETL processes using Notebooks. Experience with Power BI for semantic model creation and report development. Familiarity ...

Data moves fast, and the businesses that win are the ones whose data can keep up with their ambition. That is the problem this role exists to solve, and it is a genuinely interesting one. As our Senior Data Engineer at Protein Works … help them generate impactful business insights and analysis Taking day-to-day responsibility for the quality, security and performance of our Data Lake and Warehouse Building and maintaining robust CI/CD processes for data pipelines using tools such as Cloud Build and GitHub, raising ...

Senior Data Engineer – eDV Cleared Locations: Manchester, Gloucester or London (Full-Time, Permanent, Onsite) We are partnering with a leading defence and technology organisation to recruit an experienced Senior Data Engineer to join their highly specialised engineering teams across Manchester, Gloucester or London. This … Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch, S3 and Data Lake architectures. Containerisation and orchestration experience using Docker, Kubernetes and/or OpenShift. Knowledge of testing frameworks, engineering standards and software development best practices. Experience ...

client is looking to appoint a Business Systems & Data Manager to take ownership of the systems that underpin the group's operations and be a key part of moulding the data environment. Our client, the Ashcourt Group, is one of the fastest growing businesses … applications. There is also scope to develop the SQL estate, integrating the systems into it, with a view to implementing a data lake in time. The role will act as a bridge between IT and business users to help translate complex data concepts into actionable ...

looking for an Analytics Engineer to join our client's high-performing Business Intelligence team, helping to build scalable, high-quality data solutions that power reporting, dashboards and self-service analytics across the business. Working closely with BI Developers and business stakeholders, you'll design and optimise …/ELT pipelines, develop curated data models, and translate business requirements into reliable backend data solutions. This is a fantastic opportunity for someone who enjoys solving complex data challenges and wants to work with modern cloud technologies in a collaborative, forward-thinking environment. What ...

Bolton Join our Data Fabric Services team in our Information Systems department as a Senior Data Engineer working across all directorates: Engineering, Simulation, Test, Production, Quality, Supply Chain, MRO, and Corporate Functions. Salary : Circa £55,000 depending on experience Dynamic (hybrid) working : 2 days per week … Facilities : Fantastic site facilities including subsidised meals, free car parking and much more... The opportunity In this role you will design enterprise-wide data and BI solutions brought together from varied sources - business data, simulators, missile test systems, shop-floor machines - and then turning them into ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...

BIDs, accounting for up to 5% to 10% of the role. Engage with the commercial team to drive high‐value Cloud and Data advisory roles. Ambassadorial Presence: Act as an ambassador for CreateFuture in the public space, attending events, speaking, blogging, or leveraging social media to support … solo contributor. AI‐Native Infrastructure: Architect and implement the core engineering infrastructure required to run AI workloads reliably, moving client architectures from static data lakes to dynamic Vector Databases and Retrieval‐Augmented Generation (RAG) architectures. Agentic Development: Build production‐grade Agentic Workflows and custom AI agents, utilising advanced ...