1 to 25 of 40 Permanent Data Lake Jobs in the North of England

Will Bring Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and cloud tools. Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leveraging ...

risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience in Big Data and Data Lake environments , including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will … automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence Big Data & Data Lake Testing Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets Validate large-scale ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data. Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery. Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices. Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

IaaS, specifically: App Services, Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake & Fabric. Understand which Azure data focused components to use for which purpose. Microsoft certified architect Databricks Design and build high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Ability to Design, Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ...

wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data … with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing ...

wider technology and business teams to ensure goals and visions are aligned and achieved Help with setting up the data warehousing and lake processes, including collaborating with their architecture teams to figure out what that will look like At times, guide and mentor the junior data … with setting up and using big data storage solutions, including data warehouses, data lakes or data lake houses Able to build and demonstrate a solid understanding of the concepts of real time data streaming, batch data processing ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … vault, etc.) Data architecture frameworks and methodologies Data governance and data management Experience with Data Lake, Lakehouse, and Data Mesh architectures Strong knowledge of SQL and modern data platforms , including NoSQL and distributed systems Experience designing ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … strong understanding of data warehousing, dimensional modelling, and lakehouse concepts. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage/ADLS Gen2, Microsoft Fabric (OneLake, Workspaces, Capacity), Azure Synapse and/or SQL, and Azure Data Factory. Excellent problem-solving ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

Principal Data Engineer Lead the design and delivery of a modern cloud-based data platform, driving engineering standards, architecture, and innovation across a growing data function. The Opportunity This is a senior technical leadership role responsible for shaping data engineering strategy, architecture … best practices across multiple product domains. Working within a modern cloud environment and Data Mesh architecture, you will drive the development of scalable, secure, and high-performing data solutions while mentoring engineers and influencing technical direction. Key Responsibilities Provide technical leadership across data engineering ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

decide faster, and act with confidence across complex domains. We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. We operate as small teams delivering fast value, blending deep ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, the Principal … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

Description My client is a fast-growing e-commerce business, rapidly expanding. \n \n The role: \n Data Analyst - SQL, Office-based, Salford, Manchester. \n \n Skillset: \n \n Must haves; \n \n \n SQL \n Power BI report development (including DAX, Power Query, Parameters) \n Semantic model … similar systems are equally valued. \n\n \n Desirable; \n \n Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence \n Power BI calculation groups, bookmarks, semantic model incremental refresh \n Tabular Editor ...

Data Engineer Location: Newcastle upon Tyne Salary: Up to £80,000 The Opportunity We are seeking a Data Engineer to join a growing data team responsible for developing and maintaining a modern cloud-based data platform. This role offers the opportunity … work on large-scale data challenges, build robust data solutions and contribute to the continued evolution of the organisation's data capabilities. The successful candidate will play a key role in designing, developing and optimising data pipelines that support reporting, analytics ...

About Provectus At Provectus, we architect enterprise-grade AI and data solutions that transform how organizations leverage their most valuable asset – data. We combine deep technical expertise with strategic product thinking to deliver scalable, production-ready AI systems and modern data platforms. Who We're Looking … including model versioning, monitoring, performance tracking, and continuous improvement loops. Manage Complex Data Platform Initiatives: Lead product planning for data lake/lakehouse implementations, warehouse modernizations, and cloud data platform migrations. Define data product requirements including ingestion pipelines, transformation logic, data ...

About Provectus At Provectus, we architect enterprise-grade AI and data solutions that transform how organizations leverage their most valuable asset data. We combine deep technical expertise with strategic product thinking to deliver scalable, production-ready AI systems and modern data platforms. Who We're Looking … including model versioning, monitoring, performance tracking, and continuous improvement loops. Manage Complex Data Platform Initiatives: Lead product planning for data lake/lakehouse implementations, warehouse modernizations, and cloud data platform migrations. Define data product requirements including ingestion pipelines, transformation logic, data ...

About Provectus At Provectus, we architect enterprise-grade AI and data solutions that transform how organizations leverage their most valuable asset data. We combine deep technical expertise with strategic product thinking to deliver scalable, production-ready AI systems and modern data platforms. Who We're Looking … including model versioning, monitoring, performance tracking, and continuous improvement loops. Manage Complex Data Platform Initiatives: Lead product planning for data lake/lakehouse implementations, warehouse modernizations, and cloud data platform migrations. Define data product requirements including ingestion pipelines, transformation logic, data ...

Title: Data Engineer Location: Sunderland, UK (Hybrid: Up to 2 days per week in the office) Experience Required: 7-9 years Salary: Competitive Work Eligibility: Please note that we cannot offer visa sponsorship for this role. About the Role We are seeking talented and motivated Data … Data Engineer or in a similar role, with expertise in Azure cloud services. Experience with Azure services like Azure Data Lake and Azure Databricks. Proficiency in designing and managing ETL processes using Notebooks. Experience with Power BI for semantic model creation and report development. Familiarity ...

Data moves fast, and the businesses that win are the ones whose data can keep up with their ambition. That is the problem this role exists to solve, and it is a genuinely interesting one. As our Senior Data Engineer at Protein Works … help them generate impactful business insights and analysis Taking day-to-day responsibility for the quality, security and performance of our Data Lake and Warehouse Building and maintaining robust CI/CD processes for data pipelines using tools such as Cloud Build and GitHub, raising ...

hiring a Senior Data Engineer to help shape the future of data-driven transformation for our clients. At TEKenable, a multi-award-winning Microsoft partner and one of Deloitte s Fastest 50, you ll work with cutting-edge technologies like Microsoft Azure Synapse, Microsoft Fabric … Power BI. In this customer-facing role, you ll collaborate directly with clients to solve complex data challenges, delivering scalable solutions that drive real business value. This role is open to applicants across Ireland and the UK but we are unable to provide visa sponsorship. ...

hiring a Senior Data Engineer to help shape the future of data-driven transformation for our clients. At TEKenable, a multi-award-winning Microsoft partner and one of Deloitte s Fastest 50, you ll work with cutting-edge technologies like Microsoft Azure Synapse, Microsoft Fabric … Power BI. In this customer-facing role, you ll collaborate directly with clients to solve complex data challenges, delivering scalable solutions that drive real business value. This role is open to applicants across Ireland and the UK but we are unable to provide visa sponsorship. ...

Senior Data Engineer – eDV Cleared Locations: Manchester, Gloucester or London (Full-Time, Permanent, Onsite) We are partnering with a leading defence and technology organisation to recruit an experienced Senior Data Engineer to join their highly specialised engineering teams across Manchester, Gloucester or London. This … Strong understanding of SQL and NoSQL databases. Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch, S3 and Data Lake architectures. Containerisation and orchestration experience using Docker, Kubernetes and/or OpenShift. Knowledge of testing frameworks, engineering standards and software development best practices. Experience ...

client is looking to appoint a Business Systems & Data Manager to take ownership of the systems that underpin the group's operations and be a key part of moulding the data environment. Our client, the Ashcourt Group, is one of the fastest growing businesses … applications. There is also scope to develop the SQL estate, integrating the systems into it, with a view to implementing a data lake in time. The role will act as a bridge between IT and business users to help translate complex data concepts into actionable ...