1 to 25 of 28 Data Lake Jobs in the North of England

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations and streaming technologies (event hub). Version control (Git), Agile Delivery, and DevOps ...

continue to expand throughout the UK. Main duties of the job The role holder will be accountable for designing, building, and maintaining the data infrastructure and pipelines that enable efficient and accurate data collection, storage, processing, and analysis. The role holder will collaborate with cross-functional … teams, including analysts, software engineers and key stake holders to create and maintain data solutions that are crucial in delivering high quality care for our patients. About us We are always looking for great talent to join our team and help achieve our ambitious goals and growth. ...

continue to expand throughout the UK Main duties of the job The role holder will be accountable for designing, building, and maintaining the data infrastructure and pipelines that enable efficient and accurate data collection, storage, processing, and analysis. The role holder will collaborate with cross-functional … teams, including analysts, software engineers and key stake holders to create and maintain data solutions that are crucial in delivering high quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide better access to exceptional, timely ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services including Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure SQL, and Event Hub. * Implement data quality validation, monitoring, metadata management, and governance … Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data ...

summary Working within the Data Engineering team which delivers and maintains data transfer pipelines between clinical/operational source systems and the Christie Central Data Repository (CCDR) enabling the delivery of high-quality business and complex clinical reporting structures from disparate systems. … seeking an experienced Data Architect with a strong background in data modelling and extensive experience of modern mainstream data platforms. This role will support the Data Engineering modernisation programme focused on automating data integration and building robust data ...

Role: Principal Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Role: Principal Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Role: Lead Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer.The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … Requirements You will have strong experience in data engineering, with a particular focus on data warehousing and data lake technologies. Additionally you will have a track record of establishing data governance best practises, including data security, data ...

Databricks Data Engineer - Manchester £100,000 | 2 days in office My client, a leading technology consultancy, is seeking an experienced Databricks Data Engineer to join their team on a high-profile engagement with a major insurance client. This is a hands-on technical role focused … engineering, ideally in enterprise-scale environments Deep expertise in Azure Databricks, Azure Data Factory, Azure Synapse, and Azure Data Lake Hands-on experience with Spark (PySpark/SparkSQL) and distributed data processing Strong data modelling skills (Dimensional, ODS, Data ...

pipelines using Databricks on Azure. Build and optimize data solutions leveraging Azure Data Services (e.g., Data Lake, Synapse). Work with large datasets to enable advanced analytics and reporting. Collaborate with stakeholders to deliver high-quality data solutions aligned … standards. Essential Skills Proven experience in Data Engineering within complex environments. Strong hands-on expertise with Databricks and Azure (Data Lake, Synapse, etc.). Solid understanding of cloud-based data platforms and ETL processes. Active SC Clearance (must be in place before starting ...

pipelines using Databricks on Azure. Build and optimize data solutions leveraging Azure Data Services (e.g., Data Lake, Synapse). Work with large datasets to enable advanced analytics and reporting. Collaborate with stakeholders to deliver high-quality data solutions aligned … standards. Essential Skills Proven experience in Data Engineering within complex environments. Strong hands-on expertise with Databricks and Azure (Data Lake, Synapse, etc.). Solid understanding of cloud-based data platforms and ETL processes. Active SC Clearance (must be in place before starting ...

looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects … experience with data engineering coding languages such as Python, R, or Spark. Understanding of data warehouse and data lake principles. Experience with data visualisation tools such as PowerBI or Tableau. Leadership or mentoring experience within a technical team. Agile and/ ...

work closely with internal teams to design, build, and optimise data models and ingestion pipelines, contributing to a new data lake and a robust gold-layer architecture. You'll also have the chance to shape ML-ready pipelines and mentor more junior data engineers. What you'll be doing Building scalable data models and ingestion pipelines for a new data lake Working across multiple data domains and supporting internal partners Designing and delivering high-quality datasets for BI, insights, and analytics use cases Collaborating ...

Senior Data Solutions Architect - Consultancy I’m partnered with a leading consultancy that’s delivering cutting-edge data and technology solutions for their clients. They’re looking for a Senior Data Solutions Architect to join their high performing team in Manchester or London … role, with 1–2 days per week in the office or client site. You’ll lead projects involving Single Customer Views (SCVs), Customer Data Platforms (CDPs), Data Lakes, and data models to support application development and drive client's marketing and sales capabilities. ...

Head of Data – Hull - £110-130,000 + Benefits Exciting opportunity for a Head of Data to join a globally recognised Supply Chain Logistics company in this new, foundational leadership role, designed to build the organisation’s data discipline from the ground up. This … architecture and platform design principles Hands-on experience with some or all of SAP Datasphere, SAP Analytics Cloud, Databricks, Snowflake, Azure Data Lake, Azure Integration Services, and Microsoft Purview Experience in establishing and operating data stewardship and data ownership models Excellent stakeholder management ...

Location: Sheffield (Remote) - Only go into the office if you need to Salary: £55,000 to £65,000 + Competitive Benefits Data Lake | Data Warehouse | Microsoft Fabric Are you ready to step into a BI Lead position where your work directly impacts communities across … with household names like Sainsbury’s, Waitrose, and Salesforce to deliver food and support at scale and now they’re investing heavily in data to drive the next stage of growth. Role: As the BI Lead , you’ll take ownership of the cloud data platform ...

Databricks Data Engineer - Leeds - Up to £70,000 Location: Leeds (Hybrid - 2 days per week onsite) Job Type: Permanent About the Company Our client is a rapidly growing data-driven consultancy helping enterprise-scale organisations modernise their data estates. With several major new projects … Requirements: Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables) Proficiency in PySpark and Python Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services Understanding of Delta Lake, streaming pipelines, and lakehouse architecture Solid knowledge of data ...

supporting an organisation that’s undergoing a large scale digital transformation, and they’re looking for a Data Engineer who can help design and build the foundations of a modern data ecosystem. If you enjoy creating scalable, efficient pipelines and working closely with analysts and transformation … teams, this is a great fit. The Role You’ll play a key part in shaping the organisation’s data infrastructure. The work spans architecture, engineering, data quality, governance and cross team collaboration. You’ll be involved in everything from ingesting and transforming data ...

Senior Data Engineer* ?? Location: Leeds, West Yorkshire (Hybrid 2 days per week) ?? Employment Type: Permanent ?? Status: Actively Hiring ?? Salary: £55,000-£65,000 + Excellent Benefits WRK digital is excited to be partnering exclusively with a high-profile, UK-leading organisation, currently shortlisting for a Senior Data … contributing to the evolution of modern data architecture. Key Experience Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Senior Data Engineer* 📍 Location: Leeds, West Yorkshire (Hybrid – 2 days per week) 🕒 Employment Type: Permanent 💼 Status: Actively Hiring 💡 Salary: £55,000-£65,000 + Excellent Benefits WRK digital is excited to be partnering exclusively with a high-profile, UK-leading organisation, currently shortlisting for a Senior Data … contributing to the evolution of modern data architecture. Key Experience • Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. • Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Azure Data Engineer (Databricks) - Must be SC Cleared (Outside IR35) Contract: 6 months Location: Newcastle Upon Tyne (2-3 days onsite per week) Expenses: Not reimbursable Domain: Public Sector Clearance: SC Clearance is mandatory Role Overview: We are seeking an experienced Azure Data Engineer with strong … experience as a Data Engineer in Azure environments. Strong hands-on expertise with Databricks and Spark. Knowledge of Azure Data Lake, Azure Synapse, and related services. Experience in Public Sector projects. SC Clearance (must be active). Must be SC Cleared Candidates ideally based ...

Description We're looking for a mid-level AWS Data Engineer to help us build and run reliable, scalable data pipelines. You'll turn raw data from multiple data sources into trusted datasets for our internal users, working closely with analysts, data … This is a great opportunity to join a small, collaborative team where you will have the chance to work on all aspects of Data Engineering and build up new skills on the job. Key Responsibilities: • Design, build, and maintain data pipelines in AWS. • Create and maintain ...

Hybrid – 3 days in Manchester | £80K–£90K This is a pivotal technical leadership role where you’ll shape the Azure data platform, own data architecture, and lead a small team to deliver high-quality, scalable data solutions that directly power business decisions. … organisation, giving you real visibility and influence across the organisation. ⭐ What You’ll Do Lead the design, build and optimisation of Azure data platforms Own data architecture, modelling and best practices Build and enhance ETL/ELT pipelines, data lakes & warehousing solutions Mentor data ...