1 to 25 of 40 Data Lake Jobs in the North of England

continue to expand throughout the UK Main duties of the job The role holder will be accountable for designing, building, and maintaining the data infrastructure and pipelines that enable efficient and accurate data collection, storage, processing, and analysis. The role holder will collaborate with cross-functional … teams, including analysts, software engineers and key stake holders to create and maintain data solutions that are crucial in delivering high quality care for our patients. About us Since 2012, CHEC has been working with the NHS to increase patient choice and provide better access to exceptional, timely ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services including Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure SQL, and Event Hub. * Implement data quality validation, monitoring, metadata management, and governance … Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data ...

Role: Principal Data Engineer Salary: £85,000 - £95,000 per annum Location: Manchester (Remote/Once a month) VIQU have partnered with a national organisation going through an exciting transformation in their data infrastructure and so are hiring a principal data engineer to lead … Flow, Data Fusion, and Data Stream. Deep understanding of Data Mesh/decentralised design and Data Lake/Warehouse solutions. Previously led teams of data engineers. Hands on skills across the GCP tech stack, SQL and Python. Ability ...

Company Nigel Wright are delighted to be partnering with the Institute of Directors in their search for a Senior Data Engineer.The Institute of Directors (IoD) is a thriving membership community for Directors in the UK and beyond, where you can connect with other leaders, develop your skills … Requirements You will have strong experience in data engineering, with a particular focus on data warehousing and data lake technologies. Additionally you will have a track record of establishing data governance best practises, including data security, data ...

pipelines using Databricks on Azure. Build and optimize data solutions leveraging Azure Data Services (e.g., Data Lake, Synapse). Work with large datasets to enable advanced analytics and reporting. Collaborate with stakeholders to deliver high-quality data solutions aligned … standards. Essential Skills Proven experience in Data Engineering within complex environments. Strong hands-on expertise with Databricks and Azure (Data Lake, Synapse, etc.). Solid understanding of cloud-based data platforms and ETL processes. Active SC Clearance (must be in place before starting ...

looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects … experience with data engineering coding languages such as Python, R, or Spark. Understanding of data warehouse and data lake principles. Experience with data visualisation tools such as PowerBI or Tableau. Leadership or mentoring experience within a technical team. Agile and/ ...

Title: Senior Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Senior Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Senior Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

leading data consultancy is seeking an experienced Senior Data Engineer to join their team and deliver cutting-edge solutions for a major transportation project. This is an exciting opportunity to work on a high-impact initiative for a well-known UK transport provider, leveraging modern cloud … Strong proficiency in: Databricks (PySpark) Azure Data Factory (ADF) SQL (complex queries and optimisation) Azure Data Services (Data Lake, Synapse, etc.) Excellent communication and stakeholder management skills. Nice-to-Have Experience with Scala for Spark development. Knowledge of CI/CD pipelines ...

Data QA Engineer, Data & Analytics Location: Leeds (Hybrid, 2 days onsite per week) Rate: Competitive day rate (Outside IR35) Fruition are recruiting for a well-known organisation undertaking a major data and analytics programme within Azure. The business has recently … delivered a successful Proof of Concept for a cloud-based analytics solution, enabling secure data extraction from a centralised Data Lake to external platforms. This contract role will focus on leading QA activity to productionise the solution into a live MVP, supporting a critical delivery ...

Databricks Data Engineer - Leeds - Up to £70,000 Location: Leeds (Hybrid - 2 days per week onsite) Job Type: Permanent About the Company Our client is a rapidly growing data-driven consultancy helping enterprise-scale organisations modernise their data estates. With several major new projects … Requirements: Strong experience with Databricks (jobs, notebooks, workflows, Delta Live Tables) Proficiency in PySpark and Python Hands-on experience with Azure Data Lake, Azure Data Factory, or similar cloud services Understanding of Delta Lake, streaming pipelines, and lakehouse architecture Solid knowledge of data ...

Hiring Data Analyst, Data Engineer and Data Scientists Must have Security Clearance or Ability to gain Warrington If you have 4–5 years of experience in data roles and a passion for Generative AI, ChatGPT, machine learning, and Azure’s modern data stack, we want to hear from you. What We’re Hiring For We have multiple opportunities available across our growing capability: 📊 Data Analyst You’ll transform raw data into compelling insights, build enterprise-grade Power BI solutions, and work with Azure technologies such ...

supporting an organisation that’s undergoing a large scale digital transformation, and they’re looking for a Data Engineer who can help design and build the foundations of a modern data ecosystem. If you enjoy creating scalable, efficient pipelines and working closely with analysts and transformation … teams, this is a great fit. The Role You’ll play a key part in shaping the organisation’s data infrastructure. The work spans architecture, engineering, data quality, governance and cross team collaboration. You’ll be involved in everything from ingesting and transforming data ...

Senior Data Engineer* ?? Location: Leeds, West Yorkshire (Hybrid 2 days per week) ?? Employment Type: Permanent ?? Status: Actively Hiring ?? Salary: £55,000-£65,000 + Excellent Benefits WRK digital is excited to be partnering exclusively with a high-profile, UK-leading organisation, currently shortlisting for a Senior Data … contributing to the evolution of modern data architecture. Key Experience Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

Data Engineer – Hybrid in Bolton – up to £70,000 This is a fantastic opportunity to join a longstanding client of Candours who has had exceptional growth over the past few years. They have built a fantastic working culture and are looking for a Data Engineer … join and be a part of their growth! As a Data Engineer, you will design, build, and operate data pipelines and storage layers within Microsoft Azure. You will work with both structured and unstructured data to support analytical insight and operational decision-making. ...

Next.JS, React, any web development experience would be a plus) Bonus points for Knowledge of asynchronous messaging patterns Experience with Azure Data Lake, Data Factory, and Logic Apps Exposure to AI, machine learning, or data engineering CI/CD experience with Azure DevOps ...

working on a blend of new and existing projects working with the latest tech in a greenfield large, highly scalable data lake environment. The Company: For the past 20+ years they have been a leading SaaS platform providing a full product suite of services to the securities … shape this function in the long term. The Role: The successful candidate will work across these areas: Owning the build and maintenance of their Lake house and being the 'go-to' Data person in the business. Working with stakeholders from across the business showing the possibilities that ...

working on a blend of new and existing projects working with the latest tech in a greenfield large, highly scalable data lake environment. The Company: For the past 20+ years they have been a leading SaaS platform providing a full product suite of services to the securities … shape this function in the long term. The Role: The successful candidate will work across these areas: Owning the build and maintenance of their Lake house and being the 'go-to' Data person in the business. Working with stakeholders from across the business showing the possibilities that ...

working on a blend of new and existing projects working with the latest tech in a greenfield large, highly scalable data lake environment. The Company: For the past 20+ years they have been a leading SaaS platform providing a full product suite of services to the securities … shape this function in the long term. The Role: The successful candidate will work across these areas: Owning the build and maintenance of their Lake house and being the 'go-to' Data person in the business. Working with stakeholders from across the business showing the possibilities that ...