1 to 25 of 36 Data Lake Jobs in the North of England

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

workflows that ingest data from various on-prem and cloud-based sources. * Work with Azure services including Azure Data Lake Storage, Azure Data Factory, Azure Synapse Analytics, Azure SQL, and Event Hub. * Implement data quality validation, monitoring, metadata management, and governance … Experience * Proven experience as a Data Engineer working with Azure cloud services. * Strong proficiency in Databricks, including PySpark, Spark SQL, notebooks, Delta Lake, and job orchestration. * Strong SQL and data modeling skills (e.g., dimensional modeling, data vault). * Experience with Azure Data ...

Data Engineer Location: Sheffield (Hybrid - 3 days per week onsite) Salary: £50,000-£60,000 depending on experience DCS Tech are searching for an experienced Data Engineer to join our clients growing team! You will play a crucial part in designing, building, and optimising the data … tools. Consolidate data from internal systems, APIs, and third-party sources into a unified data warehouse or data lake environment. Build and maintain robust data models to ensure accuracy, consistency, and accessibility across the organisation. Work closely with Data ...

sites) Duration: 6 month initial contract Inside IR35 Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Architects to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working … will be required onsite at least 4 days per week. Note, active SC clearance required! Key Responsibilities: Design and implement enterprise-level data architecture solutions, including databases, data warehouses, and data lakes. Develop and maintain logical, physical, and conceptual data models. Define ...

Data Engineer/Architect This organisation builds and manages critical healthcare infrastructure used by communities across the UK. As data becomes central to decision-making and innovation, they’re investing heavily in modern platforms and AI-led solutions. This role sits at the heart of that … pipelines Advanced Python and SQL skills Solid hands-on experience with Azure data services (Data Factory, Synapse, Data Lake, Functions, Logic Apps) Power BI data modelling and dashboard development expertise Practical experience using OpenAI APIs or similar AI/ML services ...

tailored to finance and retail business needs. Extract and transform financial and transactional data from Dynamics 365 via Azure Data Lake/Synapse/Data Factory (as applicable). Collaborate with finance and IT teams to understand data requirements and reporting … Dynamics 365 Finance and Operations data structures. Experience with Azure tools such as Data Factory, Synapse Analytics, Data Lake, or SQL Databases . Solid knowledge of data warehousing concepts and financial reporting. Ability to work independently in a contract capacity with ...

Details Role/Job Title: Data Engineer Work Location: Manchester, UK Mode of Working: Hybrid Office Requirement (Hybrid): Tuesday/Wednesday/Thursday The Role Seeking a Data Engineer profile with deep technical expertise and thought leadership, provides advanced data solutions by using software … process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data. Your Responsibilities Writes ETL (Extract ...

pipelines using Databricks on Azure. Build and optimize data solutions leveraging Azure Data Services (e.g., Data Lake, Synapse). Work with large datasets to enable advanced analytics and reporting. Collaborate with stakeholders to deliver high-quality data solutions aligned … standards. Essential Skills Proven experience in Data Engineering within complex environments. Strong hands-on expertise with Databricks and Azure (Data Lake, Synapse, etc.). Solid understanding of cloud-based data platforms and ETL processes. Active SC Clearance (must be in place before starting ...

Title: Senior Data Engineer Location: Leeds, 2x per week Salary: Up to £80,000 per annum Why Apply? This is an exciting opportunity to work as a Senior Data Engineer delivering scalable, high quality data solutions for a leading client in the technology sector. … This position offers professional growth, challenging projects, and access to cutting edge cloud data technologies. Senior Data Engineer Responsibilities: Design, develop, and optimise robust, scalable data pipelines and architectures to support business intelligence and analytics initiatives. Manage and maintain cloud-based data ...

Senior Data Engineer Hybrid – 2 days per week in Leeds Salary up to £60,000 + bonus & benefits Are you a technically strong, commercially minded Data Engineer who thrives in modern cloud environments? Elevation Tech & Transformation are looking for a Senior Data Engineer … strong hands-on experience across modern data platforms, including: Proven experience with AWS data technologies: S3, Redshift, Glue, Lambda, Lake Formation, CloudFormation Experience building and deploying cloud data platforms Infrastructure-as-Code and CI/CD practices (GitHub, CodeBuild, pipelines) Strong coding experience ...

Senior Data Engineer* ?? Location: Leeds, West Yorkshire (Hybrid 2 days per week) ?? Employment Type: Permanent ?? Status: Actively Hiring ?? Salary: £55,000-£65,000 + Excellent Benefits WRK digital is excited to be partnering exclusively with a high-profile, UK-leading organisation, currently shortlisting for a Senior Data … contributing to the evolution of modern data architecture. Key Experience Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

continually refine the AI initiatives portfolio and roadmap for the group. Run a structured intake process for new ideas, assessing value, feasibility, data readiness, ethical risk, and compliance. Define clear success measures for every proof of concept (PoC) and MVP, including KPIs, leading indicators, and decision gates … such as Azure OpenAI/OpenAI, Azure ML, Databricks, Kubernetes, and Docker. Familiarity with data platforms such as Azure Data Lake, Synapse/ADF, Delta Lake, and messaging platforms (e.g., event hubs, service bus). Exposure to MLOps and observability tools (e.g., MLflow/ ...

Next.JS, React, any web development experience would be a plus) Bonus points for Knowledge of asynchronous messaging patterns Experience with Azure Data Lake, Data Factory, and Logic Apps Exposure to AI, machine learning, or data engineering CI/CD experience with Azure DevOps ...

Azure Data Engineer (Databricks) - Must be SC Cleared (Outside IR35) Contract: 6 months Location: Newcastle Upon Tyne (2-3 days onsite per week) Expenses: Not reimbursable Domain: Public Sector Clearance: SC Clearance is mandatory Role Overview: We are seeking an experienced Azure Data Engineer with strong … experience as a Data Engineer in Azure environments. Strong hands-on expertise with Databricks and Spark. Knowledge of Azure Data Lake, Azure Synapse, and related services. Experience in Public Sector projects. SC Clearance (must be active). Must be SC Cleared Candidates ideally based ...

Senior Data Engineer - Remote-First - UK-Based - Up to £60,000 Are you a passionate Data Engineer looking to make a real impact in a fast-growing, values-driven tech company? We're working with a leading Microsoft Cloud specialist that's renowned for its inclusive … travel to client sites and company events Location: UK-based Employment Type: Permanent, Full-Time What You'll Be Doing Delivering full lifecycle data solutions: acquisition, engineering, modelling, analysis, and visualisation Leading client workshops and translating business needs into technical solutions Designing and implementing scalable ETL/ ...

Senior Data Engineer About the Role We are looking for a Senior Data Engineer to join a leading Microsoft partner that is modernising data platforms and delivering innovative analytics solutions for organisations across the UK. You will work closely with clients to understand their … also be able to supplement this hands-on experience with the opportunity to gain Microsoft focus certifications and accreditations. Responsibilities Build and manage data pipelines using Azure Synapse, Data Factory, Databricks or Microsoft Fabric Design, implement and maintain data lakes data warehouses ...

Description We're looking for a mid-level AWS Data Engineer to help us build and run reliable, scalable data pipelines. You'll turn raw data from multiple data sources into trusted datasets for our internal users, working closely with analysts, data … This is a great opportunity to join a small, collaborative team where you will have the chance to work on all aspects of Data Engineering and build up new skills on the job. Key Responsibilities: • Design, build, and maintain data pipelines in AWS. • Create and maintain ...

improve the lives of their people and customers. We have worked on a variety of projects from cloud service integrations, building Data Lake and Microservice platforms, through to building apps, voice recognition platforms and offering digital strategy consulting. We've worked across several industries, with clients including … Doing We're looking for someone like you to join our growing Site Reliability Engineering (SRE) team. We support a variety of data solutions that we've developed, and we are seeking individuals with data expertise to enhance our SRE team. This role offers excellent career ...

improve the lives of their people and customers. We have worked on a variety of projects from cloud service integrations, building Data Lake and Microservice platforms, through to building apps, voice recognition platforms and offering digital strategy consulting. We've worked across several industries, with clients including … Doing We're looking for someone like you to join our growing Site Reliability Engineering (SRE) team. We support a variety of data solutions that we've developed, and we are seeking individuals with data expertise to enhance our SRE team. This role offers excellent career ...