51 to 75 of 168 Data Lake Jobs in the UK excluding London

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data … preferred). Experience with AWS cloud services including S3, Glue, Lambda, IAM. Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. Understanding of data governance and compliance frameworks. Experience in the healthcare sector or knowledge of NHS data ...

full supply chain from instrument and edge ingestion, through modelling and governance, to exposure for AI, workflow, analytics and customer data lake consumers. You will drive a critical transformation: moving IDBS from a traditional electronic lab notebook capture tool to an enterprise Data Product Provider. … modern lakehouse architecture, including medallion data tiers, transactional storage engines and change data capture patterns (for example Databricks and Delta Lake). Strong grasp of scientific data modelling, including unstructured to structured transformation, data contracts, schema evolution, ontologies and provenance standards ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Platform. From an MSB perspective the role will require the design, development, support and deployment of the AeroConnect Platform to provide connectivity and data analytic solutions for the manufacturing environments. This will focus on the integration of the latest manufacturing technologies both at the production sites and research … analysis. • Implement and manage data lakes, data warehouses, and other data storage solutions, including SQL and Cloud Lake solutions. Data Security & Compliance • Implement and enforce best architectural practices for data security, ensuring compliance with relevant data regulations ...

exciting opportunity has arisen for a Senior Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

Senior Data Engineer Location : Bolton Salary : Circa £55,000 depending on experience Working Pattern: Hybrid working 2 days per week onsite An exciting opportunity has become available for a Senior Data Engineer to join a leading defence engineering organisation, helping to develop and deliver advanced data solutions across a wide range of business and engineering functions. This role offers the opportunity to transform complex data from engineering systems, simulations, manufacturing operations and business platforms into reliable, accessible and valuable insights. You'll play a key role in designing scalable data ...

Senior Data Engineer Who we are We are an advanced data and business consultancy headquartered in Edinburgh, UK. We are a practitioner-led organisation that collaborates with top consumer brands to drive transformation and foster customer-centricity through our expertise in customer strategy, innovative design … advanced data science and engineering. We work with leading consumer brands to tackle and overcome complex business and customer problems to drive transformation and champion customer-centric agendas. We are proud to include some of the leading UK and global brands among our current clients such as Lloyds ...

Manchester/PERMANENT/SALARY: COMPETITIVE Job Purpose Responsible for developing, maintaining and optimising MPM’s data infrastructure. Provide technical expertise to ensure efficient data handling, ensuring availability, scalability and security of the centralised data asset. Ensure that all ETL pipeline and scheduled jobs … Experience with source control and CI/CD (GitHub, Azure DevOps, DABs) Data architecting, solutions architecting and experience optimising pipelines and Delta Lake Databricks Data Engineer Professional certified #J-18808-Ljbffr ...

pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop … Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

scalable dimensional data models and reporting frameworks. Integrate Power BI with enterprise data platforms including Azure SQL, Data Lake, Synapse, Fabric, and Oracle environments. Establish governance, security, audit, and reporting standards. Define and implement Row-Level Security (RLS), workspace controls, and access management. … Power BI DAX Power Query Semantic Models Dataflows Deployment Pipelines Power BI Administration Experience integrating Power BI with: Azure SQL Azure Data Lake Microsoft Fabric Azure Synapse Enterprise Data Platforms Strong dimensional data modelling experience. Experience designing secure and governed analytics solutions. Knowledge ...

Envitia is a UK-based software and services company that helps organisations unlock the full value of their data to make better, faster decisions. With over 30 years of experience, we specialise in delivering innovative software products, solutions, and consultancy services that transform complex data challenges … into actionable insights. Our mission is to empower customers across defence, government, and national security sectors to harness the power of data — from geospatial intelligence to advanced analytics and AI integration. We are proud to be a trusted partner to UK defence and government organisations, delivering technology that ...

doing Help build, test and maintain data pipelines using tools such as Databricks. Support data warehouse and data lake development with guidance from experienced engineers. Develop ETL/ELT workflows that make reliable, high-quality data accessible. Collaborate with colleagues … Python, SQL or similar data processing languages. Some exposure to Spark or Databricks through work, study, training or projects. Awareness of Delta Lake, notebooks and workflows; production experience is not essential. Familiarity with cloud platforms such as AWS, Azure or GCP is desirable. Basic understanding of relational ...

Canopius, our delivery teams are responsible for ensuring that business users can effectively harness data insights to drive strategic decision making. Our data strategy is centred around an enterprise Lakehouse platform on Databricks, avoiding fragmented, ungoverned silos on legacy technologies that hamper creativity and scalability. … aligned with organisational standards and governance requirements. Design, build, and optimise data pipelines on Databricks using PySpark and Spark SQL, applying Delta Lake and a medallion/Lakehouse architecture. Implement data validation and reconciliation checks, and automated testing across pipelines to ensure trusted, accurate outputs. ...

Role As a Core Data Engineer, you will play a pivotal role in designing, building, and optimising data pipelines, architectures, and workflows for our diverse client base. You’ll work within dynamic, multi-disciplinary project teams to implement scalable data solutions while adhering … best practices and emerging trends in data engineering. This is an exciting and valuable opportunity for an enthusiastic, earlier-stage data engineer to advance their career across a variety of commercial sectors. At Optima, you’ll work within cross-functional teams, collaborating with experts in different ...

Coventry City Council is seeking an experienced BI & Insight Analyst/Data Analyst to support a data transformation project … within Digital & HR Services. The role involves migrating data from the existing data warehouse to a new Data Lake, with HR data a significant focus, and close collaboration with HR teams and stakeholders across the Council. You will develop and maintain ...

business, operating across 100+ markets and backed by Francisco Partners. As we accelerate our transition to a modern, cloud-native SaaS platform, Platform & Data Engineering sits at the heart of our technical strategy. This is a high-impact leadership role reporting directly to the CTO, responsible for setting … tenancy, and developer-facing APIs - in a complex, multi-product enterprise SaaS environment.Hands-on background in data platform engineering: data lake architecture, ELT pipelines, and familiarity with Snowflake, Databricks, and AWS data services (Athena, Glue, EMR).Experience building AI/ML infrastructure: feature ...

role focused on designing and governing end-to-end GCP Data & AI platform, spanning data ingestion, governed data lake/lakehouse, data products, Knowledge Graph, Digital Twin data foundations, and Agentic AI platforms. The role requires an architect capable … shaping the complete data ecosystem rather than individual technology layers in isolation. In this role you will play a key role in: Design and govern enterprise-scale GCP data platforms using BigQuery, Spanner Graph DB, Dataplex, Dataflow, Pub/Sub, BigLake and Cloud Storage. Develop architectures ...

role focused on designing and governing end-to-end GCP Data & AI platform, spanning data ingestion, governed data lake/lakehouse, data products, Knowledge Graph, Digital Twin data foundations, and Agentic AI platforms. The role requires an architect capable … shaping the complete data ecosystem rather than individual technology layers in isolation.In this role you will play a key role in:Design and govern enterprise-scale GCP data platforms using BigQuery, Spanner Graph DB, Dataplex, Dataflow, Pub/Sub, BigLake and Cloud Storage.Develop architectures supporting GenAI ...

Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. Full-time Closes 25/11/2026 The Data Engineering department builds and refines high-performance, intra-day data platforms that … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines What ...

Transform complex data landscapes into high-impact solutions as a Data Warehouse Developer, shaping the future of intelligent cloud platforms. Full-time Closes 25/11/2026 The Data Engineering department builds and refines high-performance, intra-day data platforms that … enterprise data catalogue solutions Relational set-based processing and advanced SQL query development Hands-on background with modern Data Lake and Data Warehouse architectures Dimensional modelling for enterprise data warehouses Decisive problem-solving capabilities when delivering against tight deadlines What ...

Description Test Engineer, Cloud & Data Key Responsibilities Design, develop, and execute comprehensive test strategies for cloud-native data platforms. Build and maintain automated test frameworks for platform, integration, API, and end-to-end testing. Validate platform functionality across cloud services, infrastructure, data pipelines … transformation processes o Data quality and reconciliation Strong SQL skills. Familiarity with data warehouses and data lake technologies. DevOps & CI/CD Experience with: o Jenkins o GitHub Actions o Azure DevOps o Bamboo Understanding of Infrastructure as Code (Terraform preferred ...

test, and deploy high-fidelity rule-based and anomaly-based detections-as-code Detect and respond to cyber threats using security data lake, SIEM, and cloud platforms Respond to alerts, cyber threats, and drive end-to-end incident response investigations Perform digital forensic investigations to include collection … response operations Conduct threat hunts across corporate, cloud and product environments Support data engineering workflows for core security data lake and SIEM platforms Be an active member of D&R on-call rotations Coach and mentor security engineers within the detection & response team ...

stack and evolving toward a Lakehouse and semantic layer direction. Your Core Impact Design the Lakehouse: Build and own our unified data lake foundations, focusing on scalable ingestion, lifecycle management, and optimised access patterns. Build the Semantic Layer: Implement “metrics-as-code” so KPIs like … control of their business and removing high third‐party commission fees. The Technical Essentials The Azure Specialist: Deep experience with Azure Data Lake, Azure SQL, Data Factory, and Power BI. The DataOps & DevOps Advocate: Proficient with Git, CI/CD (Azure DevOps/GitHub Actions ...