51 to 75 of 152 Data Lake Jobs in the UK excluding London

Key Responsibilities: · Collaborating with cross-functional teams to understand data requirements, and design efficient, scalable, and reliable ETL processes using Python and Databricks · Developing and deploying ETL jobs that extract data from various sources, transforming them to meet business needs. · Taking ownership of the end-to-end engineering lifecycle, including data extraction, cleansing, transformation … and loading, ensuring accuracy and consistency. · Creating and managing data pipelines, ensuring proper error handling, monitoring and performance optimizations · Working in an agile environment, participating in sprint planning, daily stand-ups, and retrospectives. · Conducting code reviews, providing constructive feedback, and enforcing coding standards to maintain a high quality. · Developing and maintaining tooling and automation scripts to streamline repetitive … tasks. · Implementing unit, integration, and other testing methodologies to ensure the reliability of the ETL processes · Utilizing REST APIs and other integration techniques to connect various data sources · Maintaining documentation, including data flow diagrams, technical specifications, and processes. · Designing and implementing tailored data solutions to meet customer needs and use cases, spanning from streaming More ❯

We are looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects, Engineers, and Analysts, defining data architecture … frameworks and ensuring the development of scalable, robust, and cost-effective solutions. The ideal candidate will have a passion for data, be technology-agnostic, and possess excellent client-facing skills. Lead Data Architect Annual Salary: circa £85,000 Location: Flexible, hybrid working with some client travel Day to day of the role: Shape the approach to … agnostic. Proficiency in SQL and experience with data engineering coding languages such as Python, R, or Spark. Understanding of data warehouse and data lake principles. Experience with data visualisation tools such as PowerBI or Tableau. Leadership or mentoring experience within a technical team. Agile and/or DevOps project delivery experience More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. This role plays a key part in defining our data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The … ideal candidate will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data storage solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data More ❯

600pd Outside IR35Remote - UK based applicants only6 months A leading eCommerce brand is looking for a Data Platform Engineer to play a key role in evolving their data ecosystem. This is an exciting opportunity to shape how data is built, governed, and leveraged across the business, supporting a platform that impacts millions of users … daily. THE COMPANY This brand is recognised for its innovation and community-driven approach. With data at the heart of its decision-making, they're investing heavily in scalable, modern data platforms to enable better insights, experimentation, and product development. You'll join a collaborative engineering culture that values autonomy, technical excellence, and continuous improvement. THE … and platform technologies. Nice to Have: Experience implementing data governance and observability stacks (lineage, data contracts, quality monitoring). Knowledge of data lake formats (Delta Lake, Parquet, Iceberg, Hudi). Familiarity with containerisation and streaming technologies (Docker, Kubernetes, Kafka, Flink). Exposure to lakehouse or medallion architectures within Databricks. More ❯

Lead/Senior Data Engineer Hybrid – Burton-Upon-Trent (1-2 days per week in office) Salary: Up to £70k + discretionary 10% bonus Permanent We are partnering with a leading and innovative organisation to help recruit a Senior Data Engineer to join their evolving data team. This role provides a unique opportunity to … work with cutting-edge cloud data platforms, supporting the delivery of high-quality, reliable data solutions while contributing to automation and platform enhancements. What You’ll Be Doing As a Senior Data Engineer, you will play a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and … code reviews. What We’re Looking For Strong experience with Azure Databricks (Unity Catalog, DLT, cluster management) and other Azure services (Data Factory, Synapse, Data Lake Storage, Stream Analytics, Event Hubs). Advanced SQL knowledge with experience optimising relational databases and writing efficient queries (T-SQL). Strong understanding of data engineering principles More ❯

Data Scientist Location: Hybrid (Greater Bristol Area) Salary: £54,000 Python - PySpark - Azure - Pandas - Scikit-learn - TensorFlow - PyStats - Data Science - Power BI We're supporting a growing, forward-thinking organisation in their search for an experienced Data Specialist. This is an exciting opportunity to join a dynamic team at a pivotal point in its … growth, helping shape data strategy, deliver insightful analytics, and drive intelligent decision-making across the business. You'll work closely with stakeholders to uncover challenges, identify opportunities, and deliver actionable, measurable solutions through advanced machine learning models, statistical methods, and high-performance data pipelines. Skills & Experience Required To be considered, you will need: Strong proficiency in … performance trade-offs. Experience building and maintaining end-to-end machine learning applications. Hands-on experience with Azure cloud technologies: Synapse, Fabric, AzureML, ADX, ADF, Azure Data Lake Storage, Event Hubs. Experience with visualisation tools such as Power BI and Streamlit. Familiarity with Parquet and Delta Parquet formats. Strong data modelling and architecture knowledge across More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

Position: Azure Data Engineer Employment Type: Contract Start: ASAP (November/December 2025) Duration: 6 Months Location: West Midlands, UK Language(s): English Focus on SAP is a specialist SAP and ERP Recruitment organisation offering both permanent and contract staffing solutions on a global scale. Client – Partnered with a global leader in digital transformation and IT services, working … people and communities they serve. For you, this means working on challenging projects that demand innovation, collaboration, and thought leadership . Role – We are seeking an experienced Azure Data Engineer to join a leading technology-driven organisation. You will play a key role in designing, building, and optimising data pipelines and integration workflows within the Microsoft … ETL/ELT processes to integrate and transform large datasets across cloud and on-prem environments. Implement and optimise data solutions in Azure Synapse, Data Lake, Databricks , and Snowflake . Write efficient SQL and Python scripts for data manipulation, validation, and automation. Collaborate with data architects and analysts to ensure data More ❯

Data Architect – Greenfield Project | Data Lakes | Databricks | Azure Fabric 📍 Location: Birmingham (Hybrid) 💰 Salary: £80,000 - £85,000 Are you a Data Architect who loves building from the ground up? This is a greenfield opportunity to shape, design, and deliver a modern data platform that will drive real impact from day one. You … ll be joining a forward-thinking organisation that’s investing heavily in its data journey — giving you the freedom and influence … to define the architecture, choose the right tools, and implement best practices for scalability and performance. What you’ll be doing: Designing and delivering a new Data Lake and Databricks environment. Defining data architecture, governance, and integration standards. Collaborating with business and technical teams to translate needs into scalable data solutions. Building a More ❯

to technology. We are investing in our people, and the processes enabled by digital, to evolve and transform the student and staff experience at UAL. The Head of Data Architecture is a new senior leadership role within the Architecture and Data team, responsible for establishing and leading a new Data Architecture function within the … Digital & Technology directorate. The Head of Data Architecture will play a critical role in delivering the university’s 2032 Strategy by enabling data-driven decision-making, enhancing analytics capabilities, and embedding a culture of data governance and stewardship. You will be tasked with building a high-performing team and developing a robust operating model … that supports the university’s strategic goals. This includes designing and implementing a comprehensive data governance framework, ensuring data quality, and creating secure, scalable data systems that support planning, performance, and innovation across UAL. Working closely with senior leaders, academic colleges, and professional services, you will ensure that data is treated as More ❯

billion players already reached, your work will contribute to our shared mission of making the most fun games for the world's players. Join the team! Our Data Engineering team are seeking a talented and experienced Data Engineer to join the team based in Leamington Spa, working on-site 5 days a week. With high volume … and a variety of data within our organisation we require an advanced expertise to ensure scalability, reliability and efficiency in our data ecosystem. We require a person who has designed, created, & maintained data pipelines at large scale in a given tech stack, and also understands best practices and standards and is able to review … if they are being followed at team level. Role Overview Design, develop, test, and maintain Kwalee’s core data systems, including data pipelines, data warehouses and data lakes. Maximise the accessibility and reliability of data for developers and users of data at Kwalee, while ensuring reasonable cost effectiveness More ❯

Data Curator is required to join a team working on a large-scale data governance programme and to be responsible for interpreting and structuring complex data, as well as creating interoperable datasets to support scientific research. You will be responsible for: Designing vocabularies, ontologies, and taxonomies, ensuring data is accurate, consistent, and … aligned with best practices. Curating, profiling, and validating datasets to ensure their quality and usability. Maintaining repositories and ensuring ongoing data accuracy. Collaborating with scientists, technical specialists, and business teams. Supporting training and adoption of data curation tools across the organisation. Contributing to process improvements and adapting to automation and AI developments Required experience and skills … Extensive experience in data curation in support of scientific research. Knowledge of data standards, ontologies, and taxonomies, and their implementation in centralized repositories. Proficiency with wide range of data curation and data governance tools will be beneficial. Strong communication and stakeholder engagement skills. Experience with enterprise data management, and data More ❯

As a Data Engineer at MM Flowers, you’ll help drive our digital transformation by expanding and improving our data infrastructure that powers financial and operational insight. The role will be a key enabler on the delivery of significant technology focused projects, and the continual development of the digital landscape across the business. We’re looking … to grow our data team with a skilled, proactive Data Engineer who is keen to establish strong data governance, observability practices-ensuring datasets are versioned, catalogued and fully traceable from source to output while sharing their knowledge within the data team. Working closely with the IT Team, vendors and business stakeholders, the … Data Engineer will implement a data warehousing solution that will enable better use of data and reporting driving business benefits in alignment with the wider business strategy. The ideal candidate will bring experience working with complex, datasets, a strong grasp of modern data engineering tools and best practices, and the curiosity to More ❯

Data Engineer, Azure London/Hybrid £competitive + bonus + excellent benefits Azure, Fabric, Python Data Engineer with extensive cloud experience is sought by thriving financial services organisation in the City of London. As part of the central data platform team, you will be responsible for developing the Data Engineering standards to … be followed by federated data teams across the business. Within these standards our client is looking to create a Data Engineering development environment that has the flexibility to ensure engineers work as efficiently as possible while operating within the security constraints outlined by the business. Responsibilities Work with Product Owners to establish product requirements. Design and … engineering tools on a variety of complex products. Python Semantic Models Azure Data Factory Azure Synapse SQL Server ETL/ELT Database Design Data Warehousing Datalake/Lakehouse For a full consultation on this exciting new opportunity, get in touch with Arc IT today More ❯

Data Management Lead S/4HANA Hybrid - Ormskirk| £75,000 + Excellent Benefits Are you a data professional ready to take the lead in shaping a large-scale digital transformation? We're looking for an experienced Data Management Lead to define and deliver a long-term data strategy that underpins both our … ERP programme and the wider digital landscape. This is a senior, high-impact role that combines strategic vision with hands-on delivery You'll take ownership of the data workstream for a major ERP harmonisation initiative, ensuring the organisation's data is clean, compliant, and ready to drive smarter decision-making. You'll lead a team … of data professionals and work closely with stakeholders to embed sustainable data governance and management practices. Key Responsibilities Define and implement a comprehensive data strategy for the Digital function, focused on ERP transformation. Lead the data workstream, covering the full data migration lifecycle (ETL). Oversee data governance More ❯

Data Architect- £100,000 - Hybrid We're looking for a Data Architect to take a leading role in designing and evolving the backbone of our data ecosystem. This is a strategic, high-impact role where your expertise will define how we model, store, and use data across the business. You'll shape … the technical direction of our data landscape-developing scalable, secure, and future-ready systems that enable insight, innovation, and growth. What You'll Do Design and implement scalable data architectures, models, and integration frameworks. Lead the definition of the "As-Is" and "To-Be" data platform vision, ensuring alignment with business goals. Oversee the … end-to-end data lifecycle-from modelling and ingestion to governance, storage, and delivery. Ensure compliance with GDPR and data protection standards. Collaborate with engineering, delivery, and business teams to translate strategic objectives into technical solutions. Provide technical leadership and guidance across data initiatives, influencing best practice and architectural standards. Safeguard the integrity, availability More ❯

Data Engineer Power BI, Azure Data Factory, Synapse Salary: £50,000£55,000 + excellent benefits Location: Birmingham or London (12 days per month in office) Employment: Full time A leading and growing UK financial services company is seeking a Data Engineer to build Power BI reporting solutions and support the development of its … Azure data platform. This is an excellent opportunity for a mid-level engineer looking to deepen their Azure Data Factory, Synapse, and SQL experience while contributing to enterprise-wide MI and analytics. The Role You will: Build and maintain Power BI dashboards, reports, and data models using DAX and Power Query (key focus). … Azure Data Factory ETL pipelines. Working knowledge of Azure Synapse modelling and performance tuning. Good SQL skills for analytics and optimisation. Understanding of Azure Data Lake structures. Experience using Git and Azure DevOps in Agile teams. 24 years experience in a Data Engineering or BI Development role. Desirable: Exposure to Microsoft Fabric . More ❯

D1 Location: Glasgow Duration: 31/12/2026 Days on site: 2-3 Role Description: To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Candidates working … for this role will either contribute to strategic deliverables by building data engineering pipelines using the AWS technology stack, or support platform modernization efforts by migrating existing AWS components to Databricks, depending on their assessed skill sets. *UI development experience as must along with AWS Cloudformation.* AWS Data Engineering JD Should lead the project: Strong hands … with stakeholders, understanding business requirements, and translating them into technical design. Strong Experience in Databricks development/migration. (this is for Databricks engineer) Experience with Apache Spark, Databricks Delta Lake, Unity Catalog, and MLflow.( this is for Databricks engineer) Accountabilities Build and maintenance of data pipelines that enable the transfer and processing of durable, complete and consistent More ❯

We are looking for a Senior AWS Technical Lead to build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Candidates working for this role will either contribute to … strategic deliverables by building data engineering pipelines using the AWS technology stack, or support platform modernization efforts by migrating existing AWS components to Databricks, depending on their assessed skill sets. *UI development experience as must along with AWS CloudFormation.* AWS Data Engineering JD Should lead the project: * Strong hands-on data engineering experience delivering … with stakeholders, understanding business requirements, and translating them into technical design. * Strong Experience in Databricks development/migration. (this is for Databricks engineer) * Experience with Apache Spark, Databricks Delta Lake, Unity Catalog, and MLflow.( this is for Databricks engineer) Accountabilities * Build and maintenance of data pipelines that enable the transfer and processing of durable, complete and consistent More ❯