176 to 200 of 567 Data Lake Jobs

We are looking for a Lead Data Architect to provide strategic leadership and technical expertise in the design and development of data solutions. This role involves setting technical standards, evaluating new technologies, and shaping our approach to data. You will lead a team of Data Architects, Engineers, and Analysts, defining data architecture … frameworks and ensuring the development of scalable, robust, and cost-effective solutions. The ideal candidate will have a passion for data, be technology-agnostic, and possess excellent client-facing skills. Lead Data Architect Annual Salary: circa £85,000 Location: Flexible, hybrid working with some client travel Day to day of the role: Shape the approach to … agnostic. Proficiency in SQL and experience with data engineering coding languages such as Python, R, or Spark. Understanding of data warehouse and data lake principles. Experience with data visualisation tools such as PowerBI or Tableau. Leadership or mentoring experience within a technical team. Agile and/or DevOps project delivery experience More ❯

Were looking for a Data Engineer who loves building and managing data solutions. This is a fully remote, career opportunity with a forward looking marketing company with a national footprint. Youll be working in the Azure cloud, creating reliable pipelines, making sure data is clean and accessible, and helping the business make smarter decisions. … If you enjoy solving problems, working with all kinds of data, and collaborating with both technical and non-technical teammates, this role is for you. What Youll Do Build and manage data pipelines in Azure (Data Factory, Databricks, Synapse, etc.). Pull in data from different sourcesAPIs, databases, cloud apps, even streaming … data. Organize, clean, and transform data so its ready for reporting, dashboards, or advanced analytics. Keep everything secure and aligned with data governance and compliance rules. Work with analysts, data scientists, and business teams to make sure they have the data they need. Troubleshoot issues and keep systems running smoothly. Automate and More ❯

GCP Data Architect Location: UK Wide - Mainly remote with travel to office and client site when required Clearance Requirement: Eligible for SC clearance (must have lived in the UK for the past 5 years) Salary: £80-95,000 per annum + Permanent Benefits About the Role Are you a passionate and experienced Data Architect who thrives … on designing modern, scalable cloud data solutions? We're looking for a GCP Data Architect to join a high-performing team of data professionals driving digital and data transformation across multiple industries. As part of a dynamic data platforms team, you'll help organisations unlock the value of their data … best practices in architecture, strategy, and implementation on Google Cloud. What You'll Do Lead Architectural Design: Define and implement secure, scalable data warehouse, data lake, and data mesh architectures on Google Cloud. Drive Delivery Excellence: Partner with delivery teams to ensure solutions align with best practices, cost efficiency, and operational reliability. Act More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. This role plays a key part in defining our data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The … ideal candidate will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data storage solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data More ❯

Data Architect - Contract We are seeking a skilled Data Architect to lead the design, development, and oversight of our enterprise-wide data infrastructure. This role plays a key part in defining our data strategy and ensuring high standards of data quality, accessibility, and security across multiple systems and platforms. The … ideal candidate will be a strategic thinker with strong expertise in modern data architectures and data governance practices. Required Skills and Experience: Proven experience as a Data Architect or in a similar senior data-focused role. Extensive experience with various data modelling techniques and tools. Deep understanding of different data storage solutions (e.g., relational, NoSQL, data lakes) and their appropriate use cases. Strong knowledge of data integration patterns, ETL/ELT processes, and data pipeline orchestration. Experience with AWS data platforms and their respective data services. Solid understanding of data governance principles, including data More ❯

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders to define and implement data product solutions that … are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that are robust, reusable, and value-driven. Location: Uxbridge, UK. Main Responsibilities Solution Architecture & Design Design end-to-end architecture … for data products, including ingestion, transformation, storage, access, and visualization layers. Define architectural standards, patterns, and principles for data product development. Ensure solutions are scalable, modular, reusable, and aligned with enterprise architecture and data strategy. Lead the selection and integration of appropriate technologies and platforms (e.g., data lakes, warehouses, real-time processing More ❯

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders to define and implement data product solutions that … are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that are robust, reusable, and value-driven. Location: Uxbridge, UK. Main Responsibilities Solution Architecture & Design Design end-to-end architecture … for data products, including ingestion, transformation, storage, access, and visualization layers. Define architectural standards, patterns, and principles for data product development. Ensure solutions are scalable, modular, reusable, and aligned with enterprise architecture and data strategy. Lead the selection and integration of appropriate technologies and platforms (e.g., data lakes, warehouses, real-time processing More ❯

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders to define and implement data product solutions that … are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that are robust, reusable, and value-driven. Location: Uxbridge, UK. Main Responsibilities Solution Architecture & Design Design end-to-end architecture … for data products, including ingestion, transformation, storage, access, and visualization layers. Define architectural standards, patterns, and principles for data product development. Ensure solutions are scalable, modular, reusable, and aligned with enterprise architecture and data strategy. Lead the selection and integration of appropriate technologies and platforms (e.g., data lakes, warehouses, real-time processing More ❯

Test Engineer Data Platforms (FTC-6months Hybrid | London or Manchester) My client is looking for an experienced Test Engineer to take ownership of testing across modern data platforms. This is a hands-on role where you’ll design, implement, and execute test strategies for data pipelines, models, and reporting solutions built on Azure technologies. … Key Responsibilities Define and own the overall testing strategy for data pipelines, data models, and BI solutions. Develop and implement automated testing frameworks integrated with CI/CD pipelines. Design and execute test cases across … data ingestion, transformation, storage, and presentation layers. Validate data accuracy, performance, and usability within Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Power BI. Establish and monitor data quality checks, reconciliation, and compliance processes. Collaborate closely with data engineers, BI developers, architects, and product owners More ❯

600pd Outside IR35Remote - UK based applicants only6 months A leading eCommerce brand is looking for a Data Platform Engineer to play a key role in evolving their data ecosystem. This is an exciting opportunity to shape how data is built, governed, and leveraged across the business, supporting a platform that impacts millions of users … daily. THE COMPANY This brand is recognised for its innovation and community-driven approach. With data at the heart of its decision-making, they're investing heavily in scalable, modern data platforms to enable better insights, experimentation, and product development. You'll join a collaborative engineering culture that values autonomy, technical excellence, and continuous improvement. THE … and platform technologies. Nice to Have: Experience implementing data governance and observability stacks (lineage, data contracts, quality monitoring). Knowledge of data lake formats (Delta Lake, Parquet, Iceberg, Hudi). Familiarity with containerisation and streaming technologies (Docker, Kubernetes, Kafka, Flink). Exposure to lakehouse or medallion architectures within Databricks. More ❯

600pd Outside IR35 Remote - UK based applicants only 6 months A leading eCommerce brand is looking for a Data Platform Engineer to play a key role in evolving their data ecosystem. This is an exciting opportunity to shape how data is built, governed, and leveraged across the business, supporting a platform that impacts millions … of users daily. THE COMPANY This brand is recognised for its innovation and community-driven approach. With data at the heart of its decision-making, they're investing heavily in scalable, modern data platforms to enable better insights, experimentation, and product development. You'll join a collaborative engineering culture that values autonomy, technical excellence, and continuous … and platform technologies. Nice to Have: Experience implementing data governance and observability stacks (lineage, data contracts, quality monitoring). Knowledge of data lake formats (Delta Lake, Parquet, Iceberg, Hudi). Familiarity with containerisation and streaming technologies (Docker, Kubernetes, Kafka, Flink). Exposure to lakehouse or medallion architectures within Databricks. More ❯

Lead/Senior Data Engineer Hybrid – Midlands (1-2 days per week in office) Salary: Up to £65k plus bonus Permanent We are partnering with a leading and innovative organisation to help recruit a Senior Data Engineer to join their evolving data team. This role provides a unique opportunity to work with cutting-edge … cloud data platforms, supporting the delivery of high-quality, reliable data solutions while contributing to automation and platform enhancements. What You’ll Be Doing As a Senior Data Engineer, you will play a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and maintaining end-to-end … code reviews. What We’re Looking For Strong experience with Azure Databricks (Unity Catalog, DLT, cluster management) and other Azure services (Data Factory, Synapse, Data Lake Storage, Stream Analytics, Event Hubs). Advanced SQL knowledge with experience optimising relational databases and writing efficient queries (T-SQL). Strong understanding of data engineering principles More ❯

Lead/Senior Data Engineer Hybrid – Midlands (1-2 days per week in office) Salary: Up to £65k plus bonus Permanent We are partnering with a leading and innovative organisation to help recruit a Senior Data Engineer to join their evolving data team. This role provides a unique opportunity to work with cutting-edge … cloud data platforms, supporting the delivery of high-quality, reliable data solutions while contributing to automation and platform enhancements. What You’ll Be Doing As a Senior Data Engineer, you will play a key role in building, optimising, and maintaining cloud-based data solutions. Responsibilities include: Developing and maintaining end-to-end … code reviews. What We’re Looking For Strong experience with Azure Databricks (Unity Catalog, DLT, cluster management) and other Azure services (Data Factory, Synapse, Data Lake Storage, Stream Analytics, Event Hubs). Advanced SQL knowledge with experience optimising relational databases and writing efficient queries (T-SQL). Strong understanding of data engineering principles More ❯

Data Scientist Location: Hybrid (Greater Bristol Area) Salary: £54,000 Python - PySpark - Azure - Pandas - Scikit-learn - TensorFlow - PyStats - Data Science - Power BI We're supporting a growing, forward-thinking organisation in their search for an experienced Data Specialist. This is an exciting opportunity to join a dynamic team at a pivotal point in its … growth, helping shape data strategy, deliver insightful analytics, and drive intelligent decision-making across the business. You'll work closely with stakeholders to uncover challenges, identify opportunities, and deliver actionable, measurable solutions through advanced machine learning models, statistical methods, and high-performance data pipelines. Skills & Experience Required To be considered, you will need: Strong proficiency in … performance trade-offs. Experience building and maintaining end-to-end machine learning applications. Hands-on experience with Azure cloud technologies: Synapse, Fabric, AzureML, ADX, ADF, Azure Data Lake Storage, Event Hubs. Experience with visualisation tools such as Power BI and Streamlit. Familiarity with Parquet and Delta Parquet formats. Strong data modelling and architecture knowledge across More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

We are seeking a Data Engineer (Databricks) to support the growth of a global technology provider within the Insurtech space. The role focuses on designing and delivering ETL pipelines and scalable solutions using the Azure ecosystem, with an emphasis on enabling advanced analytics and data-driven decision-making. As a key player in a high-performing … data engineering team, you will contribute to large-scale transformation initiatives within the P&C Insurance space by developing robust data models, optimising data flows, and ensuring the accuracy and accessibility of critical information. The position requires close collaboration with both technical and business stakeholders, and is an excellent opportunity to join a team … showcase your talents. Key Responsibilities Design and develop ETL pipelines using Azure Data Factory for data ingestion and transformation Work with Azure Data Lake, Synapse, and SQL DW to manage large volumes of data Develop data transformation logic using SQL, Python, and PySpark code Collaborate with cross-functional teams More ❯

Developer Location: North Carolina MOH : Onsite/W2Experience Level: 1015 years job Summary We are seeking a highly experienced ETL Developer to design, develop, and optimize enterprise-level data integration solutions. The ideal candidate will have a deep understanding of ETL processes, data warehousing, and performance tuning, along with experience working in complex data ecosystems. This role requires strong technical expertise, problem-solving skills, and the ability to collaborate with cross-functional teams to ensure the accuracy, integrity, and performance of data pipelines. Key Responsibilities Design, develop, and maintain robust ETL processes to support data movement, transformation, and loading across multiple systems.Analyze business and data requirements to … translate them into technical specifications and ETL workflows.Optimize ETL performance, including data loading, transformation logic, and job scheduling.Work closely with data architects, analysts, and application teams to ensure consistent and accurate data delivery.Implement best practices for data quality, validation, and governance.Troubleshoot and resolve issues in existing ETL jobs and data More ❯

Job Title: Senior Data Engineer If you are interested in applying for this job, please make sure you meet the following requirements as listed below. Base Location: London OR Glasgow based (Hybrid 2 days per week in office) www.kpmgcareers.co.uk/experienced-professional/#LeBlender.OfficeLocations The KPMG Tax & Legal Technical Engineering function is a cornerstone of our business. We … upheaval. We've proudly stood beside the institutions and businesses which make the UK what it is. Why Join the KPMG Tax & Legal Technology Engineering team as Senior Data Engineer We might be world leaders in Tax & Legal, but in many ways the engineering department feels like a start-up, with a twist. There s the buzz of … Netsuite. Knowledge of Power Platform (Power Apps, Power Automate). Knowledge of Delta Lakehouse architectures and concepts. Experience with Azure Synapse (dedicated and serverless pools), Azure Data Lake, and Azure SQL. Familiarity working in a DevOps environment. Experience with REST APIs, including endpoint authentication and integration (e.g., Microsoft Graph APIs). To discuss this or wider Technology More ❯

Are you passionate about harnessing the power of data and AI to make a real difference in healthcare? The Health Data and Analytics team is dedicated to transforming health outcomes through innovative data-driven solutions. Our goal is to optimise operations, improve patient care, and deliver measurable value across the organisation by leveraging advanced … analytics, machine learning, and AI techniques. We're committed to building a culture where data is at the heart of decision-making, enabling us to achieve better efficiency, cost savings, and customer outcomes. As the Head of Data Science and AI, you'll be at the forefront of this mission, providing strategic leadership and shaping the … and lead a talented team of data scientists. Your role involves building end-to-end data science solutions, leveraging our cloud-based data lake, and working closely with stakeholders to embed a data-driven approach into every aspect of our work. This is a fantastic opportunity to drive meaningful change and More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯

A growing Microsoft Partner Consultancy are looking for a passionate Data Engineer join their impressive team, and work on cutting-edge projects for a variety of customers. The role is home-based, with some element of travel to client sites when required, and to company conferences and events (expenses-paid). For this reason, they're able to … consider candidates across the UK. This role sits within their specialist Data Practice - where you'll work as part of an Agile team to deliver modern data solutions for their clients, enabling better decision-making and driving innovation. You'll work on projects end-to-end, from running workshops to gather requirements, through to solution design … Experience designing and developing ETL/ELT processes using the Azure platform - Azure Synapse, Data Factory, Databricks or Fabric Knowledge of data lakes and medallion lake house design Working knowledge of Power BI or similar Strong communication, stakeholder management and problem-solving skills Microsoft Certifications are desirable but not essential Benefits: Salary from More ❯