Data Lake Job Vacancies

401 to 425 of 725 Data Lake Jobs

Principal Software Engineer

Sonoma, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Software Engineer

San Mateo, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Software Engineer

Alameda, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Software Engineer

San Jose, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Software Engineer

Fremont, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Software Engineer

Sunnyvale, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Software Engineer

Hayward, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Software Engineer

Santa Rosa, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Principal Software Engineer

Santa Clara, California, United States
Harnham
science, and ML teams to design and build scalable systems. The role includes working on a variety of projects, such as imagery processing pipelines, datalake design optimization, and integration with lab equipment. Key projects may include (but are not limited to): Developing new imagery processing pipelines Improving and optimizing existing … datalake infrastructure Building integrations with a variety of lab equipment Designing and implementing data observability and quality control systems Supporting data pipelines and infrastructure Key Responsibilities: Collaborate with laboratory, computational biology, data science, and ML teams to design and build systems for observability, quality … end. A self-starter mentality, with the ability to independently lead projects and solve complex problems. Nice to Have: Experience with data lake technologies such as Spark , Ray , or Iceberg . Familiarity with Kubernetes for container orchestration. Experience with dbt. Familiarity with Dagster for managing data More ❯
Employment Type: Permanent
Salary: USD Annual
Posted:

Senior Data Engineer (London)

London, UK
Hybrid / WFH Options
DataCareers
Senior Data Engineer - SC Cleared Remote (UK-based) £85,000 - 95,000 + Benefits Full-Time | Central Government Projects We're looking for an experienced Senior Data Engineer to lead the design and delivery of secure, scalable, cloud-native data solutions across high-impact … remote role , but active SC clearance is essential . Applicants without current SC clearance cannot be considered. As a senior member of the Data Engineering team, you'll play a pivotal role in designing high-quality data pipelines, guiding delivery teams, and collaborating with cross-functional … solutions Promoting engineering standards and contributing to internal capability building You'll Need: Active SC Clearance Proven experience with Microsoft Azure (Data Lake, Synapse, Purview) Strong understanding of secure data handling, DevOps, and compliance Experience with structured and unstructured data sources (e.g., Azure More ❯
Posted:

Head of Data Engineering

England, United Kingdom
Hybrid / WFH Options
Levick Stanley
Are you a visionary leader with a passion for data? Join our innovative client as the Head of Data Engineering , where you'll drive there data platform strategy, mentor top-tier engineering talent, and shape the future of there data-driven products. … What you'll do: Lead and develop a team of Tech Leads and engineering squads. Define and implement a robust data platform using Azure Cloud technologies. Collaborate with cross-functional teams to deliver high-impact, data-centric products. Ensure data integrity, security, and governance … in data engineering, with 4+ years in senior leadership. Proven experience with Azure services (Data Factory, Synapse, Data Lake, SQL Database). Strong leadership, communication, and stakeholder management skills. Solid understanding of data architecture, modeling, and distributed systems. Why join? Be More ❯
Posted:

Data Architect (GCP)

London Area, United Kingdom
Hybrid / WFH Options
Anson McCade
Role : Data Architect (GCP) Location : London Salary : £80,000 to £130,000 (Multiple grades) + bonus & benefits We are supporting a global technology services provider in the strategic expansion of their Google Cloud Data and AI practice, with multiple opportunities available for experienced professionals across architecture … and engineering. This unit is driving major transformation initiatives with flagship enterprise clients, with a focus on intelligent data platforms, AI-driven analytics, and scalable cloud-native solutions. Role Overview This is a strategic and hands-on opportunity for an experienced Data Architect to lead the … development of a robust, scalable data architecture on Google Cloud Platform (GCP). You’ll be responsible for defining the platform strategy, leading a team of data engineers, and ensuring high standards of data quality, compliance, and performance across enterprise-grade data More ❯
Posted:

Data Architect (GCP)

london, south east england, united kingdom
Hybrid / WFH Options
Anson McCade
Role : Data Architect (GCP) Location : London Salary : £80,000 to £130,000 (Multiple grades) + bonus & benefits We are supporting a global technology services provider in the strategic expansion of their Google Cloud Data and AI practice, with multiple opportunities available for experienced professionals across architecture … and engineering. This unit is driving major transformation initiatives with flagship enterprise clients, with a focus on intelligent data platforms, AI-driven analytics, and scalable cloud-native solutions. Role Overview This is a strategic and hands-on opportunity for an experienced Data Architect to lead the … development of a robust, scalable data architecture on Google Cloud Platform (GCP). You’ll be responsible for defining the platform strategy, leading a team of data engineers, and ensuring high standards of data quality, compliance, and performance across enterprise-grade data More ❯
Posted:

Data Architect (GCP)

slough, south east england, united kingdom
Hybrid / WFH Options
Anson McCade
Role : Data Architect (GCP) Location : London Salary : £80,000 to £130,000 (Multiple grades) + bonus & benefits We are supporting a global technology services provider in the strategic expansion of their Google Cloud Data and AI practice, with multiple opportunities available for experienced professionals across architecture … and engineering. This unit is driving major transformation initiatives with flagship enterprise clients, with a focus on intelligent data platforms, AI-driven analytics, and scalable cloud-native solutions. Role Overview This is a strategic and hands-on opportunity for an experienced Data Architect to lead the … development of a robust, scalable data architecture on Google Cloud Platform (GCP). You’ll be responsible for defining the platform strategy, leading a team of data engineers, and ensuring high standards of data quality, compliance, and performance across enterprise-grade data More ❯
Posted:

Enterprise Data Architect (Azure)

City Of Bristol, England, United Kingdom
Hybrid / WFH Options
TrueNorth®
TrueNorth are working with a global organisation who are looking for their first Enterprise Data Architect to join a new function that is being created in the company. You'll be instrumental in designing the data architecture for the org, as well as overseeing the creation … Data Warehouse. Key skills and experience required: Extensive Azure data architecture ETL and ELT pipeline development Databricks, Data Lake and other Azure focussed services Leading data teams Data modelling Excellent stakeholder management and engagement Analytics and reporting built on … top of a data warehouse Beneficial: Finance/fintech/insurance/regulated industry experience Azure and/or Data Engineering certifications Working with 3rd party vendors ML Ops The role is hybrid working from their Bristol offices (2 days per week). We have a More ❯
Posted:

Enterprise Data Architect (Azure)

newport, wales, united kingdom
Hybrid / WFH Options
TrueNorth®
TrueNorth are working with a global organisation who are looking for their first Enterprise Data Architect to join a new function that is being created in the company. You'll be instrumental in designing the data architecture for the org, as well as overseeing the creation … Data Warehouse. Key skills and experience required: Extensive Azure data architecture ETL and ELT pipeline development Databricks, Data Lake and other Azure focussed services Leading data teams Data modelling Excellent stakeholder management and engagement Analytics and reporting built on … top of a data warehouse Beneficial: Finance/fintech/insurance/regulated industry experience Azure and/or Data Engineering certifications Working with 3rd party vendors ML Ops The role is hybrid working from their Bristol offices (2 days per week). We have a More ❯
Posted:

Enterprise Data Architect (Azure)

bath, south west england, united kingdom
Hybrid / WFH Options
TrueNorth®
TrueNorth are working with a global organisation who are looking for their first Enterprise Data Architect to join a new function that is being created in the company. You'll be instrumental in designing the data architecture for the org, as well as overseeing the creation … Data Warehouse. Key skills and experience required: Extensive Azure data architecture ETL and ELT pipeline development Databricks, Data Lake and other Azure focussed services Leading data teams Data modelling Excellent stakeholder management and engagement Analytics and reporting built on … top of a data warehouse Beneficial: Finance/fintech/insurance/regulated industry experience Azure and/or Data Engineering certifications Working with 3rd party vendors ML Ops The role is hybrid working from their Bristol offices (2 days per week). We have a More ❯
Posted:

Enterprise Data Architect (Azure)

Newcastle Upon Tyne, England, United Kingdom
Hybrid / WFH Options
TrueNorth®
TrueNorth are working with a global organisation who are looking for their first Enterprise Data Architect to join a new function that is being created in the company. You'll be instrumental in designing the data architecture for the org, as well as overseeing the creation … Data Warehouse. Key skills and experience required: Extensive Azure data architecture ETL and ELT pipeline development Databricks, Data Lake and other Azure focussed services Leading data teams Data modelling Excellent stakeholder management and engagement Analytics and reporting built on … top of a data warehouse Beneficial: Finance/fintech/insurance/regulated industry experience Azure and/or Data Engineering certifications Working with 3rd party vendors ML Ops The role is hybrid working from their Newcastle City Centre offices (2 days per week). We More ❯
Posted:

Enterprise Data Architect (Azure)

bradley stoke, south west england, united kingdom
Hybrid / WFH Options
TrueNorth®
TrueNorth are working with a global organisation who are looking for their first Enterprise Data Architect to join a new function that is being created in the company. You'll be instrumental in designing the data architecture for the org, as well as overseeing the creation … Data Warehouse. Key skills and experience required: Extensive Azure data architecture ETL and ELT pipeline development Databricks, Data Lake and other Azure focussed services Leading data teams Data modelling Excellent stakeholder management and engagement Analytics and reporting built on … top of a data warehouse Beneficial: Finance/fintech/insurance/regulated industry experience Azure and/or Data Engineering certifications Working with 3rd party vendors ML Ops The role is hybrid working from their Bristol offices (2 days per week). We have a More ❯
Posted:

Enterprise Data Architect (Azure)

sunderland, tyne and wear, north east england, united kingdom
Hybrid / WFH Options
TrueNorth®
TrueNorth are working with a global organisation who are looking for their first Enterprise Data Architect to join a new function that is being created in the company. You'll be instrumental in designing the data architecture for the org, as well as overseeing the creation … Data Warehouse. Key skills and experience required: Extensive Azure data architecture ETL and ELT pipeline development Databricks, Data Lake and other Azure focussed services Leading data teams Data modelling Excellent stakeholder management and engagement Analytics and reporting built on … top of a data warehouse Beneficial: Finance/fintech/insurance/regulated industry experience Azure and/or Data Engineering certifications Working with 3rd party vendors ML Ops The role is hybrid working from their Newcastle City Centre offices (2 days per week). We More ❯
Posted:

Head of Data Engineering (England)

Northamptonshire, UK
Hybrid / WFH Options
Levick Stanley
Are you a visionary leader with a passion for data? Join our innovative client as the Head of Data Engineering , where you'll drive there data platform strategy, mentor top-tier engineering talent, and shape the future of there data-driven products. … What you'll do: Lead and develop a team of Tech Leads and engineering squads. Define and implement a robust data platform using Azure Cloud technologies. Collaborate with cross-functional teams to deliver high-impact, data-centric products. Ensure data integrity, security, and governance … in data engineering, with 4+ years in senior leadership. Proven experience with Azure services (Data Factory, Synapse, Data Lake, SQL Database). Strong leadership, communication, and stakeholder management skills. Solid understanding of data architecture, modeling, and distributed systems. Why join? Be More ❯
Posted:

Senior Data Architect IRC265727

Edinburgh, United Kingdom
Hitachi Vantara Corporation
Description As a Data Solutions Architect you'll work closely with key stakeholders to map out their data/insights requirements and develop roadmaps and design architecture which you'll communicate effectively to the project teams, implementation teams and end-users - leading top quality solutions design … and delivery. Requirements Strong experience as a Cloud data architect Skilled in one or more of the following architectural frameworks (TOGAF, ZACHMAN, FEAF) Cloud Experience: AWS or GCP preferred, particularly around migrations and cloud architecture Good technical knowledge and understanding of big data frameworks like Hadoop … with common architectural patterns and able to define and customise them for different use cases. Develop data models and Data Lake designs around stated use cases to capture KPIs and data transformations. Identify relevant AWS services - on Amazon EMR, Redshift, Athena, Glue, Lambda More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Data Product Architect

London Area, United Kingdom
Hybrid / WFH Options
Merlin Entertainments
Data Product Architect Location: Hybrid - London, Blackfriars Join us at Merlin Entertainments as we transform the future of digital guest experiences across our iconic global attractions. Merlin is embarking on an exciting Digital and Data Transformation focused on enhancing the end-to-end guest journey in … our attractions. The Data Product Architect will play pivotal role in bridging the gap between business needs and technical solutions, ensuring data products are scalable, reliable and aligned with business objectives. About the Role As a Data Architect, you will work alongside teams such … as Product, Data Engineering/Analytics and Business Stakeholders to design data solutions that enable the business to analyse and report more accurately and lead to improved decision making. Responsibilities Create and update an architectural vision and roadmap for data products. Define the structure More ❯
Posted:

Enterprise Data Architect (Azure) (City Of Bristol)

Bristol, UK
Hybrid / WFH Options
TrueNorth®
TrueNorth are working with a global organisation who are looking for their first Enterprise Data Architect to join a new function that is being created in the company. You'll be instrumental in designing the data architecture for the org, as well as overseeing the creation … Data Warehouse. Key skills and experience required: Extensive Azure data architecture ETL and ELT pipeline development Databricks, Data Lake and other Azure focussed services Leading data teams Data modelling Excellent stakeholder management and engagement Analytics and reporting built on … top of a data warehouse Beneficial: Finance/fintech/insurance/regulated industry experience Azure and/or Data Engineering certifications Working with 3rd party vendors ML Ops The role is hybrid working from their Bristol offices (2 days per week). We have a More ❯
Posted:

Enterprise Data Architect (Azure) (Newcastle Upon Tyne)

Newcastle upon Tyne, UK
Hybrid / WFH Options
TrueNorth®
TrueNorth are working with a global organisation who are looking for their first Enterprise Data Architect to join a new function that is being created in the company. You'll be instrumental in designing the data architecture for the org, as well as overseeing the creation … Data Warehouse. Key skills and experience required: Extensive Azure data architecture ETL and ELT pipeline development Databricks, Data Lake and other Azure focussed services Leading data teams Data modelling Excellent stakeholder management and engagement Analytics and reporting built on … top of a data warehouse Beneficial: Finance/fintech/insurance/regulated industry experience Azure and/or Data Engineering certifications Working with 3rd party vendors ML Ops The role is hybrid working from their Newcastle City Centre offices (2 days per week). We More ❯
Posted:
Data Lake
10th Percentile
£46,750
25th Percentile
£60,000
Median
£82,500
75th Percentile
£122,500
90th Percentile
£141,000