1 to 25 of 121 Data Lake Jobs in London

with stakeholders, engineers, and analysts. Technical Stack: Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker Data: Snowflake, Delta Lake, Redis, Azure Data Lake Infra & Ops: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable skills/knowledge/experience: Knowledge … data platforms (e.g. Snowflake, Azure Data Lake). Experience deploying models as APIs (FastAPI, Azure Functions). Understanding of monitoring, model performance tracking, and observability best practices. Familiarity with orchestration tools like Airflow or Azure Data Factory. ...

collecting, transforming, and loading data into various data stores. Build and maintain data warehousing and data lake solutions Develop and deploy data models that support various business requirements Lead the design of data solutions with quality, automation … governance Expertise in developing Data Warehouses In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh Strong knowledge of data architecture and data modelling practices Cost ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

architecture design for projects, producing Data Architecture Assessments Design and deliver cloud data architectures using Azure Data Lake, Azure Data Factory, Synapse, SQL and related services Lead project-level data architecture, defining data models, flows, integrations … with hands-on experience delivering enterprise data models Strong hands-on experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, Databricks or Fabric Expertise in conceptual and logical data modelling, ideally using UML Deep understanding of Azure-aligned data ...

ability to drive business impact through data Technical Environment Languages: Python, SQL, Bash Cloud: Azure, AWS Data & Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Tools: Airflow, DBT, Docker Infrastructure & Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills Experience with … data platforms such as Snowflake or Azure Data Lake Experience deploying models as APIs (e.g. FastAPI, Azure Functions) Knowledge of monitoring, model performance tracking and observability practices Familiarity with orchestration tools such as Airflow or Azure Data Factory ...

ability to drive business impact through data Technical Environment Languages: Python, SQL, Bash Cloud: Azure, AWS Data & Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Tools: Airflow, DBT, Docker Infrastructure & Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills Experience with … data platforms such as Snowflake or Azure Data Lake Experience deploying models as APIs (e.g. FastAPI, Azure Functions) Knowledge of monitoring, model performance tracking and observability practices Familiarity with orchestration tools such as Airflow or Azure Data Factory ...

ability to drive business impact through data Technical Environment Languages: Python, SQL, Bash Cloud: Azure, AWS Data & Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Tools: Airflow, DBT, Docker Infrastructure & Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills Experience with … data platforms such as Snowflake or Azure Data Lake Experience deploying models as APIs (e.g. FastAPI, Azure Functions) Knowledge of monitoring, model performance tracking and observability practices Familiarity with orchestration tools such as Airflow or Azure Data Factory ...

Responsibilities Include: Designing and owning conceptual, logical, and physical data models Defining and evolving data warehouse and data lake architectures Providing architectural leadership across relational and NoSQL databases Advising on data integration patterns , including ETL/ELT and streaming architectures Supporting … Modeller Strong expertise in data modelling (conceptual, logical, and physical) Demonstrable experience designing data warehouses and data lake architectures Advanced SQL skills and strong understanding of relational and NoSQL databases Experience with cloud data platforms (AWS, Azure, and/ ...

Title: Data Architect Location: London (Hybrid – minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Data Architect to work with a high-performing data team, designing and delivering … supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable Skills and Experience Experience working with ...

Title: Data Architect Location: London (Hybrid – minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Data Architect to work with a high-performing data team, designing and delivering … supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable Skills and Experience Experience working with ...

Title: Data Architect Location: London (Hybrid – minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Data Architect to work with a high-performing data team, designing and delivering … supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable Skills and Experience Experience working with ...

Data Architect, Data Lake, AWS, Azure, Insurance, Cloud We are seeking an experienced and forward-thinking Data Architect to lead and optimise our data architecture initiatives, with a strong focus on the insurance sector. You will be responsible for designing, implementing … Computer Science, Information Technology, or a related field. This opening can be based from multiple locations Data Architect, Data Lake, AWS, Azure, Insurance, Cloud McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds. ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

Associate Director, Master Data Management Solution Architect, Engineering, AI & Data, Technology & Transformation Basic information Location London Business Line Job Type Permanent/FTC Date published 10-Dec-2025 Connect to your Industry Do you want to be at the heart of some of the biggest … reference data management, and stewardship workflows Strong proficiency with cloud-native data services (Azure Purview/ADF, AWS Glue/Lake Formation, GCP DataPlex) and modern integration technologies (APIs, streaming, ETL/ELT). Solid understanding of data governance, data lineage ...

distribution keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue …/Iceberg for low-cost, serverless analytics. Manage Glue Data Catalog integrations and table schema management. 5. Storage (S3) & Data Lake Architecture Design secure, cost-efficient S3 data lake structures (bronze/silver/gold zones). Implement data lifecycle ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Engineer across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced Python (PySpark … Proven ability to engage senior stakeholders and clearly communicate technical trade-offs Experience working in Agile delivery environments Nice to Have: Experience with AWS Lake Formation, Lambda, Step Functions, Athena, EMR, DataBrew Familiarity with data quality, lineage, or observability tooling Knowledge of GDS ways of working ...

Title: Senior Data Engineer Location: London (Hybrid – minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines that … translate business requirements into technical solutions. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills and Experience Experience with enterprise data ...

Title: Senior Data Engineer Location: London (Hybrid – minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines that … translate business requirements into technical solutions. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills and Experience Experience with enterprise data ...