1 to 25 of 50 Permanent Data Lake Jobs in London

collecting, transforming, and loading data into various data stores. Build and maintain data warehousing and data lake solutions Develop and deploy data models that support various business requirements Lead the design of data solutions with quality, automation … governance Expertise in developing Data Warehouses In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh Strong knowledge of data architecture and data modelling practices Cost ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

architecture design for projects, producing Data Architecture Assessments Design and deliver cloud data architectures using Azure Data Lake, Azure Data Factory, Synapse, SQL and related services Lead project-level data architecture, defining data models, flows, integrations … with hands-on experience delivering enterprise data models Strong hands-on experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, Databricks or Fabric Expertise in conceptual and logical data modelling, ideally using UML Deep understanding of Azure-aligned data ...

ability to drive business impact through data Technical Environment Languages: Python, SQL, Bash Cloud: Azure, AWS Data & Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Tools: Airflow, DBT, Docker Infrastructure & Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills Experience with … data platforms such as Snowflake or Azure Data Lake Experience deploying models as APIs (e.g. FastAPI, Azure Functions) Knowledge of monitoring, model performance tracking and observability practices Familiarity with orchestration tools such as Airflow or Azure Data Factory ...

Title: Data Architect Location: London (Hybrid – minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Data Architect to work with a high-performing data team, designing and delivering … supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable Skills and Experience Experience working with ...

Data Architect, Data Lake, AWS, Azure, Insurance, Cloud We are seeking an experienced and forward-thinking Data Architect to lead and optimise our data architecture initiatives, with a strong focus on the insurance sector. You will be responsible for designing, implementing … Computer Science, Information Technology, or a related field. This opening can be based from multiple locations Data Architect, Data Lake, AWS, Azure, Insurance, Cloud McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds. ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

distribution keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue …/Iceberg for low-cost, serverless analytics. Manage Glue Data Catalog integrations and table schema management. 5. Storage (S3) & Data Lake Architecture Design secure, cost-efficient S3 data lake structures (bronze/silver/gold zones). Implement data lifecycle ...

opportunity for you to join a leading London Market underwriter within a well-established, high-performing change and transformation function as a Senior Data Business Analyst. As the Senior Data Business Analyst, you’ll have the artistic freedom to define and shape how data … Business Analysis perspective, setting the standards, approach, and best practices for the function. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects across the change portfolio, ensuring scope, timelines, and governance standards are met within a mature change function. Serve as the first ...

critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. ...

Data Architect (DV) £Up to £100,000 GBP Transport Allowance Onsite WORKING Location: London; Manchester; Bristol, Manchester, North West - United Kingdom Type: Permanent The Role - Data Architect (DV Cleared) Join a consultancy recognised as a UK Great Place to Work year after year - a distinction that … data architecture for complex programmes, including ingestion, orchestration, governance, security, cost-optimisation, and observability Architect and implement multi-cloud, data lake, and data warehouse platforms Design scalable data pipelines, integration workflows, and analytics solutions Apply ML/AI frameworks, semantic models ...

Title: Senior Data Engineer Location: London (Hybrid – minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Senior Data Engineer to design, develop and maintain scalable data pipelines that … translate business requirements into technical solutions. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills and Experience Experience with enterprise data ...

Farringdon hybrid working available Were looking for a driven Data & Information Architect to help evolve our data and information architecture and support the delivery of our data-driven transformation. Reporting to the Head of Business Intelligence & Analytics, youll play a vital role in reviewing … improving our data flows, shaping our future-state architecture, and unlocking the value of our data assets In this role, youll work in close collaboration with our Technology and Transformation teams and represent the Data & BI team across key forums, acting as a bridge ...

Data Architect (AI Data Foundations) Location - Erskine, London, Farnborough or Newcastle Candidates are required to be eligible for clearance We are seeking an AI Data Architect to design and implement AI-ready data foundations. You will define data models, storage … patterns, pipelines, and governance frameworks that support machine learning and analytics. Working closely with data engineers and ML engineers, you will ensure data is well-structured, accessible, secure, and scalable for AI use cases. Key Responsibilities Design and maintain data models and schemas (relational ...

Principal Data Engineer (GCP) Northwest – Hybrid Up to £100,000 VIQU are seeking a Principal Data Engineer to join a leading social enterprise that reinvests profits to create thriving, sustainable communities. Following a full transition to a 100% cloud-based data platform, this role … highly preferred, with consideration for AWS or Azure alongside some GCP Experience with Terraform, Docker and dbt Strong expertise in Data Lake/Data Warehouse solutions Advanced SQL and Python skills Proven experience optimising complex queries Strong understanding of Data Governance, including lineage ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Data Engineering Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Bricks, ML, Azure, Mainly Remote Data Engineering/Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role … must have been working within Data Engineering before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance Development Framework experience within Microsoft Stack Technologies Experience with implementing ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

Data Engineering Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Bricks, ML, Azure, Mainly Remote Data Engineering/Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role … must have been working within Data Engineering before moving into Product Ownership Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance Development Framework experience within Microsoft Stack Technologies Experience with implementing ...

people who care about building things properly, you’ll fit right in. You’ll Work With Azure Data Factory, Data Lake, Key Vault, Azure Functions Databricks, Delta Lake, Unity Catalog, PySpark, Spark SQL Medallion architecture, Lakehouse patterns, distributed compute CI/CD pipelines using … thrive in this role if you have: Strong hands‐on experience with Azure Data Services and Databricks Solid understanding of Delta Lake, Medallion architecture and Lakehouse patterns Proficiency in Python, PySpark and Spark SQL Experience building CI/CD pipelines using Azure DevOps Knowledge of data ...

design and configuration. Demonstrable experience implementing the Medallion Architecture for structured data transformation. Advanced ETL/ELT development experience using PySpark, Delta Lake and Databricks SQL. Practical experience with Unity Catalog for governance, metadata management and lineage tracking. Strong knowledge of Azure Data Platform components … including Azure Data Lake, networking and security controls. Experience integrating with Microsoft Purview (desirable). Familiarity with Microsoft Fabric (desirable). Strong understanding of GDPR, data standards and compliance frameworks. Excellent documentation skills – able to produce best practice guides, templates and onboarding frameworks. Lead-level ...

architectures , covering data ingestion, identity resolution, segmentation, and activation Define how the CDP integrates with, Data lake/lakehouse platforms (e.g. Databricks), CRM and sales platforms (e.g. Salesforce), Marketing automation and engagement tools (e.g. Braze) Apply strong understanding of batch vs real-time data … martech and data architectures , spanning CDP and identity resolution, Marketing automation and engagement platforms, CRM and customer-facing systems, Data lake/lakehouse platforms (e.g. Databricks). Proven track record of leading discovery, requirements definition, and solution shaping in complex or ambiguous environments Previous exposure ...

Responsibilities . Lead the development, optimisation and governance of large-scale data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark and Unity Catalog . Partner closely with underwriting, actuarial, delegated authority, bordereaux, exposure management, reinsurance … Required Experience and Skills . Expert-level knowledge of Azure Data Services and Databricks within enterprise environments . Deep understanding of Delta Lake, Medallion architecture, distributed compute, Lakehouse patterns, data modelling and performance optimisation . Strong Python, PySpark and SQL experience, with hands-on implementation ...

Lead Data Engineer About the Role We are seeking a Lead Data Engineer to join a leading Microsoft partner specialising in modernising data platforms and delivering cutting-edge analytics solutions for organisations across the UK. In this senior position, you will take ownership … designing and delivering advanced data solutions, guiding technical strategy and providing leadership across complex client engagements. You will work closely with stakeholders to understand their business challenges and architect scalable, efficient data platforms that enable self-service analytics and long-term growth. This is a hands ...

time. Your Role: Design, develop, and optimise large-scale cloud data platforms using Azure Data Factory, Data Lake, Key Vault, Azure Functions, Databricks, Delta Lake, PySpark, and Unity Catalog. Collaborate with underwriting, actuarial, Delegated Authority, bordereaux, exposure management, reinsurance, finance, and Solvency … Your Skills: Expert-level hands-on experience with Azure Data Services and Databricks in enterprise, highly regulated environments. Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns, distributed compute, data modelling, and performance optimisation. Strong programming skills in Python, PySpark, and Spark SQL, with experience ...