1 to 25 of 30 Remote/Hybrid Data Lake Jobs in London

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Engineer Manager Hybrid - London with 2/3 days WFH Circ £85,000 - £95,000 + Attractive Bonus & Benefits This newly created Data Engineer Managers position is an excellent opportunity for someone that enjoys being hands on technically as well as managing a small team … Data Engineers. It would suit those with official management experience, or potentially a Lead or Senior Engineer used to leading teams and now looking to take on more managerial responsibility. Our client is a well-established and rapidly growing global business with its headquarters based in London. ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … warehousing concepts and dimensional modeling Proficiency in SQL and Python Experience with Azure data services such as Azure Data Lake Storage (ADLS Gen2) , Azure Data Factory , and Azure SQL Familiarity with CI/CD pipelines and version control (Git, Azure DevOps) Experience ...

Data Engineer £250 Outside IR35 - Remote Job Summary We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions on Microsoft Azure. The ideal candidate has strong hands-on experience with Azure Databricks and Azure Synapse Analytics … warehousing concepts and dimensional modeling Proficiency in SQL and Python Experience with Azure data services such as Azure Data Lake Storage (ADLS Gen2) , Azure Data Factory , and Azure SQL Familiarity with CI/CD pipelines and version control (Git, Azure DevOps) Experience ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality … production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations ...

Data Engineer - £350PD - Remote Required Technical Skills Data Pipeline & ETL Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data Hands-on experience with AWS Glue and AWS Step Functions Implementation of data validation, data quality … production pipelines Experience with incremental data processing patterns (CDC, watermarking, upserts) AWS Data Services Amazon S3: data lake architectures, partitioning strategies, lifecycle policies DynamoDB: data modeling, secondary indexes, streams, and performance optimization Amazon Redshift: foundational querying, integrations, and performance considerations ...

granular financial datasets. You’ll play a central role in shaping large-scale tick-data architecture - building pipelines, improving data-lake structures, and refining storage formats to support demanding research and trading workflows... Key Responsibilities Architect, build, and refine high-throughput pipelines capable of processing … Develop resilient, well-structured Python/OOP solutions underpinning tick-data ingestion, normalisation, storage, and replay Design and evolve data-lake patterns using Parquet and related columnar formats; introduce Iceberg-style table modelling where beneficial Implement cloud-backed processing and storage patterns - leveraging services from ...

granular financial datasets. You’ll play a central role in shaping large-scale tick-data architecture - building pipelines, improving data-lake structures, and refining storage formats to support demanding research and trading workflows... Key Responsibilities Architect, build, and refine high-throughput pipelines capable of processing … Develop resilient, well-structured Python/OOP solutions underpinning tick-data ingestion, normalisation, storage, and replay Design and evolve data-lake patterns using Parquet and related columnar formats; introduce Iceberg-style table modelling where beneficial Implement cloud-backed processing and storage patterns - leveraging services from ...

Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability … work independently in a remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking ...

Lead Data Engineer (AWS Snowflake Python) London/WFH to £110k Are you a technologist Data Engineer with strong technical leadership skills? You could be progressing your career in an impactful, hands-on Lead Data Engineer role at a growing technology company as they … expand their UK presence. As a Lead Data Engineer you'll take responsibility for the team's engineering practices such as code reviews and CI/CD and for overall code quality and test coverage. You'll plan and manage the team's Sprints, collaborating closely with product ...

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms … data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known ...

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role … scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications ...

About the Opportunity This is a unique opportunity for a Data Engineer to work at the intersection of cutting-edge technology and elite sports performance. You’ll join a collaborative, high-standard engineering team with a culture built around creativity, innovation, and excellence. In this role … scientists to enable end-to-end data workflows Own the architecture and maintenance of a GCP-based data lake/lakehouse environment Your Background 4+ years of industry experience in Data Engineering roles Advanced-level Python for data applications ...

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders … define and implement data product solutions that are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that ...

About the role We are looking for an experienced Data Product Solution Architect to drive the architecture, design, and delivery of scalable, secure, and high-performing data products. This role acts as a strategic bridge between data engineering, analytics, product management, and business stakeholders … define and implement data product solutions that are technically sound and aligned with business goals. The ideal candidate is both technically hands-on and strategically minded, capable of translating complex data requirements into scalable product architectures and enabling the delivery of data products that ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

Lead Data Engineer (SQL Python Snowflake) London/WFH to £85k Are you a skilled data technologist with strong leadership and stakeholder management skills? You could be progressing your career in a senior, hands-on Data Engineer position at a global tech company that … provide data centric software solutions to major blue-chip and government organisations to enable them to discover and analyse data and customer feedback. What's in it for you: As a Lead Data Engineer you'll earn a competitive package: Salary to £85k Bonus ...

Technical Business Analyst (BA) and Architect to drive enterprise-scale digital transformation initiatives. This role combines business analysis, solution architecture, cloud architecture, and data architecture, acting as a bridge between business stakeholders and technology teams. Key Responsibilities: Business Analysis (BA): - Engage with stakeholders to gather and document business … initiatives Cloud & Technology Leadership: - AWS: EC2, S3, RDS, Lambda, EKS, Elastic Beanstalk, IAM, Neptune - Azure: Data Factory, Databricks, Synapse, Data Lake, Event Hub, AKS, Power BI - Microservices and APIs using Java/Spring Boot - CI/CD using GitLab, Azure DevOps, Kubernetes, Helm, Terraform - Ensure ...

Python Data Engineer - Multi-Strategy Hedge Fund Location: London | Hybrid: 2 days per week on-site | Type: Full-time About the Role A leading multi-strategy hedge fund is seeking a highly skilled Python Data Engineer to join its technology and data team. This … scalable Python-based ETL pipelines for ingesting and transforming market data from multiple sources. Design and manage cloud-based data lake solutions (AWS, Databricks) for large volumes of structured and unstructured data. Implement rigorous data quality, validation, and cleansing routines to ensure accuracy ...

Senior Data Engineer Summer-Browning Associates is currently supporting our central government client, who is seeking a Senior Data Engineer for an initial three-month assignment with the option to extend. Location: Hybrid working - London, Bristol, Manchester, Birmingham, Newcastle, Exeter, Cambridge, Southampton The ideal candidate will … hold an active security clearance and strong experience in Data Engineering, with the following skills and qualifications: Proficiency in the Microsoft BI Stack, including Azure SQL, Fabric, Synapse Analytics, and Power BI. Experience in developing data products such as data warehouses, data ...

Data Engineer (Python) - Leading Asset Manager | London (Hybrid) Brand-new team. High autonomy. Big impact and high bonus! A top Asset Manager is building a new data function from scratch , and they need a sharp Data Engineer to help define and deliver their future … office, 2 days WFH (flexible when needed). The Role Build and optimise scalable data pipelines for a new Data Lake Work with Python, SQL, Spark, AWS, Docker, CI/CD Orchestrate workflows using Airflow, Prefect, or Dagster Support ETL, API integrations, and high-quality ...

Data Engineer Remote - Azure - Databricks - up to £80k I'm working with a client who are a leading Microsoft consultancy that's growing fast and shaping the future of data. They are continuing to grow, driving innovation and help clients accelerate their cloud transformation journeys. With a pipeline … cutting-edge projects, this is your chance to work at the forefront of cloud data engineering and make a real impact. You'll Work With Designing and delivering scalable projects using Databricks, Synapse & Fabric Build and optimise ETL/ELT pipelines and data models with ...

Data Engineer Remote - Azure - Databricks - up to £80k I'm working with a client who are a leading Microsoft consultancy that's growing fast and shaping the future of data. They are continuing to grow, driving innovation and help clients accelerate their cloud transformation journeys. With a pipeline … cutting-edge projects, this is your chance to work at the forefront of cloud data engineering and make a real impact. You'll Work With Designing and delivering scalable projects using Databricks, Synapse & Fabric Build and optimise ETL/ELT pipelines and data models with ...

Director of Data & AI | Microsoft Azure Stack | AI-Driven Legal Platform Workplace Type: Hybrid Location: London Salary: 130-150k The Role This is a senior leadership role for someone who wants to sit at the heart of a business where AI is already embedded into live products … platform is built on a Microsoft stack with centrally stored data: Azure Machine Learning Microsoft Fabric Databricks Centralised data lake architecture Microsoft Dynamics CRM AI-powered legal tools focused on due diligence and contract review Nice to Haves Experience working on established AI products rather ...