1 to 25 of 45 Remote Data Lake Jobs in London

We are currently working with a fast-growing insurance provider that is actively recruiting for a Data Governance Analyst to join them on a permanent basis. The role is part of a data team which is vital to the business for pricing … and risk processes, focusing on Master Data Management and Reference Data Management. You will be utilising Azure-based modern architecture, including Databricks, Data Lake etc. This is a hybrid role with three days per week on-site. Key responsibilities: Ensuring proper governance as well as accuracy and consistency across all customer and reference … quality, data lineage and similar data management concepts Comfortable working with Azure and Data Lakehouse Architecture, including Databricks, Data Lake, Data Factory Excellent experience with SQL data analysis Understanding of financial services regulations and requirements MDM tooling experience e.g. Profisee, Informatica, Microsoft MDS etc. (preferable More ❯

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions for a strategic insurance project The ideal candidate will have deep … pipelines and storage Provide technical leadership and mentoring to data engineers and developers Mandatory Skillset: Azure Cloud Services Strong experience with Azure Data Lake Azure Synapse Azure SQL and Azure Storage Azure Data Factory ADF Expertise in building and managing complex data pipelines Databricks Handson experience with Spark based … Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight If you're excited about this role then we would like to hear from you! Please apply with a copy of your CV or send More ❯

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions for a strategic insurance project The ideal candidate will have deep … pipelines and storage Provide technical leadership and mentoring to data engineers and developers Mandatory Skillset: Azure Cloud Services Strong experience with Azure Data Lake Azure Synapse Azure SQL and Azure Storage Azure Data Factory ADF Expertise in building and managing complex data pipelines Databricks Handson experience with Spark based … Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight If you're excited about this role then we would like to hear from you! Please apply with a copy of your CV or send More ❯

wants technical leadership, architectural influence, and the chance to shape a modern cloud-based data platform built on Azure Data Factory, Synapse, Data Lake, and Microsoft Fabric. The Role As Senior Data Engineer, you will: Lead the design, build, and optimisation of Azure Data Factory (ADF) ETL pipelines . … performance-optimised SQL workloads. Own and enhance Power BI datasets, semantic models, and reporting standards (major focus). Shape cloud data architecture across Azure Data Lake and Synapse environments. Play a key role in the organisations transition to Microsoft Fabric . Implement robust data quality, validation, and monitoring frameworks . Work closely with … pipelines, automation, optimisation). Strong Azure Synapse experience: warehousing, SQL pools, query tuning, stored procedures. Deep proficiency in SQL development and optimisation. Solid understanding of Azure Data Lake and cloud storage layers. Proven track record delivering Azure-based data engineering solutions. Strong communication and stakeholder engagement. Demonstrated mentoring or technical leadership experience. Desirable: Exposure to More ❯

data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. … Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure Monitor , Log Analytics , and Databricks tools. Optimise performance … Essential Skills & Experience 5+ years of experience with Azure services (Azure Data Factory, ADLS, Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks , Delta Lake , and cluster management . Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling , data More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for data governance, security … GitHub Actions, or Azure DevOps Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory Azure Synapse/SQL Pools More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows Implement best practices for data governance … GitHub Actions, or Azure DevOps Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory Azure Synapse/SQL Pools More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

Data Engineer - Azure & Databricks - £70,000 Location: Hybrid, London Employment Type: Full-time About the Role: A global leader within their relevant field is looking for an experienced Data Engineer to join a global organization and help deliver innovative data solutions. You'll work on the full data engineering and business intelligence … lifecycle, supporting analytics and AI needs across multiple business functions. Key Responsibilities: Design and implement scalable data solutions using Azure Data Services and Databricks Develop and maintain data pipelines for automated data collection and integration Create and optimize data models and transformations Build interactive dashboards and reports using Power BI … stages of processing Collaborate with cross-functional teams to define requirements and deliver solutions Requirements: Hands-on experience with Azure Data Factory, Databricks, SQL, Data Lake, Power BI Strong skills in T-SQL and DAX Experience in ETL development, data modelling, and data governance Familiarity with CI/CD pipelines and More ❯

Data Engineer - Azure & Databricks - £70,000 Location: Hybrid, London Employment Type: Full-time About the Role: A global leader within their relevant field is looking for an experienced Data Engineer to join a global organization and help deliver innovative data solutions. You'll work on the full data engineering and business intelligence … lifecycle, supporting analytics and AI needs across multiple business functions. Key Responsibilities: Design and implement scalable data solutions using Azure Data Services and Databricks Develop and maintain data pipelines for automated data collection and integration Create and optimize data models and transformations Build interactive dashboards and reports using Power BI … stages of processing Collaborate with cross-functional teams to define requirements and deliver solutions Requirements: Hands-on experience with Azure Data Factory, Databricks, SQL, Data Lake, Power BI Strong skills in T-SQL and DAX Experience in ETL development, data modelling, and data governance Familiarity with CI/CD pipelines and More ❯

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. … This opportunity is offered on a remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: Leading the design and implementation of innovative cloud … business intelligence roles. Proficiency in ETL and data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known for innovation and excellence. More ❯

Data Engineer | Hybrid | London | Databricks | Azure | 85k I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation as a trusted leader in high-value, complex projects. Today, their … you work each week. This is an organisation where world-class projects meet an environment that prioritises your well-being and career development. I'm looking for a Data Engineer who thrives on innovation and loves tackling complex data challenges. If building scalable, cloud-based solutions excites you, this is your chance to make a real … technology and stay at the forefront of the data engineering field. You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards and analytics ETL & Data Modelling: T-SQL, metadata-driven pipelines Design and implement scalable Azure-based data More ❯

Data Engineer | Hybrid | London | Databricks | Azure | 85k I'm working with a global powerhouse that's been setting the standard for excellence for over 60 years. With more than 1,000 projects delivered worldwide and a combined value exceeding $150 billion, they've earned a reputation as a trusted leader in high-value, complex projects. Today, their … you work each week. This is an organisation where world-class projects meet an environment that prioritises your well-being and career development. I'm looking for a Data Engineer who thrives on innovation and loves tackling complex data challenges. If building scalable, cloud-based solutions excites you, this is your chance to make a real … technology and stay at the forefront of the data engineering field. You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards and analytics ETL & Data Modelling: T-SQL, metadata-driven pipelines Design and implement scalable Azure-based data More ❯

Data Engineer - London - Databricks - Azure - 75k + bonus + benefits I'm currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they've established themselves as a trusted global leader in delivering high-value work. Today … worked in the office, regardless of how near or far employees live. Tech Stack: Azure | Databricks | Power BI | Python They're looking to grow their team with a Data Engineer that thrives on innovation and cutting-edge technology. If you love solving complex data challenges and building scalable solutions, this is your chance to make an … latest technology, ensuring you can be at the forefront of your field. What You'll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines What you'll do Design and implement scalable Azure More ❯

Job Title: Data Engineer Salary: £60,000 + Bonus Location: Fully Remote (UK-based) Overview We are seeking an experienced Data Engineer to join our Data team and play a key role in developing scalable, cloud-based data pipelines and infrastructure. This role will support the organisation's growing data strategy by ensuring high-quality, reliable, and accessible data for analytics, reporting, and future AI/ML capabilities. The ideal candidate will have strong expertise in Azure, Databricks, and Python, with a proven track record of building and maintaining modern data platforms. Experience in financial services is beneficial but not essential. Key Responsibilities Data Architecture & Engineering Design, build, and maintain scalable Azure-based data architectures. Develop high-performance data pipelines and transformation workflows using Databricks and Python. Ensure data platforms support analytics, business intelligence, and emerging GenAI/ML needs. Pipeline Development & Workflow Management Develop, optimise, and monitor ETL/ELT pipelines across various data More ❯

Data Analyst – London – Hybrid – 6 month FTC - £53,000 pro rata SQL – Power BI - Python A well established and growing business based in Central London (near Waterloo) are looking for a capable, confident Data Analyst with expertise in SQL and Power BI to join them on a 6 month FTC. As the organisation’s sole Data Analyst, you will play a pivotal role in delivering the operational elements of the Data Strategy. Working closely with the Director of Technology and Data, you will help drive the transformation of how they use data, enhancing insight, decision-making and impact across the organisation. The primary goal is to ensure that … and drive the development of advanced analytics, including predictive and prescriptive models. Initiate and manage pilots of ethical AI and machine learning use cases within the data lake(s). Identify, scope and implement opportunities to automate manual processes and enhance reporting efficiency. To be suitable for this Data Analyst role you will have the More ❯

of millions of policies and raised over $200 million in funding. And we're only just getting started. About the Role We're looking for a Head of Data Engineering to lead and grow our high-impact team of four Data Engineers. You'll play a pivotal role in shaping the future of Zego's data infrastructure- ensuring it scales with our ambitions while remaining resilient, efficient, and safeguarding user data privacy. This is a hands-on leadership role that combines technical depth, strategic vision, and team enablement. You'll partner with cross-functional leaders in Engineering, Data Science, Analytics, and Product to drive our data strategy, evolve … feedback, and knowledge sharing. Pragmatic Problem-Solving: Comfortable balancing technical excellence with business priorities and constraints Nice to have Experience building Data Mesh or Data Lake architectures. Familiarity with Kubernetes, Docker, and real-time streaming (e.g. Kafka, Kinesis). Exposure to ML engineering pipelines or MLOps frameworks. What's it like to work at Zego More ❯

cutting-edge analytics solutions that make a real impact. This role combines hands-on technical expertise with strategic thinking. Enabling clients to unlock insights and value from their data using Microsoft’s latest analytics stack. As an expert in Power BI and Microsoft Fabric, you’ll architect scalable, modern data solutions that unlock real business value … and guide delivery teams through implementation. With your deep knowledge in Power BI, Microsoft Fabric, and Azure data services, and your passion for innovation, technical expertise with strategic thinking to support data-driven transformation. Here, you’ll partner with stakeholders, guide delivery teams, and help clients harness the full potential of Microsoft’s newest analytics ecosystem. … of Microsoft Fabric architecture and components Expertise in Microsoft Fabric Data Engineering Fabric Dataflows/Azure Data Factory Experience with Azure Synapse, Data Lake, SQL, and integration pipelines Desirable: Experience with other low-code or analytics platforms Knowledge of data governance frameworks and security models Microsoft certifications (e.g., Power BI Data More ❯

Azure Data Engineer (Databricks Specialist) About the Role We are seeking an experienced Azure Data Engineer with a strong focus on Databricks to join our team on a 3-month contract. This role is fully remote and outside IR35, offering flexibility and competitive day rates. You will play a key role in designing, building, and optimising … scalable data solutions in Azure, with Databricks at the core of the project. Responsibilities* Design and implement data pipelines using Azure Databricks.* Collaborate with developers, analysts, and DevOps teams to ensure smooth data integration.* Optimise performance of large-scale data processing workloads.* Work with stakeholders to understand application state and data … governance, security, and compliance. Key Skills & Experience* Proven experience as an Azure Data Engineer.* Strong hands-on expertise with Databricks - 5+ years experience (PySpark, notebooks, clusters, Delta Lake).* Solid knowledge of Azure services (Data Lake, Synapse, Data Factory, Event Hub).* Experience working with DevOps teams and CI/CD pipelines. More ❯

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Mainly Remote Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has come … background with a hardened skillset in Microsoft Stack Technologies (C# .NET Core) who has then transitioned into Product Ownership. We need someone highly analytical who can understand large Data Sets, Data Bricks and is able to bring Proof of Concepts to the table and help with the execution. The platform primarily serves two key personas: Data … for more details... Experience required: Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management: Demonstrated expertise More ❯

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe and the States on occasions. We need someone who has … background with a hardened skillset in Microsoft Stack Technologies (C# .NET Core) who has then transitioned into Product Ownership. We need someone highly analytical who can understand large Data Sets, Data Bricks and is able to bring Proof of Concepts to the table and help with the execution. The platform primarily serves two key personas: Data … for more details Experience required: Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly valued. Backlog management:Demonstrated expertise More ❯

Technical Lead - Data - £85,000 Location: UK - Remote Employment Type: Full-time, Permanent About the Role A Microsoft Partnered Consultancy is looking for a Technical Data Team Lead - to join a dynamic, agile team delivering innovative data solutions for clients. This is a hands-on leadership role where you'll mentor technical consultants, oversee … project delivery, and contribute to designing scalable data solutions in cloud environments. Key Responsibilities: Lead and mentor a team of technical consultants, driving engagement and growth. Manage resource planning, scheduling, and performance development. Collaborate with pre-sales and project teams to scope and deliver data projects. Support technical delivery, including cloud migrations, data lakes … using Microsoft/Azure technologies (Fabric, Databricks, Synapse, Data Factory, SQL Server). Expertise in ETL/ELT processes, SQL, and Python. Knowledge of data lake implementation and medallion lakehouse architecture. Solid understanding of BI, data warehousing concepts, and optimization techniques for large-scale solutions. What's on Offer Competitive salary and benefits More ❯

Technical Lead - Data - £85,000 Location: UK - Remote Employment Type: Full-time, Permanent About the Role A Microsoft Partnered Consultancy is looking for a Technical Data Team Lead - to join a dynamic, agile team delivering innovative data solutions for clients. This is a hands-on leadership role where you'll mentor technical consultants, oversee … project delivery, and contribute to designing scalable data solutions in cloud environments. Key Responsibilities: Lead and mentor a team of technical consultants, driving engagement and growth. Manage resource planning, scheduling, and performance development. Collaborate with pre-sales and project teams to scope and deliver data projects. Support technical delivery, including cloud migrations, data lakes … using Microsoft/Azure technologies (Fabric, Databricks, Synapse, Data Factory, SQL Server). Expertise in ETL/ELT processes, SQL, and Python. Knowledge of data lake implementation and medallion lakehouse architecture. Solid understanding of BI, data warehousing concepts, and optimization techniques for large-scale solutions. What's on Offer Competitive salary and benefits More ❯