1 to 25 of 91 Data Lake Jobs in London

Head of Data – Data Architecture, Data Strategy/Governance, Data Science/Analysis/Engineering; frameworks, data operating model (TOM), compliance, risk, automation; management information (MI) reporting, PowerBI, SQL, ADF, Azure Data Warehousing/Data Lakes. Permanent, London/Hybrid (3/2) c.£150k (Negotiable … +Bonus +Benefits Global organisation seeks Head of Data to lead strategy around data architecture, data governance, platform enhancement and MI reporting development across all systems which support business decisions and improve operations. Working in a senior level capacity, initially within an individual contributors role (initially) the Head of Data will undertake a … number of strategic and tactical duties including: Developing data initiatives in line with wider business strategy Engage with senior business leaders and technology management to design a Target Data Operating Model Develop the firms AI/NLP strategy, roadmap and capability utilising emerging data science approaches where applicable Optimise existing technology to support/ More ❯

Head of Data Data Architecture, Data Strategy/Governance, Data Science/Analysis/Engineering; frameworks, data operating model (TOM), compliance, risk, automation; management information (MI) reporting, PowerBI, SQL, ADF, Azure Data Warehousing/Data Lakes. Permanent, London/Hybrid (3/2) c.£150k (Negotiable … +Bonus +Benefits Global organisation seeks Head of Data to lead strategy around data architecture, data governance, platform enhancement and MI reporting development across all systems which support business decisions and improve operations. Working in a senior level capacity, initially within an individual contributors role (initially) the Head of Data will undertake a … number of strategic and tactical duties including: Developing data initiatives in line with wider business strategy Engage with senior business leaders and technology management to design a Target Data Operating Model Develop the firms AI/NLP strategy, roadmap and capability utilising emerging data science approaches where applicable Optimise existing technology to support/ More ❯

We are currently working with a fast-growing insurance provider that is actively recruiting for a Data Governance Analyst to join them on a permanent basis. The role is part of a data team which is vital to the business for pricing … and risk processes, focusing on Master Data Management and Reference Data Management. You will be utilising Azure-based modern architecture, including Databricks, Data Lake etc. This is a hybrid role with three days per week on-site. Key responsibilities: Ensuring proper governance as well as accuracy and consistency across all customer and reference … quality, data lineage and similar data management concepts Comfortable working with Azure and Data Lakehouse Architecture, including Databricks, Data Lake, Data Factory Excellent experience with SQL data analysis Understanding of financial services regulations and requirements MDM tooling experience e.g. Profisee, Informatica, Microsoft MDS etc. (preferable More ❯

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Architecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North … and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution … of data modelling, data integration, metadata management, and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts More ❯

Enterprise Data Architect/Senior Solution Data Architect/Head of Data Architecture Data is responsible for shaping, governing, and enabling data-centric solution design across the clients global technology landscape. The role ensures that all data and analytics solutions align to enterprise architecture principles, support the North … and governed data. Working across programmes such as UNIFY (SAP S/4HANA), Integrated Supply Chain (Blue Yonder), and Sales Excellence (Salesforce CGC), the role bridges business strategy, data architecture, and solution delivery to ensure a unified enterprise data fabric and analytics capability. Key Accountability's Solution Leadership Lead end-to-end data solution … of data modelling, data integration, metadata management, and data governance. Experience with modern data platforms such as Azure Data Lake, Databricks, Power BI, and SAP BTP. Solid grasp of enterprise integration patterns (APIs, streaming, ETL/ELT, event-driven architectures). Ability to translate complex data concepts More ❯

Data Architect (Azure) 6 Month Contract UK Based Via Umbrella Our UK leading life and pensions client are looking for a Data Architect to joun their team on an initial 6 month contract. Key Responsibilities Data Architecture & Design Define and maintain enterprise data architecture standards, models, and frameworks. Design data solutions leveraging Azure services such as Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, Azure Data Factory, and Azure Databricks. Data Integration & ETL Develop and optimize data pipelines for ingestion, transformation … best practices in data architecture. Required Skills & Experience Technical Expertise Extensive experience with Azure Data Services: Data Factory, Databricks, Synapse, Data Lake, Azure SQL. Strong understanding of data modeling, data warehousing, and distributed computing. Proficiency in Python, SQL, and Spark for data engineering tasks. Financial More ❯

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions for a strategic insurance project The ideal candidate will have deep … pipelines and storage Provide technical leadership and mentoring to data engineers and developers Mandatory Skillset: Azure Cloud Services Strong experience with Azure Data Lake Azure Synapse Azure SQL and Azure Storage Azure Data Factory ADF Expertise in building and managing complex data pipelines Databricks Handson experience with Spark based … Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight If you're excited about this role then we would like to hear from you! Please apply with a copy of your CV or send More ❯

Adword Job Title: Data Architect (Insurance Domain) Location: London UK Hybrid role Responsibilities: Experience Level 15 years with at least 5 years in Azure ecosystem Role: We are seeking a seasoned Data Architect to lead the design and implementation of scalable data solutions for a strategic insurance project The ideal candidate will have deep … pipelines and storage Provide technical leadership and mentoring to data engineers and developers Mandatory Skillset: Azure Cloud Services Strong experience with Azure Data Lake Azure Synapse Azure SQL and Azure Storage Azure Data Factory ADF Expertise in building and managing complex data pipelines Databricks Handson experience with Spark based … Mandatory Skills: Python for DATA,Java,Python,Scala,Snowflake,Azure BLOB,Azure Data Factory, Azure Functions, Azure SQL, Azure Synapse Analytics, AZURE DATA LAKE,ANSI-SQL,Databricks,HDInsight If you're excited about this role then we would like to hear from you! Please apply with a copy of your CV or send More ❯

You will share your technical knowledge and experiences, delivering impact, learning, and growth across teams at Recursion. The Team You'll Join You will join the Data Lake team that built and maintains our Data Lake/house. The team is responsible for relational and object storage and has the motto: all data … of large datasets. Up to date on industry trends and tools. You understand the tradeoffs between different data platform architectures and technologies like a data lake, a data warehouse and can draw on this knowledge to develop data platforms solutions for Recursion. Excitement to learn parts of our tech stack that … and operating one of the most powerful supercomputers in the world, Recursion is uniting technology, biology and chemistry to advance the future of medicine. Recursion is headquartered in Salt Lake City, where it is a founding member of BioHive, the Utah life sciences industry collective. Recursion also has offices in Toronto, Montréal, New York, London, Oxford area, and the More ❯

wants technical leadership, architectural influence, and the chance to shape a modern cloud-based data platform built on Azure Data Factory, Synapse, Data Lake, and Microsoft Fabric. The Role As Senior Data Engineer, you will: Lead the design, build, and optimisation of Azure Data Factory (ADF) ETL pipelines . … performance-optimised SQL workloads. Own and enhance Power BI datasets, semantic models, and reporting standards (major focus). Shape cloud data architecture across Azure Data Lake and Synapse environments. Play a key role in the organisations transition to Microsoft Fabric . Implement robust data quality, validation, and monitoring frameworks . Work closely with … pipelines, automation, optimisation). Strong Azure Synapse experience: warehousing, SQL pools, query tuning, stored procedures. Deep proficiency in SQL development and optimisation. Solid understanding of Azure Data Lake and cloud storage layers. Proven track record delivering Azure-based data engineering solutions. Strong communication and stakeholder engagement. Demonstrated mentoring or technical leadership experience. Desirable: Exposure to More ❯

We’re looking for an innovative Data Architect to lead the creation and rollout of a comprehensive Data Governance Strategy, alongside the implementation of a data platform. This role will be instrumental in ensuring organizational data is accurate, secure, compliant, and strategically utilized to unlock business value. This is a new role … created due to growth, offering an exciting opportunity to shape and lead our data governance and platform strategy from the ground up. Key responsibilities Design and implement a comprehensive data governance framework. Define and maintain data governance policies, standards, and procedures. Establish and lead a cross-functional Data Governance Council. Collaborate with … data architecture and modelling is required, including conceptual, logical, and physical data modelling, as well as expertise in data warehousing, data lake architecture, and Master Data Management (MDM). The role also demands proficiency in data integration and ETL processes, including the design and orchestration of data More ❯

Analytics Engineer - London Job Title: Analytics Engineer Location: SE1, London (Southwark) Reports to: Head of Data & Analytics Department: Data & Analytics and/or Category & Product Type: Full-time in office Role Overview Black Sheep Coffee is seeking a skilled and motivated Analytics Engineer to design, develop, and maintain our Azure-based data infrastructure while … delivering actionable insights to support data-driven decision-making across the organization. As part of the Category & Product team, this role blends data engineering and analytics expertise to enable seamless integration of data systems, optimize workflows, and empower strategic initiatives. The ideal candidate will have a strong technical foundation in SQL, data … or Analytics Engineer, preferably within the retail or hospitality industry. Proficiency in Azure Data Factory and other Azure services (e.g., Azure SQL Database, Azure Data Lake). Strong SQL skills with experience in relational databases (e.g., SQL Server). Expertise in data modelling, ETL workflows, and data warehousing concepts. Knowledge of More ❯

data into structured, analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage . Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools for controlled and reproducible deployments. … Databricks Development Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure Monitor , Log Analytics , and Databricks tools. Optimise performance … Essential Skills & Experience 5+ years of experience with Azure services (Azure Data Factory, ADLS, Azure SQL Database, Synapse Analytics). Strong hands-on expertise in Databricks , Delta Lake , and cluster management . Proficiency in SQL and Python for pipeline development. Familiarity with Git/GitHub and CI/CD practices. Understanding of data modelling , data More ❯

Azure Data Engineer VIQU has partnered with a leading Telecommunications organisation seeking an experienced Azure Data Engineer to design, develop, and manage scalable data solutions on the Microsoft Azure platform. You’ll play a key role in architecting and implementing robust data integration solutions, as well as building ETL pipelines to support … data ingestion, transformation, and loading. The Role:As an Azure data engineer, you’ll collaborate with cross-functional teams in an agile environment — contributing to sprint planning, daily stand-ups, and other agile ceremonies. Strong communication skills are essential, as you’ll often translate complex data concepts into clear insights for non-technical stakeholders. … Microsoft Azure. Strong expertise in data modelling, data warehousing, and ETL development. Hands-on experience with Azure Data Factory, Azure Data Lake, and Azure SQL Database. Exposure to big data technologies such as Hadoop, Spark, and Databricks. Experience with Azure Synapse Analytics or Cosmos DB. Familiarity with data More ❯

DATA ARCHITECT - DV CLEARED NEW PERMANENT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ARCHITECT WITH ENHANCED DV CLEARANCE Permanent job opportunity for a Data Architect Leading National Security SME Salary up to £100,000 + Bonus London based organisation in an easily accessible location To apply please call or … email WHO WE ARE? We are recruiting multiple a Data Architect to support urgent National Security & Defence projects in London. Due to the nature of these projects you must hold enhanced DV Security Clearance. WHAT WILL THE DATA ARCHITECT BE DOING? You will be joining a leading SME who is working hard to support National Security … projects within UK Govt. Departments in London. As part of a team, you will be responsible for designing and implementing Data Solutions in Mission-Critical areas. WE NEED THE DATA ARCHITECT TO HAVE.... Current DV clearance - Enhanced Good at understanding complexity and abstracting that into a form that is consumable for a non-technical audience. Experience More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricksworkflows Implement best practices for data governance, security … GitHub Actions, or Azure DevOps Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory Azure Synapse/SQL Pools More ❯

Databricks Engineer - £400PD - Remote About the Role We are seeking a highly skilled Azure Data Engineer with deep, hands-on Databricks experience to join our growing data engineering team. In this role, you will design, build, and optimise scalable data pipelines and lakehouse architectures on Azure, enabling advanced analytics and data-driven … Responsibilities Design, develop, and maintain ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake. Build and optimise data lakehouse architectures on Azure Data Lake Storage ( ADLS ) . Develop high-performance data solutions using Azure Synapse, Azure Data Factory, and Databricks workflows Implement best practices for data governance … GitHub Actions, or Azure DevOps Required Skills & Experience 3+ years' experience as a Data Engineer working in Azure environments. Strong hands-on experience with Databricks (PySpark, Delta Lake, cluster optimisation, job scheduling). Solid knowledge of Azure cloud services including: Azure Data Lake Storage Azure Data Factory Azure Synapse/SQL Pools More ❯

Senior Data Architect Joining Capco means joining an organisation that is committed to an inclusive working environment where you're encouraged to Be Yourself At Work. We celebrate individuality and recognize that diversity and inclusion, in all forms, is critical to success. It's important to us that we recruit and develop as diverse a range of talent … Focused on maintaining our nimble, agile and entrepreneurial culture. Your Capco Day/Key Responsibilities You will accompany and lead complex agile consulting projects supporting our clients with data architecture design and delivery. You will work with technology leaders across Financial Services to provide best practice guidance for data management and data architecture development … . Knowledge of the relevant procedures, architectures and technologies in one or more of the following topics: Contextual Datamodelling, Entity Relationship Modelling, Logical & Physical Datamodelling and Data Lake design. Experience designing and implementing cloud data migration and storage patterns on one or more of AWS, GCP and Microsoft Azure Experience implementing and integrating data More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

An opportunity has arisen for a Senior Data Engineer to join a well-established biotech company using large-scale genetic data and AI to predict disease risk and advance precision healthcare. As a Senior Data Engineer , you will be responsible for developing, automating, and optimising scalable data pipelines using modern cloud technologies. … with hybrid/remote working options offering a salary of £500 - £650 per day (Inside IR35) and benefits. You Will Be Responsible For: Designing and implementing cloud-based data architectures using Azure services. Building robust and scalable data pipelines to support complex, high-volume processing. Deploying and managing containerised workloads through Kubernetes, Helm, and Docker. Automating … Code tools (Terraform, Ansible). Hands-on experience with PostgreSQL and familiarity with lakehouse technologies (e.g. Apache Parquet, Delta Tables). Exposure to Spark, Databricks, and data lake/lakehouse environments. Understanding of Agile development methods, CI/CD pipelines, GitHub, and automated testing. Practical experience monitoring live services using tools such as Grafana, Prometheus, or New More ❯

support and managed services offerings, they are seeking an experienced Service Delivery Manager to join their team. Role overview Our client is looking for an experienced and talented Data Solution Architect who will help to grow our data delivery team: architecting, designing and implementing large-scale Data Platform, Business Intelligence (BI) and Analytics solutions … for our clients. The role is highly technical and requires a robust understanding and hands-on expertise of Microsoft Azure cloud technologies, data architecture and modelling concepts. The role also demands strong analytical, problem solving, and planning skills. The role requires strong communication and collaboration skills and the motivation to achieve results in a dynamic business environment. Job … a similar senior role Experience in designing and implementing Azure Data solutions using services such as: Microsoft Fabric Azure Synapse Analytics Azure Databricks Azure Data Lake Storage Gen2 Azure SQL Database Azure Data Factory Azure DevOps Azure Stream Analytics Microsoft Power BI Familiar with Azure Purview An understanding of Master Data More ❯

Data Engineer - Azure & Databricks - £70,000 Location: Hybrid, London Employment Type: Full-time About the Role: A global leader within their relevant field is looking for an experienced Data Engineer to join a global organization and help deliver innovative data solutions. You'll work on the full data engineering and business intelligence … lifecycle, supporting analytics and AI needs across multiple business functions. Key Responsibilities: Design and implement scalable data solutions using Azure Data Services and Databricks Develop and maintain data pipelines for automated data collection and integration Create and optimize data models and transformations Build interactive dashboards and reports using Power BI … stages of processing Collaborate with cross-functional teams to define requirements and deliver solutions Requirements: Hands-on experience with Azure Data Factory, Databricks, SQL, Data Lake, Power BI Strong skills in T-SQL and DAX Experience in ETL development, data modelling, and data governance Familiarity with CI/CD pipelines and More ❯

Data Engineer - Azure & Databricks - £70,000 Location: Hybrid, London Employment Type: Full-time About the Role: A global leader within their relevant field is looking for an experienced Data Engineer to join a global organization and help deliver innovative data solutions. You'll work on the full data engineering and business intelligence … lifecycle, supporting analytics and AI needs across multiple business functions. Key Responsibilities: Design and implement scalable data solutions using Azure Data Services and Databricks Develop and maintain data pipelines for automated data collection and integration Create and optimize data models and transformations Build interactive dashboards and reports using Power BI … stages of processing Collaborate with cross-functional teams to define requirements and deliver solutions Requirements: Hands-on experience with Azure Data Factory, Databricks, SQL, Data Lake, Power BI Strong skills in T-SQL and DAX Experience in ETL development, data modelling, and data governance Familiarity with CI/CD pipelines and More ❯

Data Architect - Fully Remote role Data Architect sought by a well-established Data & Analytics consultancy. Our client is seeking a cloud professional to spearhead strategic leadership and technical expertise within their data solutions landscape, focussed on cloud data platforms, but including IoT analytics, data integration, and migration projects. … This opportunity is offered on a remote-first basis, but with an open invitation to their headquarters any time. Role Responsibilities: The Data Architect will be pivotal in shaping the approach to designing and developing data solutions using cloud technologies such as AWS and Azure. This position involves: Leading the design and implementation of innovative cloud … business intelligence roles. Proficiency in ETL and data pipeline design, with a technology-agnostic approach. A solid understanding of data warehouse and data lake principles. Expert SQL skills and demonstrable data modelling capabilities. About the Company: Our client is a well-established organisation in their field, known for innovation and excellence. More ❯