76 to 100 of 153 Data Lake Jobs in the UK

Head of Data Data Architecture, Data Strategy/Governance, Data Science/Analysis/Engineering; frameworks, data operating model (TOM), compliance, risk, automation; management information (MI) reporting, PowerBI, SQL, ADF, Azure Data Warehousing/Data Lakes. … Permanent, London/Hybrid (3/2) c.£150k (Negotiable) +Bonus +Benefits Global organisation seeks Head of Data to lead strategy around data arc click apply for full job details ...

hiring a senior Data Engineer to lead the development of intelligent, scalable data platforms for Industry 4.0 initiatives. This role will drive integration across OT/IT systems, enable real-time analytics, and ensure robust data governance and quality frameworks. The engineer will collaborate … generation, and prompt engineering. Mandatory Skills: Cloud Platforms:Deep experience with AWS (S3, Lambda, Glue, Redshift) and/or Azure (Data Lake, Synapse). Programming & Scripting:Proficiency in Python, SQL, PySpark etc. ETL/ELT & Streaming:Expertise in technologies like Apache Airflow, Glue, Kafka, Informatica, EventBridge ...

Title: Senior Systems Developer DETAILS We are seeking a highly skilled Senior Systems Developer with extensive experience in data architecture, system design, and enterprise-level application development. The successful candidate will be responsible for constructing scalable systems, designing robust data models, and guiding the technical direction … backend and data-driven solutions across the organisation. DUTIES & RESPONSIBILITIES · Design, develop, and maintain sophisticated backend systems, APIs, and services. · Lead architectural decisions to ensure systems are scalable, secure, and high-performing. · Implement best practices for software engineering, and cloud-native development. · Collaborate with cross-functional teams (Data ...

Data Management Lead S/4HANA Hybrid - Ormskirk| £75,000 + Excellent Benefits Are you a data professional ready to take the lead in shaping a large-scale digital transformation? We're looking for an experienced Data Management Lead to define and deliver … long-term data strategy that underpins both our ERP programme and the wider digital landscape. This is a senior, high-impact role that combines strategic vision with hands-on delivery You'll take ownership of the data workstream for a major ERP harmonisation initiative, ensuring ...

Data Engineer Our financial services client based in Reading is looking to recruit an experienced Data Engineer to join ASAP. The position will be fully remote working with occasional visits to their offices in Reading. To be considered for the role you must have the following … Data Factory. Basic understanding of Azure Fabric and appropriate implementation. Familiarity with the management and use cases of Azure Data Lake Storage. Familiarity with the development of analytics Azure Synapse. Familiarity with Azure database service with strong knowledge of the SQL language. An understanding ...

What you'll bring: Strong Python & TDD skills Expertise in modern data architecture (dimensional modelling, data mesh, data lake) & best practices (agile, CI/CD, IaC, observability). Experience with Cloud and big data technologies (e.g. Spark/Databricks/Delta … Lake/BigQuery). Familiarity with eventing technologies (e.g. Event Hubs/Kafka) and file formats such as Parquet/Delta/Iceberg. Want to learn more? Get in touch for an informal chat. ...

batch and streaming workloads Develop Fabric dataflows, pipelines, and semantic models Implement complex transformations, joins, aggregations and performance tuning Build and optimise Delta Lake/delta tables Develop secure data solutions including role-based access, data masking and compliance controls Implement data validation … DataFrames Microsoft Fabric (Fabric Spark jobs, dataflows, pipelines, semantic models) Azure: ADLS, cloud data engineering, notebooks Python programming; Java exposure beneficial Delta Lake/Delta table optimisation experience Git/GitLab, CI/CD pipelines, DevOps practices Strong troubleshooting and problem-solving ability Experience with lakehouse architectures ...

Azure Data Engineer (Databricks Specialist) About the Role We are seeking an experienced Azure Data Engineer with a strong focus on Databricks to join our team on a 3-month contract. This role is fully remote and outside IR35, offering flexibility and competitive day rates. … Skills & Experience* Proven experience as an Azure Data Engineer.* Strong hands-on expertise with Databricks - 5+ years experience (PySpark, notebooks, clusters, Delta Lake).* Solid knowledge of Azure services (Data Lake, Synapse, Data Factory, Event Hub).* Experience working with DevOps teams ...

supporting an organisation that’s undergoing a large scale digital transformation, and they’re looking for a Data Engineer who can help design and build the foundations of a modern data ecosystem. If you enjoy creating scalable, efficient pipelines and working closely with analysts and transformation … teams, this is a great fit. The Role You’ll play a key part in shaping the organisation’s data infrastructure. The work spans architecture, engineering, data quality, governance and cross team collaboration. You’ll be involved in everything from ingesting and transforming data ...

regulated environment Job Summary: We are searching for an Enterprise Architect on behalf of a progressive financial services firm. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure, with Data architecture as the cornerstone of their digital ecosystem.This … while solving complex data integration, quality, and lineage challenges. Deep knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI. This role is perfect for a strategic thinker who can bridge business objectives with technical execution, translating data ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Mainly Remote Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency: Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

Technical Lead - Data - £85,000 Location: UK - Remote Employment Type: Full-time, Permanent About the Role A Microsoft Partnered Consultancy is looking for a Technical Data Team Lead - to join a dynamic, agile team delivering innovative data solutions for clients. This is a hands … Fabric, Databricks, Synapse, Data Factory, SQL Server). Expertise in ETL/ELT processes, SQL, and Python. Knowledge of data lake implementation and medallion lakehouse architecture. Solid understanding of BI, data warehousing concepts, and optimization techniques for large-scale solutions. What ...

Technical Lead - Data - £85,000 Location: UK - Remote Employment Type: Full-time, Permanent About the Role A Microsoft Partnered Consultancy is looking for a Technical Data Team Lead - to join a dynamic, agile team delivering innovative data solutions for clients. This is a hands … Fabric, Databricks, Synapse, Data Factory, SQL Server). Expertise in ETL/ELT processes, SQL, and Python. Knowledge of data lake implementation and medallion lakehouse architecture. Solid understanding of BI, data warehousing concepts, and optimization techniques for large-scale solutions. What ...

Protocol (MCP) for advanced context-aware analytics and automation. Develop and maintain security analytics and data pipelines within Sentinel Data Lake to support large-scale threat detection, incident response, and threat hunting, while optimizing cost and enabling Agentic AI-driven security operations. Integrate and automate … team of Cyber Defence Security Engineers. The Requirements: Must-Have Skills: Microsoft Sentinel Expertise : Architecture, deployment, management, including AI for Security, Data Lake optimization, MCP, and Sentinel Graph. Cloud Security Tools : Hands-on with Wiz Cloud (Defend, Runtime Sensor, Code), CSPM, and CWP. Automation & Integration : Using Sentinel ...

Role Overview A leading financial services provider is embarking on a major data transformation, building a modern architecture with Microsoft and Databricks technologies to become a truly data-driven organisation. As part of our client's programme and management information team, we are seeking a Data … Power BI (Desktop, Service, DAX). Expertise in Data Modelling and Schema creation. Strong experience with Databricks and Azure Data Lake design. Proficiency in SQL, ETL frameworks, and database management systems. Analytical mindset with proven problem-solving abilities. Excellent communication, coaching, and teamwork skills ...

Data Engineering Consultant - £50,000 - Hybrid As a Data Engineer, you will work within an agile team to deliver high-value data solutions for clients. You'll be hands-on across the full lifecycle, using and developing your technical and project skills to create …/ELT pipelines using Azure Synapse, Data Factory, Databricks, or Fabric, with SQL and Python. Strong understanding of data lake and lakehouse architectures. Experience working with large, complex datasets from diverse sources. Strong SQL and Python capabilities, including stored procedures, notebooks, and query optimisation. Familiarity ...

Data Engineering Consultant - £50,000 - Hybrid As a Data Engineer, you will work within an agile team to deliver high-value data solutions for clients. You'll be hands-on across the full lifecycle, using and developing your technical and project skills to create …/ELT pipelines using Azure Synapse, Data Factory, Databricks, or Fabric, with SQL and Python. Strong understanding of data lake and lakehouse architectures. Experience working with large, complex datasets from diverse sources. Strong SQL and Python capabilities, including stored procedures, notebooks, and query optimisation. Familiarity ...

build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning to ensure cost-efficient, high-performing workloads. … governance best practices. Develop PySpark applications for ETL, data transformation, and analytics, following modular and reusable design principles. Create and manage Delta Lake tables with ACID compliance, schema evolution, and time travel for versioned data management. Integrate Databricks solutions with Azure services such as Azure ...

build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning to ensure cost-efficient, high-performing workloads. … governance best practices. Develop PySpark applications for ETL, data transformation, and analytics, following modular and reusable design principles. Create and manage Delta Lake tables with ACID compliance, schema evolution, and time travel for versioned data management. Integrate Databricks solutions with Azure services such as Azure ...

Data Engineering team lead - £70,000 - Hybrid Overview We're looking for a Lead Technical Consultant to guide a team of Technical Consultants, oversee delivery of high-quality data solutions, and collaborate across the business to ensure successful project outcomes. This role combines leadership, resource management … Innovation Support technical delivery when needed, including designing scalable Azure/Microsoft data solutions. Drive innovation through cloud migrations, data lake implementations, and robust ETL/ELT pipeline development. Skills & Experience You'll thrive in this role if you have: Leadership Proven ability to build ...

Data Engineering team lead - £70,000 - Hybrid Overview We're looking for a Lead Technical Consultant to guide a team of Technical Consultants, oversee delivery of high-quality data solutions, and collaborate across the business to ensure successful project outcomes. This role combines leadership, resource management … Innovation Support technical delivery when needed, including designing scalable Azure/Microsoft data solutions. Drive innovation through cloud migrations, data lake implementations, and robust ETL/ELT pipeline development. Skills & Experience You'll thrive in this role if you have: Leadership Proven ability to build ...

Cleared Contract £400-£458pd (Inside IR35) SC Clearance is Essential Summary Were looking for a Python Data Engineer skilled in PySpark, Delta Lake, Azure services, containerized development, and Behave-based testing. Youll design and build scalable data pipelines and maintain high-quality, test-driven code … pipelines for data ingestion, processing, and validation. Write unit and BDD tests using Behave, including mocking and patching. Create and optimize Delta Lake tables for reliable, performant data storage. Use Docker to manage consistent development, testing, and deployment environments. Build configurable, parameter-driven code ...

engineering solutions. Key requirements: Proven experience as a Data Engineer with Active Security Clearance (SC) Strong experience with Databricks, PySpark and Delta Lake Expertise in Jobs & Workflows, cluster tuning, and performance optimisation Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies) Hands-on with … Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions Familiarity with CI/CD for Databricks deployments Strong troubleshooting in distributed Data environments Excellent communication and collaboration skills Nice to have: Immediate availability Experience with enterprise-scale Databricks environments Knowledge of Azure Synapse, Power ...

engineering solutions. Key requirements: Proven experience as a Data Engineer with Active Security Clearance (SC) Strong experience with Databricks, PySpark and Delta Lake Expertise in Jobs & Workflows, cluster tuning, and performance optimisation Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies) Hands-on with … Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions Familiarity with CI/CD for Databricks deployments Strong troubleshooting in distributed Data environments Excellent communication and collaboration skills Nice to have: Immediate availability Experience with enterprise-scale Databricks environments Knowledge of Azure Synapse, Power ...