26 to 50 of 60 Data Lake Jobs in the South East

with some of the following and be able to learn new technologies or concepts quickly: Deep experience with Databricks on Microsoft Azure, including Delta Lake, Unity Catalog, Delta Live Tables, PySpark and Databricks SQL, alongside complementary services such as Azure Data Factory, Synapse Analytics, and Microsoft Fabric. … Designing and implementing Lakehouse architectures in Databricks to unify data warehousing and data lake capabilities, enabling scalable analytics and governance. Building and orchestrating Databricks notebooks, Delta Live Tables, Databrick Jobs and integration with Azure Data Factory for enterprise-scale data ingestion ...

Data Engineer Our financial services client based in Reading is looking to recruit an experienced Data Engineer to join ASAP. The position will be fully remote working with occasional visits to their offices in Reading. To be considered for the role you must have the following … Data Factory. Basic understanding of Azure Fabric and appropriate implementation. Familiarity with the management and use cases of Azure Data Lake Storage. Familiarity with the development of analytics Azure Synapse. Familiarity with Azure database service with strong knowledge of the SQL language. An understanding ...

Senior Data Engineer, Azure London/hybrid Circa £90k-£100k + bonus + benefits Senior Data Engineer required by global banking organisation to help build and scale a modern data platform within a complex financial services environment. This role plays a key part … with technologies such as Azure Data Factory, Synapse, SQL Server and Power BI Solid understanding of data warehousing, lakehouse and datalake architectures Familiarity with modern data engineering patterns (ETL/ELT, medallion architecture, observability) Excellent Python and SQL skills Experience working with Apache Spark ...

Technology Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Engineering, ML, Azure, Remote with Travel Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role, but when travel is required (to London, Europe … Development FIRST mentality. You must have been a Developer before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance. Experience with implementing and optimising scalable cloud infrastructure is highly ...

Data Migration Engineer (Dynamics CE Focus/ERP) Permanent | Fully remote, competitive salary + bonus We are looking for a hands-on Data Migration Engineer to join a fast-growing, acquisition-led organisation. Your core mission will be to migrate operational (CRM) and in time, finance … into Dynamics (or similar ERP platforms) Experience working with messy, real-world data Exposure to Azure-based environments (Data Lake, Fabric, etc.) Why Join? High visibility, business-critical role Direct ownership of outcomes Exposure to multiple systems and acquisitions Opportunity to become ...

cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook. Inviting Applications for the role … MLOps concepts, model registration, deployment (AKS, ACI), and monitoring. • Hands-on experience with Azure data services such as Azure Data Lake Storage, Azure Data Factory, Azure Databricks, or Azure Synapse Analytics. • Solid understanding of software engineering principles, including version control (Git), testing ...

Protocol (MCP) for advanced context-aware analytics and automation. Develop and maintain security analytics and data pipelines within Sentinel Data Lake to support large-scale threat detection, incident response, and threat hunting, while optimizing cost and enabling Agentic AI-driven security operations. Integrate and automate … team of Cyber Defence Security Engineers. The Requirements: Must-Have Skills: Microsoft Sentinel Expertise : Architecture, deployment, management, including AI for Security, Data Lake optimization, MCP, and Sentinel Graph. Cloud Security Tools : Hands-on with Wiz Cloud (Defend, Runtime Sensor, Code), CSPM, and CWP. Automation & Integration : Using Sentinel ...

Role Overview A leading financial services provider is embarking on a major data transformation, building a modern architecture with Microsoft and Databricks technologies to become a truly data-driven organisation. As part of our client's programme and management information team, we are seeking a Data … Power BI (Desktop, Service, DAX). Expertise in Data Modelling and Schema creation. Strong experience with Databricks and Azure Data Lake design. Proficiency in SQL, ETL frameworks, and database management systems. Analytical mindset with proven problem-solving abilities. Excellent communication, coaching, and teamwork skills ...

build, and maintain scalable data pipelines using Databricks Notebooks, Jobs, and Workflows for both batch and streaming data. Optimise Spark and Delta Lake performance through efficient cluster configuration, adaptive query execution, and caching strategies. Conduct performance testing and cluster tuning to ensure cost-efficient, high-performing workloads. … governance best practices. Develop PySpark applications for ETL, data transformation, and analytics, following modular and reusable design principles. Create and manage Delta Lake tables with ACID compliance, schema evolution, and time travel for versioned data management. Integrate Databricks solutions with Azure services such as Azure ...

engineering solutions. Key requirements: Proven experience as a Data Engineer with Active Security Clearance (SC) Strong experience with Databricks, PySpark and Delta Lake Expertise in Jobs & Workflows, cluster tuning, and performance optimisation Solid understanding of Data governance (Unity Catalog, Lineage, Access Policies) Hands-on with … Azure services: Data Lake Storage (Gen2), Key Vault, Azure Functions Familiarity with CI/CD for Databricks deployments Strong troubleshooting in distributed Data environments Excellent communication and collaboration skills Nice to have: Immediate availability Experience with enterprise-scale Databricks environments Knowledge of Azure Synapse, Power ...

Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks … Data Engineer to design, develop, and manage data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business ...

Data Platform Engineer - ADF, Terraform, Synapse, Spark £Market Rate (Inside IR35) London/Hybrid 6 months We are currently working with a client who urgently require a Data Platform Engineer with hands on expertise in Synapse Spark Architecture, ADF and Terraform (IaC), to assist in designing … Factory (ADF), including network configurations and integration runtime options. Strong expertise in Synapse Analytics Spark, Azure Key Vault, and Data Lake Storage Accounts. Experience in efficient handling of large-scale data Deep understanding of Azure DevOps pipelines and deploying Terraform (Infrastructure as Code ...

RoleWe are looking for a Python Data Engineer with strong hands-on experience in Behave-based unit testing, PySpark development, Delta Lake optimisation, and Azure cloud services. This role focusses on designing and deploying scalable data processing solutions in a containerised environment, emphasising maintainable, configurable … pipelines using Python and PySpark. Implement unit and behavior-driven testing with Behave, ensuring robust mocking and patching of dependencies. Design and maintain Delta Lake tables for optimised query performance, ACID compliance, and incremental data loads. Build and manage containerised environments using Docker for consistent development, testing ...

bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties … will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML and reporting - Designing ...

Data Engineer Remote - Azure - Databricks - up to £80k I'm working with a client who are a leading Microsoft consultancy that's growing fast and shaping the future of data. They are continuing to grow, driving innovation and help clients accelerate their cloud transformation journeys. With a pipeline … cutting-edge projects, this is your chance to work at the forefront of cloud data engineering and make a real impact. You'll Work With Designing and delivering scalable projects using Databricks, Synapse & Fabric Build and optimise ETL/ELT pipelines and data models with ...

Director of Data & AI | Microsoft Azure Stack | AI-Driven Legal Platform Workplace Type: Hybrid Location: London Salary: 130-150k The Role This is a senior leadership role for someone who wants to sit at the heart of a business where AI is already embedded into live products … platform is built on a Microsoft stack with centrally stored data: Azure Machine Learning Microsoft Fabric Databricks Centralised data lake architecture Microsoft Dynamics CRM AI-powered legal tools focused on due diligence and contract review Nice to Haves Experience working on established AI products rather ...

Data Engineering Team Lead - Remote - Databricks - Azure - 80k Join a Leading Microsoft Consultancy Driving Data Innovation I'm working with a well-established Microsoft Partner with an incredible project pipeline, rapid growth, and a reputation for delivering Tech for Good. They're working on cutting-edge … projects using emerging technologies like Microsoft Fabric and Azure Databricks. We're looking for a Data engineering team lead who combines hands-on technical expertise with leadership skills to mentor a talented team and deliver exceptional solutions for our clients. What You'll Do Lead and mentor ...

supporting complex, large-scale workloads within mature Agile delivery environments. Deep hands-on expertise with Azure Databricks, including clusters, job orchestration, Workflows, Repos, Delta Lake, Unity Catalog, metastore configuration, and workspace administration. Strong experience with Azure DevOps YAML pipelines, Git branching strategies, artifact management, automated testing, and environmental promotion … Azure networking, storage, key vaults, identities, private endpoints, and associated cloud infrastructure. Strong understanding of Azure cloud services such as Azure Data Lake Storage, Azure Key Vault, Azure Monitor, Azure VMs, Azure Networking, Azure Log Analytics, and Azure AD. Proficient in scripting with Python, Bash, or PowerShell ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...

collaborative and inclusive culture. About the role CitNOW Group has rapidly expanded through multiple acquisitions, creating an exciting ecosystem of platforms, applications and data landscapes. We are seeking an experienced Enterprise Architect to define and implement a group-wide architecture strategy that unifies these systems within a cohesive … enterprise architecture, with a proven track record in post-merger and acquisition integration. The ideal candidate will have deep knowledge of integration platforms, data architecture and cloud technologies, combined with excellent communication and stakeholder management skills to influence effectively across diverse business units. This role is critical ...