151 to 175 of 255 Data Lake Jobs in the South East

Are you a skilled Data Engineer with deep Snowflake expertise and a passion for building scalable cloud-based solutions? A fast-growing technology consultancy is looking for an advanced Senior Data Engineer to lead delivery squads, drive engineering excellence, and help shape innovative data solutions across cloud platforms like AWS, Azure, and GCP. Join … a high performing team that partners with enterprise clients across sectors to deliver cutting edge data projects. This is a hybrid role (2–3 days onsite) based in London, offering great technical scope, leadership opportunities, and structured career development. Key Responsibilities Lead technical delivery of Snowflake based data engineering projects for enterprise clients. Design, build, and … Snowflake development and optimisation. Strong skills in Python and SQL for ELT/ETL and transformation workflows. Experience with cloud native storage and compute tools: S3, Data Lake, ADF, Redshift, Synapse, etc. Familiarity with CI/CD pipelines, test automation, and DevOps practices in data workflows. Stakeholder management Career & Development Opportunities Structured career progression with More ❯

Are you a skilled Data Engineer with deep Snowflake expertise and a passion for building scalable cloud-based solutions? A fast-growing technology consultancy is looking for an advanced Senior Data Engineer to lead delivery squads, drive engineering excellence, and help shape innovative data solutions across cloud platforms like AWS, Azure, and GCP. Join … a high performing team that partners with enterprise clients across sectors to deliver cutting edge data projects. This is a hybrid role (2–3 days onsite) based in London, offering great technical scope, leadership opportunities, and structured career development. Key Responsibilities Lead technical delivery of Snowflake based data engineering projects for enterprise clients. Design, build, and … Snowflake development and optimisation. Strong skills in Python and SQL for ELT/ETL and transformation workflows. Experience with cloud native storage and compute tools: S3, Data Lake, ADF, Redshift, Synapse, etc. Familiarity with CI/CD pipelines, test automation, and DevOps practices in data workflows. Stakeholder management Career & Development Opportunities Structured career progression with More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯

for front office use, capable of calculating and distributing option sensitivities and exposures in real time. It supports dynamic pricing, stress testing, and scenario analysis for high-volume, data-intensive trading activity. As Lead Developer, you will drive the architecture and implementation of a cloud native, microservice based risk framework, ensuring scalability, performance, and accuracy across all risk … containerised microservices (Kubernetes, Docker). Infrastructure: Kafka, Terraform, Jenkins, Git, CI/CD pipelines. Data: SQL/NoSQL databases, distributed data processing, data lake environments. Quant Integration: Comfortable working with quant libraries and APIs. Ideal Profile Built cloud native risk systems that calculate and distribute option sensitivities and exposures. Proven background building from More ❯

for front office use, capable of calculating and distributing option sensitivities and exposures in real time. It supports dynamic pricing, stress testing, and scenario analysis for high-volume, data-intensive trading activity. As Lead Developer, you will drive the architecture and implementation of a cloud native, microservice based risk framework, ensuring scalability, performance, and accuracy across all risk … containerised microservices (Kubernetes, Docker). Infrastructure: Kafka, Terraform, Jenkins, Git, CI/CD pipelines. Data: SQL/NoSQL databases, distributed data processing, data lake environments. Quant Integration: Comfortable working with quant libraries and APIs. Ideal Profile Built cloud native risk systems that calculate and distribute option sensitivities and exposures. Proven background building from More ❯

for front office use, capable of calculating and distributing option sensitivities and exposures in real time. It supports dynamic pricing, stress testing, and scenario analysis for high-volume, data-intensive trading activity. As Lead Developer, you will drive the architecture and implementation of a cloud native, microservice based risk framework, ensuring scalability, performance, and accuracy across all risk … containerised microservices (Kubernetes, Docker). Infrastructure: Kafka, Terraform, Jenkins, Git, CI/CD pipelines. Data: SQL/NoSQL databases, distributed data processing, data lake environments. Quant Integration: Comfortable working with quant libraries and APIs. Ideal Profile Built cloud native risk systems that calculate and distribute option sensitivities and exposures. Proven background building from More ❯

for front office use, capable of calculating and distributing option sensitivities and exposures in real time. It supports dynamic pricing, stress testing, and scenario analysis for high-volume, data-intensive trading activity. As Lead Developer, you will drive the architecture and implementation of a cloud native, microservice based risk framework, ensuring scalability, performance, and accuracy across all risk … containerised microservices (Kubernetes, Docker). Infrastructure: Kafka, Terraform, Jenkins, Git, CI/CD pipelines. Data: SQL/NoSQL databases, distributed data processing, data lake environments. Quant Integration: Comfortable working with quant libraries and APIs. Ideal Profile Built cloud native risk systems that calculate and distribute option sensitivities and exposures. Proven background building from More ❯

handover Coordinate activities across internal business stakeholders, external vendors, and service providers Manage vendor deliverables, SLAs, and contract milestones Oversee integrations between new solutions and internal systems (APIs, data flows, single sign-on) Lead change management, user acceptance testing, and go-live readiness Ensure projects are delivered on time, within scope, and to budget, following agreed governance Business … configuration instructions Assess and recommend suitable SaaS or cloud products based on functional fit and cost-effectiveness Facilitate vendor selection, RFP/RFI processes, and evaluation workshops Support data migration, configuration, and integration activities Develop business process documentation and support end-user training Vendor & Stakeholder Management Act as the main point of contact between the business and external … systems - Anaplan, DealCloud, Workiva, Alteryx or Microsoft 365 Basic familiarity with technologies that underpin an enterprise data platform built using Microsoft Azure technologies (Azure Data Lake, Synapse Analytics, Data Factory, Purview, Power BI) Awareness or experience with Generative AI, Agentic AI, or automation technologies (eg, ChatGPT, Microsoft Copilot, AI workflow tools) Prior experience More ❯

handover Coordinate activities across internal business stakeholders, external vendors, and service providers Manage vendor deliverables, SLAs, and contract milestones Oversee integrations between new solutions and internal systems (APIs, data flows, single sign-on) Lead change management, user acceptance testing, and go-live readiness Ensure projects are delivered on time, within scope, and to budget, following agreed governance Business … configuration instructions Assess and recommend suitable SaaS or cloud products based on functional fit and cost-effectiveness Facilitate vendor selection, RFP/RFI processes, and evaluation workshops Support data migration, configuration, and integration activities Develop business process documentation and support end-user training Vendor & Stakeholder Management Act as the main point of contact between the business and external … systems - Anaplan, DealCloud, Workiva, Alteryx or Microsoft 365 Basic familiarity with technologies that underpin an enterprise data platform built using Microsoft Azure technologies (Azure Data Lake, Synapse Analytics, Data Factory, Purview, Power BI) Awareness or experience with Generative AI, Agentic AI, or automation technologies (eg, ChatGPT, Microsoft Copilot, AI workflow tools) Prior experience More ❯

handover Coordinate activities across internal business stakeholders, external vendors, and service providers Manage vendor deliverables, SLAs, and contract milestones Oversee integrations between new solutions and internal systems (APIs, data flows, single sign-on) Lead change management, user acceptance testing, and go-live readiness Ensure projects are delivered on time, within scope, and to budget, following agreed governance Business … configuration instructions Assess and recommend suitable SaaS or cloud products based on functional fit and cost-effectiveness Facilitate vendor selection, RFP/RFI processes, and evaluation workshops Support data migration, configuration, and integration activities Develop business process documentation and support end-user training Vendor & Stakeholder Management Act as the main point of contact between the business and external … systems - Anaplan, DealCloud, Workiva, Alteryx or Microsoft 365 Basic familiarity with technologies that underpin an enterprise data platform built using Microsoft Azure technologies (Azure Data Lake, Synapse Analytics, Data Factory, Purview, Power BI) Awareness or experience with Generative AI, Agentic AI, or automation technologies (eg, ChatGPT, Microsoft Copilot, AI workflow tools) Prior experience More ❯

Data Engineering and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Data Delivery and Integration Manager (Remote) - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end … data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning … ML and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning More ❯

Copilot and Agents, Fabric and Azure range of products, which enables us to deliver powerful, connected business solutions that drive significant client value. The Role: Pre-Sales Data Solutions Architect – Microsoft Business Solutions (MBS) The Pre-Sales Data Solutions Architect will define and articulate data and AI strategies within Microsoft AI-powered business solutions. … This strategic role combines deep technical expertise in Microsoft’s data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients and internal teams to define data architecture and strategy within the Microsoft ecosystem. Designing … and presenting end-to-end Microsoft data architectures that integrate data technologies like Azure Synapse Analytics, Fabric and Power BI with Dynamics 365, Power Platform, AI Foundry, and Copilot Studio. Supporting sales and solution design processes by creating Microsoft-aligned proposals, solution diagrams, and proofs of concept. Acting as a trusted Microsoft data advisor More ❯

Copilot and Agents, Fabric and Azure range of products, which enables us to deliver powerful, connected business solutions that drive significant client value. The Role: Pre-Sales Data Solutions Architect – Microsoft Business Solutions (MBS) The Pre-Sales Data Solutions Architect will define and articulate data and AI strategies within Microsoft AI-powered business solutions. … This strategic role combines deep technical expertise in Microsoft’s data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients and internal teams to define data architecture and strategy within the Microsoft ecosystem. Designing … and presenting end-to-end Microsoft data architectures that integrate data technologies like Azure Synapse Analytics, Fabric and Power BI with Dynamics 365, Power Platform, AI Foundry, and Copilot Studio. Supporting sales and solution design processes by creating Microsoft-aligned proposals, solution diagrams, and proofs of concept. Acting as a trusted Microsoft data advisor More ❯

Copilot and Agents, Fabric and Azure range of products, which enables us to deliver powerful, connected business solutions that drive significant client value. The Role: Pre-Sales Data Solutions Architect – Microsoft Business Solutions (MBS) The Pre-Sales Data Solutions Architect will define and articulate data and AI strategies within Microsoft AI-powered business solutions. … This strategic role combines deep technical expertise in Microsoft’s data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients and internal teams to define data architecture and strategy within the Microsoft ecosystem. Designing … and presenting end-to-end Microsoft data architectures that integrate data technologies like Azure Synapse Analytics, Fabric and Power BI with Dynamics 365, Power Platform, AI Foundry, and Copilot Studio. Supporting sales and solution design processes by creating Microsoft-aligned proposals, solution diagrams, and proofs of concept. Acting as a trusted Microsoft data advisor More ❯

Data Architect - London - Databricks - 110k + Bonus I'm looking for a hands-on Data Architect ready to shape the next generation of data platforms - blending architecture, data modelling, and AI innovation in a fast-moving, flat-structured tech environment. Is this what you're looking for: Azure Databricks, ADF, Power BI … SQL - everything built in Azure.Innovation-first culture: Work directly with senior tech leaders on projects using unstructured data into powerful insights.Modernised environment: Microservices, data lakes, and service-oriented architecture. Competitive package: Up to £110,000 + 3-8% bonus, hybrid working (typically 1-2 days in office), and excellent benefits. What you'll do: Architect and … deliver scalable data solutions on Azure Databricks. Take full ownership of data modelling - conceptual, logical, and physical. Set data governance, quality, and optimisation best practices. Collaborate closely with engineering and data leaders to evolve the cloud data ecosystem. Contribute to cutting-edge AI projects shaping the future of intelligent analytics. More ❯

Contract Data Engineer - Global Bank Location: Hybrid (London or Edinburgh preferred)?? Duration: 6-12 months? Day Rate: Competitive via Umbrella A leading global bank is seeking a skilled Data Engineer to join its next-generation data and AI transformation programme. This contract role offers the chance to work on high-impact initiatives, including powering … intelligent chatbots and AI-driven analytics across the organisation. Key Responsibilities: Design, build, and maintain scalable ETL data pipelines to support AI, chatbot, and analytics use cases. Collaborate with data scientists, ML engineers, and product teams to deliver clean, reliable data for model training and real-time inference. Enable chatbot platforms by integrating structured … and unstructured data sources for conversational AI applications. Develop and maintain Tableau dashboards to support data storytelling and operational insights. Optimise data workflows across cloud and on-prem environments, ensuring performance and reliability. Skills & Experience: Strong experience in ETL pipeline development using tools like Apache Airflow, Informatica, or similar. Advanced SQL skills and experience More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

Databricks Tech Lead - Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯