176 to 200 of 252 Data Lake Jobs in the South East

Databricks Tech Lead - Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

skills in Python , SQL , and optionally Java/Scala Hands-on experience with Palantir Foundry tools , including: Code Repositories, Pipeline Builder, Code Workbook Ontology Management, Contour, Solution Designer, Data Lineage Data Health, Data Connections, Egress Policies Experience in end-to-end solution development , from planning to scaling Strong understanding of data architecture … including data lakes, warehousing, schema design, and performance optimization Excellent communication and stakeholder management skills Ability to work in fast-paced, ambiguous environments and learn new tools quickly Package for the Palantir Forward Deployed Engineer, Palantir FDE Paying up to £1300 per day More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and … ClickHouse. They’re looking for a Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused … Hands-on with analytical databases such as ClickHouse, SingleStore, Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and … ClickHouse. They’re looking for a Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused … Hands-on with analytical databases such as ClickHouse, SingleStore, Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and … ClickHouse. They’re looking for a Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused … Hands-on with analytical databases such as ClickHouse, SingleStore, Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. You’ll operate at the intersection of technology, data, and business value—driving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. You’ll operate at the intersection of technology, data, and business value—driving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. You’ll operate at the intersection of technology, data, and business value—driving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. You'll operate at the intersection of technology, data, and business value-driving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

Product Manager – Data & AI Innovation (Air Platform) Location: London (Hybrid) Salary: £100-120,000 + bonus Type: Full-time, Permanent About Our Client Our client is a global financial technology leader driving innovation across data, automation, and AI. Their solutions power some of the world’s largest financial institutions, enabling them to transform operational efficiency, accuracy … and performance. They are now seeking a strategic Product Manager with deep expertise in data-driven product development and AI integration to lead innovation across their flagship Air Platform — a next-generation solution focused on intelligent automation, orchestration, and data optimisation. This is an opportunity to sit at the heart of AI transformation — defining strategy, shaping … product direction, and delivering next-level user experiences powered by AI agents, LLMs, and emerging technologies. The Opportunity As Product Manager – Data & AI Innovation, you will drive the roadmap for advanced data orchestration and AI-enabled features. You’ll collaborate with data scientists, engineers, and go-to-market teams to ensure each innovation is More ❯

Product Manager – Data & AI Innovation (Air Platform) Location: London (Hybrid) Salary: £100-120,000 + bonus Type: Full-time, Permanent About Our Client Our client is a global financial technology leader driving innovation across data, automation, and AI. Their solutions power some of the world’s largest financial institutions, enabling them to transform operational efficiency, accuracy … and performance. They are now seeking a strategic Product Manager with deep expertise in data-driven product development and AI integration to lead innovation across their flagship Air Platform — a next-generation solution focused on intelligent automation, orchestration, and data optimisation. This is an opportunity to sit at the heart of AI transformation — defining strategy, shaping … product direction, and delivering next-level user experiences powered by AI agents, LLMs, and emerging technologies. The Opportunity As Product Manager – Data & AI Innovation, you will drive the roadmap for advanced data orchestration and AI-enabled features. You’ll collaborate with data scientists, engineers, and go-to-market teams to ensure each innovation is More ❯

Product Manager – Data & AI Innovation (Air Platform) Location: London (Hybrid) Salary: £100-120,000 + bonus Type: Full-time, Permanent About Our Client Our client is a global financial technology leader driving innovation across data, automation, and AI. Their solutions power some of the world’s largest financial institutions, enabling them to transform operational efficiency, accuracy … and performance. They are now seeking a strategic Product Manager with deep expertise in data-driven product development and AI integration to lead innovation across their flagship Air Platform — a next-generation solution focused on intelligent automation, orchestration, and data optimisation. This is an opportunity to sit at the heart of AI transformation — defining strategy, shaping … product direction, and delivering next-level user experiences powered by AI agents, LLMs, and emerging technologies. The Opportunity As Product Manager – Data & AI Innovation, you will drive the roadmap for advanced data orchestration and AI-enabled features. You’ll collaborate with data scientists, engineers, and go-to-market teams to ensure each innovation is More ❯

NoSQL database modelsExperience with CI/CD, Git, and configuration management tools Nice-to-haves include cloud/database certifications, experience in security & compliance audits , and exposure to data lakes or real-time analytics . What’s in it for you Salary in the region of £40,000 – £50,000 The chance to join a growing technology business More ❯

Overview : We are seeking a seasoned HR Data Solution Architect to design and build a scalable people data reporting and analytics platform. The ideal candidate will have strong experience in data architecture, integration, and reporting-preferably with Workday and Prism, though expertise in other People Data systems will also be considered. Key … Responsibilities : Architect and model data structures for HR analytics platforms, ensuring alignment with enterprise data lakes. Design and implement ETL pipelines and integrations across Workday, Prism, and external systems. Develop reporting datasets and dashboards using tools like Workday, Prism, Tableau, or Power BI. Establish data governance, privacy, and security controls. Monitor and optimize data pipelines and stay current with platform enhancements. Contribute to agile delivery practices and cross-functional collaboration. Preferred Skills : Deep understanding of Workday Objects and Prism Data Hub. Experience with cloud platforms, microservices, and modern data architectures. Strong analytical and stakeholder management skills. More ❯