76 to 100 of 128 Data Lake Jobs in Central London

Copilot and Agents, Fabric and Azure range of products, which enables us to deliver powerful, connected business solutions that drive significant client value. The Role: Pre-Sales Data Solutions Architect – Microsoft Business Solutions (MBS) The Pre-Sales Data Solutions Architect will define and articulate data and AI strategies within Microsoft AI-powered business solutions. … This strategic role combines deep technical expertise in Microsoft’s data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients and internal teams to define data architecture and strategy within the Microsoft ecosystem. Designing … and presenting end-to-end Microsoft data architectures that integrate data technologies like Azure Synapse Analytics, Fabric and Power BI with Dynamics 365, Power Platform, AI Foundry, and Copilot Studio. Supporting sales and solution design processes by creating Microsoft-aligned proposals, solution diagrams, and proofs of concept. Acting as a trusted Microsoft data advisor More ❯

Data Architect - London - Databricks - 110k + Bonus I'm looking for a hands-on Data Architect ready to shape the next generation of data platforms - blending architecture, data modelling, and AI innovation in a fast-moving, flat-structured tech environment. Is this what you're looking for: Azure Databricks, ADF, Power BI … SQL - everything built in Azure. Innovation-first culture: Work directly with senior tech leaders on projects using unstructured data into powerful insights. Modernised environment: Microservices, data lakes, and service-oriented architecture. Competitive package: Up to £110,000 + 3-8% bonus, hybrid working (typically 1-2 days in office), and excellent benefits. What you'll do … Architect and deliver scalable data solutions on Azure Databricks. Take full ownership of data modelling - conceptual, logical, and physical. Set data governance, quality, and optimisation best practices. Collaborate closely with engineering and data leaders to evolve the cloud data ecosystem. Contribute to cutting-edge AI projects shaping the future of More ❯

.NET (C#), SQL Server, SSIS/SSAS, T-SQL Experience of data engineering, ETL/ELT pipelines, Azure services (Data Factory, Synapse, Data Lake) Exposure with React/Angular/TypeScript Knowledge of CI/CD and DevOps practices Proven track record of leading development teams and engaging with stakeholders Commodities trading experience More ❯

Remote Senior Data Engineer - Contract Opportunity Role & Logistics Role: Senior Data Engineer (Databricks Focus) Company: Global Technology Platform Location: UK Remote Contract Duration: 6 Months (multi-year scope) Status: Outside IR35 Rate: Competitive Day Rate The Project We are seeking a highly experienced Senior Data Engineer to lead the hands-on delivery of core … data infrastructure for a critical, 6-month project. You will play a key role in designing and implementing scalable data solutions at the center of our technology platform. Key Responsibilities & Deliverables Design, architect, and implement robust, end-to-end data pipelines (batch and streaming). Drive the adoption of modern data engineering … leader, providing guidance, mentorship, and code reviews to the engineering team. Ensure rigorous engineering discipline, including CI/CD, testing, and monitoring standards are implemented and maintained. Own data workflows from ingestion through transformation, quality assurance, modeling, and delivery to downstream systems. Essential Technical Requirements 5+ years proven experience in a Data Engineering role, building production More ❯

Remote Senior Data Engineer - Contract Opportunity Role & Logistics Role: Senior Data Engineer (Databricks Focus) Company: Global Technology Platform Location: UK Remote Contract Duration: 6 Months (multi-year scope) Status: Outside IR35 Rate: Competitive Day Rate The Project We are seeking a highly experienced Senior Data Engineer to lead the hands-on delivery of core … data infrastructure for a critical, 6-month project. You will play a key role in designing and implementing scalable data solutions at the center of our technology platform. Key Responsibilities & Deliverables Design, architect, and implement robust, end-to-end data pipelines (batch and streaming). Drive the adoption of modern data engineering … leader, providing guidance, mentorship, and code reviews to the engineering team. Ensure rigorous engineering discipline, including CI/CD, testing, and monitoring standards are implemented and maintained. Own data workflows from ingestion through transformation, quality assurance, modeling, and delivery to downstream systems. Essential Technical Requirements 5+ years proven experience in a Data Engineering role, building production More ❯

Remote Senior Data Engineer - Contract Opportunity Role & Logistics Role: Senior Data Engineer (Databricks Focus) Company: Global Technology Platform Location: UK Remote Contract Duration: 6 Months (multi-year scope) Status: Outside IR35 Rate: Competitive Day Rate The Project We are seeking a highly experienced Senior Data Engineer to lead the hands-on delivery of core … data infrastructure for a critical, 6-month project. You will play a key role in designing and implementing scalable data solutions at the center of our technology platform. Key Responsibilities & Deliverables Design, architect, and implement robust, end-to-end data pipelines (batch and streaming). Drive the adoption of modern data engineering … leader, providing guidance, mentorship, and code reviews to the engineering team. Ensure rigorous engineering discipline, including CI/CD, testing, and monitoring standards are implemented and maintained. Own data workflows from ingestion through transformation, quality assurance, modeling, and delivery to downstream systems. Essential Technical Requirements 5+ years proven experience in a Data Engineering role, building production More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

Databricks Tech Lead Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and … ClickHouse. They’re looking for a Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused … Hands-on with analytical databases such as ClickHouse, SingleStore, Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and … ClickHouse. They’re looking for a Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused … Hands-on with analytical databases such as ClickHouse, SingleStore, Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

Hybrid This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. Youll operate at the intersection of technology, data, and business valuedriving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking, and … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. You’ll operate at the intersection of technology, data, and business value—driving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) Strong proficiency in Java, Python, or Scala Solid understanding of event-driven architecture and data streaming patterns Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure Familiarity with Docker, Kubernetes, and CI/CD pipelines Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC Confluent certifications (Developer, Administrator, or Flink Developer) Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes Knowledge More ❯

Product Manager – Data & AI Innovation (Air Platform) Location: London (Hybrid) Salary: £100-120,000 + bonus Type: Full-time, Permanent About Our Client Our client is a global financial technology leader driving innovation across data, automation, and AI. Their solutions power some of the world’s largest financial institutions, enabling them to transform operational efficiency, accuracy … and performance. They are now seeking a strategic Product Manager with deep expertise in data-driven product development and AI integration to lead innovation across their flagship Air Platform — a next-generation solution focused on intelligent automation, orchestration, and data optimisation. This is an opportunity to sit at the heart of AI transformation — defining strategy, shaping … product direction, and delivering next-level user experiences powered by AI agents, LLMs, and emerging technologies. The Opportunity As Product Manager – Data & AI Innovation, you will drive the roadmap for advanced data orchestration and AI-enabled features. You’ll collaborate with data scientists, engineers, and go-to-market teams to ensure each innovation is More ❯

Product Manager – Data & AI Innovation (Air Platform) Location: London (Hybrid) Salary: £100-120,000 + bonus Type: Full-time, Permanent About Our Client Our client is a global financial technology leader driving innovation across data, automation, and AI. Their solutions power some of the world’s largest financial institutions, enabling them to transform operational efficiency, accuracy … and performance. They are now seeking a strategic Product Manager with deep expertise in data-driven product development and AI integration to lead innovation across their flagship Air Platform — a next-generation solution focused on intelligent automation, orchestration, and data optimisation. This is an opportunity to sit at the heart of AI transformation — defining strategy, shaping … product direction, and delivering next-level user experiences powered by AI agents, LLMs, and emerging technologies. The Opportunity As Product Manager – Data & AI Innovation, you will drive the roadmap for advanced data orchestration and AI-enabled features. You’ll collaborate with data scientists, engineers, and go-to-market teams to ensure each innovation is More ❯

Overview : We are seeking a seasoned HR Data Solution Architect to design and build a scalable people data reporting and analytics platform. The ideal candidate will have strong experience in data architecture, integration, and reportingpreferably with Workday and Prism, though expertise in other People Data systems will also be considered. Key Responsibilities … Architect and model data structures for HR analytics platforms, ensuring alignment with enterprise data lakes. Design and implement ETL pipelines and integrations across Workday, Prism, and external systems. Develop reporting datasets and dashboards using tools like Workday, Prism, Tableau, or Power BI. Establish data governance, privacy, and security controls. Monitor and optimize data pipelines and stay current with platform enhancements. Contribute to agile delivery practices and cross-functional collaboration. Preferred Skills : Deep understanding of Workday Objects and Prism Data Hub. Experience with cloud platforms, microservices, and modern data architectures. Strong analytical and stakeholder management skills. More ❯

Overview : We are seeking a seasoned HR Data Solution Architect to design and build a scalable people data reporting and analytics platform. The ideal candidate will have strong experience in data architecture, integration, and reporting—preferably with Workday and Prism, though expertise in other People Data systems will also be considered. Key … Responsibilities : Architect and model data structures for HR analytics platforms, ensuring alignment with enterprise data lakes. Design and implement ETL pipelines and integrations across Workday, Prism, and external systems. Develop reporting datasets and dashboards using tools like Workday, Prism, Tableau, or Power BI. Establish data governance, privacy, and security controls. Monitor and optimize data pipelines and stay current with platform enhancements. Contribute to agile delivery practices and cross-functional collaboration. Preferred Skills : Deep understanding of Workday Objects and Prism Data Hub. Experience with cloud platforms, microservices, and modern data architectures. Strong analytical and stakeholder management skills. More ❯

identity management. Experience with Copilot Studio and building custom Copilot agents or plugins. Familiarity with REST APIs, JSON, OAuth, and integration patterns with enterprise systems (e.g., CRM, ERP, data lakes). Understanding of prompt engineering, grounding techniques, and responsible AI principles. Soft Skills: Strong communication and stakeholder engagement skills, with the ability to explain complex technical concepts to More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯