76 to 100 of 120 Data Lake Jobs in the City of London

Data Architect - London - Databricks - 110k + Bonus I'm looking for a hands-on Data Architect ready to shape the next generation of data platforms - blending architecture, data modelling, and AI innovation in a fast-moving, flat-structured tech environment. Is this what you're looking for: Azure Databricks, ADF, Power BI … SQL - everything built in Azure. Innovation-first culture: Work directly with senior tech leaders on projects using unstructured data into powerful insights. Modernised environment: Microservices, data lakes, and service-oriented architecture. Competitive package: Up to £110,000 + 3-8% bonus, hybrid working (typically 1-2 days in office), and excellent benefits. What you'll do … Architect and deliver scalable data solutions on Azure Databricks. Take full ownership of data modelling - conceptual, logical, and physical. Set data governance, quality, and optimisation best practices. Collaborate closely with engineering and data leaders to evolve the cloud data ecosystem. Contribute to cutting-edge AI projects shaping the future of More ❯

.NET (C#), SQL Server, SSIS/SSAS, T-SQL Experience of data engineering, ETL/ELT pipelines, Azure services (Data Factory, Synapse, Data Lake) Exposure with React/Angular/TypeScript Knowledge of CI/CD and DevOps practices Proven track record of leading development teams and engaging with stakeholders Commodities trading experience More ❯

Remote Senior Data Engineer - Contract Opportunity Role & Logistics Role: Senior Data Engineer (Databricks Focus) Company: Global Technology Platform Location: UK Remote Contract Duration: 6 Months (multi-year scope) Status: Outside IR35 Rate: Competitive Day Rate The Project We are seeking a highly experienced Senior Data Engineer to lead the hands-on delivery of core … data infrastructure for a critical, 6-month project. You will play a key role in designing and implementing scalable data solutions at the center of our technology platform. Key Responsibilities & Deliverables Design, architect, and implement robust, end-to-end data pipelines (batch and streaming). Drive the adoption of modern data engineering … leader, providing guidance, mentorship, and code reviews to the engineering team. Ensure rigorous engineering discipline, including CI/CD, testing, and monitoring standards are implemented and maintained. Own data workflows from ingestion through transformation, quality assurance, modeling, and delivery to downstream systems. Essential Technical Requirements 5+ years proven experience in a Data Engineering role, building production More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and … ClickHouse. They’re looking for a Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused … Hands-on with analytical databases such as ClickHouse, SingleStore, Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and … ClickHouse. They’re looking for a Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused … Hands-on with analytical databases such as ClickHouse, SingleStore, Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. You’ll operate at the intersection of technology, data, and business value—driving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. You’ll operate at the intersection of technology, data, and business value—driving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

Product Manager – Data & AI Innovation (Air Platform) Location: London (Hybrid) Salary: £100-120,000 + bonus Type: Full-time, Permanent About Our Client Our client is a global financial technology leader driving innovation across data, automation, and AI. Their solutions power some of the world’s largest financial institutions, enabling them to transform operational efficiency, accuracy … and performance. They are now seeking a strategic Product Manager with deep expertise in data-driven product development and AI integration to lead innovation across their flagship Air Platform — a next-generation solution focused on intelligent automation, orchestration, and data optimisation. This is an opportunity to sit at the heart of AI transformation — defining strategy, shaping … product direction, and delivering next-level user experiences powered by AI agents, LLMs, and emerging technologies. The Opportunity As Product Manager – Data & AI Innovation, you will drive the roadmap for advanced data orchestration and AI-enabled features. You’ll collaborate with data scientists, engineers, and go-to-market teams to ensure each innovation is More ❯

Product Manager – Data & AI Innovation (Air Platform) Location: London (Hybrid) Salary: £100-120,000 + bonus Type: Full-time, Permanent About Our Client Our client is a global financial technology leader driving innovation across data, automation, and AI. Their solutions power some of the world’s largest financial institutions, enabling them to transform operational efficiency, accuracy … and performance. They are now seeking a strategic Product Manager with deep expertise in data-driven product development and AI integration to lead innovation across their flagship Air Platform — a next-generation solution focused on intelligent automation, orchestration, and data optimisation. This is an opportunity to sit at the heart of AI transformation — defining strategy, shaping … product direction, and delivering next-level user experiences powered by AI agents, LLMs, and emerging technologies. The Opportunity As Product Manager – Data & AI Innovation, you will drive the roadmap for advanced data orchestration and AI-enabled features. You’ll collaborate with data scientists, engineers, and go-to-market teams to ensure each innovation is More ❯

Overview : We are seeking a seasoned HR Data Solution Architect to design and build a scalable people data reporting and analytics platform. The ideal candidate will have strong experience in data architecture, integration, and reporting—preferably with Workday and Prism, though expertise in other People Data systems will also be considered. Key … Responsibilities : Architect and model data structures for HR analytics platforms, ensuring alignment with enterprise data lakes. Design and implement ETL pipelines and integrations across Workday, Prism, and external systems. Develop reporting datasets and dashboards using tools like Workday, Prism, Tableau, or Power BI. Establish data governance, privacy, and security controls. Monitor and optimize data pipelines and stay current with platform enhancements. Contribute to agile delivery practices and cross-functional collaboration. Preferred Skills : Deep understanding of Workday Objects and Prism Data Hub. Experience with cloud platforms, microservices, and modern data architectures. Strong analytical and stakeholder management skills. More ❯

identity management. Experience with Copilot Studio and building custom Copilot agents or plugins. Familiarity with REST APIs, JSON, OAuth, and integration patterns with enterprise systems (e.g., CRM, ERP, data lakes). Understanding of prompt engineering, grounding techniques, and responsible AI principles. Soft Skills: Strong communication and stakeholder engagement skills, with the ability to explain complex technical concepts to More ❯

skills are required: Strong experience in a similar role (Quant Development/Analysis) Front Office experience , Ideally with experience working on Fixed income products Strong Python Strong exposure to datalake techynologies - Snowflake etc Excellent communication skills Interviews taking place ASAP. Please don't hesitate to reach out direct. sberry@hunterbond.com More ❯

and analysing vast datasets, their collaborative agent system predicts client needs before they arise, delivering the “silver bullet” of foresight to financial institutions. With an intelligent data lake that learns continuously, this technology has the potential to revolutionize B2B sales productivity and client service delivery on a global scale. THE ROLE As CTO , you’ll be both … leader who can turn an ambitious vision into a scalable, intelligent platform. You’ll own technology decisions, defining the product roadmap, and build a world-class engineering and data team. From shaping the MVP to driving innovation and investor credibility, this is a rare opportunity to create lasting impact in an emerging AI frontier. Specifically, you can expect … for the Predictive Intelligence platform. Designing and overseeing the development of the MVP and scaling it to enterprise-grade readiness. Building and mentoring a high-performing engineering and data team from the ground up. Partnering closely with the founding team on product direction, innovation, and go-to-market execution. Owning decisions around tech stack, tooling, and infrastructure — balancing More ❯

and analysing vast datasets, their collaborative agent system predicts client needs before they arise, delivering the “silver bullet” of foresight to financial institutions. With an intelligent data lake that learns continuously, this technology has the potential to revolutionize B2B sales productivity and client service delivery on a global scale. THE ROLE As CTO , you’ll be both … leader who can turn an ambitious vision into a scalable, intelligent platform. You’ll own technology decisions, defining the product roadmap, and build a world-class engineering and data team. From shaping the MVP to driving innovation and investor credibility, this is a rare opportunity to create lasting impact in an emerging AI frontier. Specifically, you can expect … for the Predictive Intelligence platform. Designing and overseeing the development of the MVP and scaling it to enterprise-grade readiness. Building and mentoring a high-performing engineering and data team from the ground up. Partnering closely with the founding team on product direction, innovation, and go-to-market execution. Owning decisions around tech stack, tooling, and infrastructure — balancing More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … production-ready systems . Develop and maintain end-to-end ML pipelines for data ingestion, training, testing, and deployment. Optimise model performance, scalability, and reliability using MLOps best practices. Work with large-scale structured and unstructured datasets for model training and validation. Implement model monitoring, versioning, and retraining processes to ensure continuous improvement. Collaborate cross-functionally with engineering More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … production-ready systems . Develop and maintain end-to-end ML pipelines for data ingestion, training, testing, and deployment. Optimise model performance, scalability, and reliability using MLOps best practices. Work with large-scale structured and unstructured datasets for model training and validation. Implement model monitoring, versioning, and retraining processes to ensure continuous improvement. Collaborate cross-functionally with engineering More ❯

objective from discovery through to adoption into BAU, utilising a combination of agile and traditional project and change management techniques. There is also a large-scale focus on data analysis and modelling. We put a large focus on internal advocacy, you will get real responsibility and accountability from the outset, you tell us how far you want to … combined minimum of 5 years Business Analysis experience in a previous consultancy or in industry Financial Services experience across Investments, Insurance, Asset Management or Wealth Management Experience in data analysis, data modelling, data lakes, visualisation techniques and implementation of digital dashboards Experience in identifying, scoping and implementing opportunities for non-technical and digitally enabled More ❯