51 to 75 of 120 Data Lake Jobs in the City of London

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a hedge fund or HFT shop, you’ll know what this … role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to … building the core platform used by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

Senior Business Analyst Enterprise Data Transformation Location: London (Hybrid) Type: 6-Month FTC Salary: £70,000 £80,000 VIQU has partnered with a leading global organisation to recruit a Senior Business Analyst to support the delivery phase of a major multi-year Data Transformation Programme. The business is entering a crucial stage focused on delivering a … new enterprise data platform, making this an excellent opportunity to contribute to a large-scale initiative driving innovation and data-led decision-making across global operations. Key Responsibilities Lead business analysis for complex, global data transformation and technology programmes. Gather, document, and validate business, data, and functional requirements across multiple regions. Work … closely with finance and other business functions to understand data needs, processes, and integration points. Map, analyse, and streamline data workflows to improve quality, governance, and accessibility. Collaborate with technical teams to support data migration, integration, and reporting initiatives. Manage backlogs, change requests, and dependencies using structured governance frameworks. Support programme planning, reporting, and More ❯

Data Engineer x4 days a week in their London office Join a fast-scaling, product-led tech company on a mission to transform how their sector performs in real time. With a strong focus on data-led decision-making and seamless mobile experiences, this team is building out their next-generation data infrastructure, and … they’re looking for another Data Engineer to help drive that forward. This is an exciting opportunity to shape the way data flows through a live product used by thousands, while working closely with analytics, engineering, and commercial teams. You’ll be joining a small, high-impact team, reporting to a technical leader with a strong … background in applied data architecture. What You’ll Be Doing Designing, building, and maintaining scalable data pipelines to power both internal analytics and customer-facing mobile/web applications Developing robust ETL processes for ingesting and transforming data from a variety of sources, particularly APIs Creating and optimising data architectures to ensure More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading … Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data strategy in a growing fintech If you’re an experienced Azure Data Engineer who enjoys leading without losing your hands-on edge, then More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading … Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data strategy in a growing fintech If you’re an experienced Azure Data Engineer who enjoys leading without losing your hands-on edge, then More ❯

of the leading organizations in the UAE specializing in healthcare and advanced technology solutions . PLEASE NOTE THAT THE ROLE IS BASED IN DUBAI! As the Director – Healthcare Data and AI Solution Architect , you will play a key leadership role in defining and driving the company’s data and AI architecture strategy , shaping the foundation for … innovation, scalability, and excellence in healthcare technology. You will design and implement a robust, secure, and future-ready data and AI ecosystem , ensuring deep integration with enterprise-wide strategies and governance frameworks. Reporting to the Executive Director of AI & Data , you’ll lead a team of architects and collaborate closely with cross-functional teams to bring … the company’s AI vision to life. Key Responsibilities Architectural Leadership Define and maintain a comprehensive and scalable data and AI architecture aligned with enterprise-wide technology strategy. Establish and enforce best practices for data storage, integration, governance, and compliance with regulatory standards. Provide strategic technical direction to architecture and engineering teams. Evaluate and enhance systems More ❯

of the leading organizations in the UAE specializing in healthcare and advanced technology solutions . PLEASE NOTE THAT THE ROLE IS BASED IN DUBAI! As the Director – Healthcare Data and AI Solution Architect , you will play a key leadership role in defining and driving the company’s data and AI architecture strategy , shaping the foundation for … innovation, scalability, and excellence in healthcare technology. You will design and implement a robust, secure, and future-ready data and AI ecosystem , ensuring deep integration with enterprise-wide strategies and governance frameworks. Reporting to the Executive Director of AI & Data , you’ll lead a team of architects and collaborate closely with cross-functional teams to bring … the company’s AI vision to life. Key Responsibilities Architectural Leadership Define and maintain a comprehensive and scalable data and AI architecture aligned with enterprise-wide technology strategy. Establish and enforce best practices for data storage, integration, governance, and compliance with regulatory standards. Provide strategic technical direction to architecture and engineering teams. Evaluate and enhance systems More ❯

Enterprise Data Architect - London Salary: Up to £130,000 Hybrid: 3 days a week Industry: Financial Services We are seeking an Enterprise Architect to work with one of our key financial services clients. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure. This is a greenfield opportunity to … establish enterprise-wide data governance frameworks and design scalable data platforms. You'll be responsible for designing the firm’s architectural standards, enabling advanced analytics, AI/ML capabilities, and regulatory … compliance while solving complex data integration, quality, and lineage challenges. You’ll have in-depth knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI - be a strategic thinker who bridges business objectives with technical execution, translating data challenges into architectural solutions. Get in touch to More ❯

Enterprise Data Architect - London Salary: Up to £130,000 Hybrid: 3 days a week Industry: Financial Services We are seeking an Enterprise Architect to work with one of our key financial services clients. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure. This is a greenfield opportunity to … establish enterprise-wide data governance frameworks and design scalable data platforms. You'll be responsible for designing the firm’s architectural standards, enabling advanced analytics, AI/ML capabilities, and regulatory … compliance while solving complex data integration, quality, and lineage challenges. You’ll have in-depth knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI - be a strategic thinker who bridges business objectives with technical execution, translating data challenges into architectural solutions. Get in touch to More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Job Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage … data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations in support of analytics and reporting needs. • Responsibilities … Design and develop ETL pipelines using ADF for data ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to meet data processing and transformation needs. • Understand business requirements and create data flow processes that meet More ❯

Job Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage … data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations in support of analytics and reporting needs. • Responsibilities … Design and develop ETL pipelines using ADF for data ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to meet data processing and transformation needs. • Understand business requirements and create data flow processes that meet More ❯

Paragon Alpha are working with a data team at a multi-manager hedge fund, who have recently added AUM, and are growing a team of technologists to underpin their trading divisions. They're looking for … a talented Senior/Lead Data Engineer to join this team, and to work on data and trading infrastructure and a scalable data lake (AWS), which will ingest data sets from market data vendors. Stack: Python, Pandas/Polars, AWS, ETL This is a great opportunity for someone inside … or outside of finance, to join a high performing team and build data systems that yield profit for the firm. If this sounds of interest, please do apply. More ❯

Paragon Alpha are working with a data team at a multi-manager hedge fund, who have recently added AUM, and are growing a team of technologists to underpin their trading divisions. They're looking for … a talented Senior/Lead Data Engineer to join this team, and to work on data and trading infrastructure and a scalable data lake (AWS), which will ingest data sets from market data vendors. Stack: Python, Pandas/Polars, AWS, ETL This is a great opportunity for someone inside … or outside of finance, to join a high performing team and build data systems that yield profit for the firm. If this sounds of interest, please do apply. More ❯

Data Delivery and Integration Manager - Full time permanent role - Retail industry - Remote/home-based - Salary up to £75,000 plus bonus, private healthcare and more! A large and growing retail business are looking to expand their IT function with the addition of a Data Integration Manager. This role will focus on end to end data engineering and integration solutions for a company wide modernisation programme. Duties will include: - Managing the processes for data engineering and data integration in order to align to business needs - Leading a team across engineering and integration - Work to ensure the data infrastructure of the business effectively supports analytics, AL, machine learning ML … and reporting - Designing of data pipelines, ETL, ELT processes and architecture - Work with internal stakeholders and multiple 3rd parties to seamlessly integrate systems, platforms and applications To be considered suitable for this Data Engineering Manager role you will need to have experience across the following: - Team leadership and guidance - Data engineering and aligning of More ❯

Are you a skilled Data Engineer with deep Snowflake expertise and a passion for building scalable cloud-based solutions? A fast-growing technology consultancy is looking for an advanced Senior Data Engineer to lead delivery squads, drive engineering excellence, and help shape innovative data solutions across cloud platforms like AWS, Azure, and GCP. Join … a high performing team that partners with enterprise clients across sectors to deliver cutting edge data projects. This is a hybrid role (2–3 days onsite) based in London, offering great technical scope, leadership opportunities, and structured career development. Key Responsibilities Lead technical delivery of Snowflake based data engineering projects for enterprise clients. Design, build, and … Snowflake development and optimisation. Strong skills in Python and SQL for ELT/ETL and transformation workflows. Experience with cloud native storage and compute tools: S3, Data Lake, ADF, Redshift, Synapse, etc. Familiarity with CI/CD pipelines, test automation, and DevOps practices in data workflows. Stakeholder management Career & Development Opportunities Structured career progression with More ❯

Are you a skilled Data Engineer with deep Snowflake expertise and a passion for building scalable cloud-based solutions? A fast-growing technology consultancy is looking for an advanced Senior Data Engineer to lead delivery squads, drive engineering excellence, and help shape innovative data solutions across cloud platforms like AWS, Azure, and GCP. Join … a high performing team that partners with enterprise clients across sectors to deliver cutting edge data projects. This is a hybrid role (2–3 days onsite) based in London, offering great technical scope, leadership opportunities, and structured career development. Key Responsibilities Lead technical delivery of Snowflake based data engineering projects for enterprise clients. Design, build, and … Snowflake development and optimisation. Strong skills in Python and SQL for ELT/ETL and transformation workflows. Experience with cloud native storage and compute tools: S3, Data Lake, ADF, Redshift, Synapse, etc. Familiarity with CI/CD pipelines, test automation, and DevOps practices in data workflows. Stakeholder management Career & Development Opportunities Structured career progression with More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯

for front office use, capable of calculating and distributing option sensitivities and exposures in real time. It supports dynamic pricing, stress testing, and scenario analysis for high-volume, data-intensive trading activity. As Lead Developer, you will drive the architecture and implementation of a cloud native, microservice based risk framework, ensuring scalability, performance, and accuracy across all risk … containerised microservices (Kubernetes, Docker). Infrastructure: Kafka, Terraform, Jenkins, Git, CI/CD pipelines. Data: SQL/NoSQL databases, distributed data processing, data lake environments. Quant Integration: Comfortable working with quant libraries and APIs. Ideal Profile Built cloud native risk systems that calculate and distribute option sensitivities and exposures. Proven background building from More ❯

for front office use, capable of calculating and distributing option sensitivities and exposures in real time. It supports dynamic pricing, stress testing, and scenario analysis for high-volume, data-intensive trading activity. As Lead Developer, you will drive the architecture and implementation of a cloud native, microservice based risk framework, ensuring scalability, performance, and accuracy across all risk … containerised microservices (Kubernetes, Docker). Infrastructure: Kafka, Terraform, Jenkins, Git, CI/CD pipelines. Data: SQL/NoSQL databases, distributed data processing, data lake environments. Quant Integration: Comfortable working with quant libraries and APIs. Ideal Profile Built cloud native risk systems that calculate and distribute option sensitivities and exposures. Proven background building from More ❯

handover Coordinate activities across internal business stakeholders, external vendors, and service providers Manage vendor deliverables, SLAs, and contract milestones Oversee integrations between new solutions and internal systems (APIs, data flows, single sign-on) Lead change management, user acceptance testing, and go-live readiness Ensure projects are delivered on time, within scope, and to budget, following agreed governance Business … configuration instructions Assess and recommend suitable SaaS or cloud products based on functional fit and cost-effectiveness Facilitate vendor selection, RFP/RFI processes, and evaluation workshops Support data migration, configuration, and integration activities Develop business process documentation and support end-user training Vendor & Stakeholder Management Act as the main point of contact between the business and external … systems - Anaplan, DealCloud, Workiva, Alteryx or Microsoft 365 Basic familiarity with technologies that underpin an enterprise data platform built using Microsoft Azure technologies (Azure Data Lake, Synapse Analytics, Data Factory, Purview, Power BI) Awareness or experience with Generative AI, Agentic AI, or automation technologies (eg, ChatGPT, Microsoft Copilot, AI workflow tools) Prior experience More ❯

handover Coordinate activities across internal business stakeholders, external vendors, and service providers Manage vendor deliverables, SLAs, and contract milestones Oversee integrations between new solutions and internal systems (APIs, data flows, single sign-on) Lead change management, user acceptance testing, and go-live readiness Ensure projects are delivered on time, within scope, and to budget, following agreed governance Business … configuration instructions Assess and recommend suitable SaaS or cloud products based on functional fit and cost-effectiveness Facilitate vendor selection, RFP/RFI processes, and evaluation workshops Support data migration, configuration, and integration activities Develop business process documentation and support end-user training Vendor & Stakeholder Management Act as the main point of contact between the business and external … systems - Anaplan, DealCloud, Workiva, Alteryx or Microsoft 365 Basic familiarity with technologies that underpin an enterprise data platform built using Microsoft Azure technologies (Azure Data Lake, Synapse Analytics, Data Factory, Purview, Power BI) Awareness or experience with Generative AI, Agentic AI, or automation technologies (eg, ChatGPT, Microsoft Copilot, AI workflow tools) Prior experience More ❯

Copilot and Agents, Fabric and Azure range of products, which enables us to deliver powerful, connected business solutions that drive significant client value. The Role: Pre-Sales Data Solutions Architect – Microsoft Business Solutions (MBS) The Pre-Sales Data Solutions Architect will define and articulate data and AI strategies within Microsoft AI-powered business solutions. … This strategic role combines deep technical expertise in Microsoft’s data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients and internal teams to define data architecture and strategy within the Microsoft ecosystem. Designing … and presenting end-to-end Microsoft data architectures that integrate data technologies like Azure Synapse Analytics, Fabric and Power BI with Dynamics 365, Power Platform, AI Foundry, and Copilot Studio. Supporting sales and solution design processes by creating Microsoft-aligned proposals, solution diagrams, and proofs of concept. Acting as a trusted Microsoft data advisor More ❯

Copilot and Agents, Fabric and Azure range of products, which enables us to deliver powerful, connected business solutions that drive significant client value. The Role: Pre-Sales Data Solutions Architect – Microsoft Business Solutions (MBS) The Pre-Sales Data Solutions Architect will define and articulate data and AI strategies within Microsoft AI-powered business solutions. … This strategic role combines deep technical expertise in Microsoft’s data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients and internal teams to define data architecture and strategy within the Microsoft ecosystem. Designing … and presenting end-to-end Microsoft data architectures that integrate data technologies like Azure Synapse Analytics, Fabric and Power BI with Dynamics 365, Power Platform, AI Foundry, and Copilot Studio. Supporting sales and solution design processes by creating Microsoft-aligned proposals, solution diagrams, and proofs of concept. Acting as a trusted Microsoft data advisor More ❯