26 to 50 of 58 Data Lake Jobs in Slough

Senior Data Engineer | Systematic Trading A Top-tier quant fund is hiring a Senior Data Engineer to help architect and scale a global Data Lakehouse that feeds directly into live trading strategies. If you’ve already been building data infrastructure inside a hedge fund or HFT shop, you’ll know what this … role really means: low-latency, high-availability, globally distributed data pipelines that quant teams trust every day. This is your chance to level up from patching legacy pipelines to … building the core platform used by quant researchers and traders across desks and regions. What You’ll Be Driving Architect and build a global Lakehouse platform (Data Lake + OLAP) in AWS Develop scalable data pipelines in Python , working with SDKs and data libs Own end-to-end data modeling , ingestion More ❯

Platform Engineer - Data, Azure, AI, IaC, Terraform £Market Rate (Inside IR35) London/Hybrid 6 months We are currently working with a client who urgently require a Platform Engineer with strong knowledge of Data to play a pivotal role in designing and engineering a robust, scalable Data Platform, with a strong focus on Azure … Engineer, within large, complex organisations Focus on Azure-based Data Platforms Strong hands-on experience with Azure Data Factory (ADF), Azure AI, Data Lake, Cognitive Services and OpenAI Proven ability to deploy Azure services and Infrastructure as Code (IaC) Deep knowledge of Terraform, automation and Infrastructure as Code (IaC) Strong working knowledge of … communication skills and stakeholder engagement Nice to have: Immediate availability Background in Infrastructure to understanding concepts such as Networking, Firewalls and Security Previous experience of deploying Virtual Machines, Data Lakes, Data vaults Some exposure to GCP and it's AI capabilities Scripting knowledge of Powershell/Bash/Python Awareness of operational challenges If you're More ❯

Lead Data Engineer (Azure Stack) £95k + 10% bonus Hybrid – 1 day a week Central London I’m helping a growing fintech find their next Lead Data Engineer, they are looking for someone who loves building modern data platforms in Azure and wants to make a genuine impact. This role offers the best of … help drive a modern, data-driven culture all within a collaborative environment that values innovation and ownership. Tech you’ll be working with: Azure Data Lake Azure Synapse Databricks Data Factory Python, SQL, PySpark Terraform, GitHub Actions, CI/CD pipelines You’ll thrive here if you: Have strong experience building and leading … Azure-based data platforms Enjoy mentoring and guiding other engineers Love designing scalable, automated data pipelines Bring a hands-on approach and enjoy problem-solving Want to shape data strategy in a growing fintech If you’re an experienced Azure Data Engineer who enjoys leading without losing your hands-on edge, then More ❯

of the leading organizations in the UAE specializing in healthcare and advanced technology solutions . PLEASE NOTE THAT THE ROLE IS BASED IN DUBAI! As the Director – Healthcare Data and AI Solution Architect , you will play a key leadership role in defining and driving the company’s data and AI architecture strategy , shaping the foundation for … innovation, scalability, and excellence in healthcare technology. You will design and implement a robust, secure, and future-ready data and AI ecosystem , ensuring deep integration with enterprise-wide strategies and governance frameworks. Reporting to the Executive Director of AI & Data , you’ll lead a team of architects and collaborate closely with cross-functional teams to bring … the company’s AI vision to life. Key Responsibilities Architectural Leadership Define and maintain a comprehensive and scalable data and AI architecture aligned with enterprise-wide technology strategy. Establish and enforce best practices for data storage, integration, governance, and compliance with regulatory standards. Provide strategic technical direction to architecture and engineering teams. Evaluate and enhance systems More ❯

Enterprise Data Architect - London Salary: Up to £130,000 Hybrid: 3 days a week Industry: Financial Services We are seeking an Enterprise Architect to work with one of our key financial services clients. You will lead their data-driven technology evolution and architect the future state of their cloud infrastructure. This is a greenfield opportunity to … establish enterprise-wide data governance frameworks and design scalable data platforms. You'll be responsible for designing the firm’s architectural standards, enabling advanced analytics, AI/ML capabilities, and regulatory … compliance while solving complex data integration, quality, and lineage challenges. You’ll have in-depth knowledge of Microsoft data technologies - including Azure Data Lake, Synapse Analytics, Fabric, and Power BI - be a strategic thinker who bridges business objectives with technical execution, translating data challenges into architectural solutions. Get in touch to More ❯

Senior Data Engineer (GCP BigQuery Python SQL) London/WFH to £85k Are you a tech savvy Data Engineer with Google Cloud expertise combined with client facing skills? You could be joining a global technology consultancy with a range of banking, financial services and insurance clients in a senior, hands-on Data Engineer role. … As a Senior Data Engineer you will design and build end-to-end real-time data pipelines using GCP services such as BigQuery, Dataflow and Dataproc, collaborating closely with clients to define business requirements, architect fit-for-purpose data solutions and support the migration of legacy on-premise systems to cloud-native architectures. You … ll collaborate directly with clients to analyse requirements, define solutions and deliver production grade systems, leading the development of robust, well tested and fault tolerant data engineering solutions. Location/WFH: There's a hybrid work from home model with two days a week in the London, City office (or at client site in London). About you More ❯

Job Title: Azure Databricks Data Engineer Primary skills: Advanced SQL, Azure Databricks, Azure Data Factory, Azure Datalake. Secondary skills: Azure SQL, PySpark, Azure Synapse. Experience: 10+ Years of Experience Hybrid - 3 Days/Week onsite is MUST About the job We are looking for an experienced Databricks Data Engineer to design, develop, and manage … data pipelines using Azure services such as Databricks, Data Factory, and Datalake. The role involves building scalable ETL solutions, collaborating with cross-functional teams, and processing large volumes of data. You will work closely with business and technical teams to deliver robust data models and transformations in support of analytics and reporting needs. • Responsibilities … Design and develop ETL pipelines using ADF for data ingestion and transformation. • Collaborate with Azure stack modules like Data Lakes and SQL DW to handle large volumes of data. • Write SQL, Python, and PySpark code to meet data processing and transformation needs. • Understand business requirements and create data flow processes that meet More ❯

Paragon Alpha are working with a data team at a multi-manager hedge fund, who have recently added AUM, and are growing a team of technologists to underpin their trading divisions. They're looking for … a talented Senior/Lead Data Engineer to join this team, and to work on data and trading infrastructure and a scalable data lake (AWS), which will ingest data sets from market data vendors. Stack: Python, Pandas/Polars, AWS, ETL This is a great opportunity for someone inside … or outside of finance, to join a high performing team and build data systems that yield profit for the firm. If this sounds of interest, please do apply. More ❯

Are you a skilled Data Engineer with deep Snowflake expertise and a passion for building scalable cloud-based solutions? A fast-growing technology consultancy is looking for an advanced Senior Data Engineer to lead delivery squads, drive engineering excellence, and help shape innovative data solutions across cloud platforms like AWS, Azure, and GCP. Join … a high performing team that partners with enterprise clients across sectors to deliver cutting edge data projects. This is a hybrid role (2–3 days onsite) based in London, offering great technical scope, leadership opportunities, and structured career development. Key Responsibilities Lead technical delivery of Snowflake based data engineering projects for enterprise clients. Design, build, and … Snowflake development and optimisation. Strong skills in Python and SQL for ELT/ETL and transformation workflows. Experience with cloud native storage and compute tools: S3, Data Lake, ADF, Redshift, Synapse, etc. Familiarity with CI/CD pipelines, test automation, and DevOps practices in data workflows. Stakeholder management Career & Development Opportunities Structured career progression with More ❯

Role – Technology Lead Technology – Kafka, Confluent cloud and Data Integration Location – London, UK Job Description We are looking for an experienced Kafka and Confluent Cloud Specialist to join our team onsite as a Subject Matter Expert (SME) and primary technical lead for all data onboarding activities across on-premises and cloud environments. This role demands strong … expertise in event streaming platforms, excellent SQL skills, and the ability to collaborate with multiple stakeholders to ensure smooth data integration and delivery. As a secondary skill, experience with Fivetran, SSIS, ADF or Snowflake will be considered a strong plus. Your role In the role of a Data Integration Lead , you will drive the design, implementation … and optimization of enterprise-grade data integration solutions, with a strong focus on real-time streaming and cloud-native platforms. You will lead initiatives involving Apache Kafka and Confluent Cloud, enabling scalable, event-driven architectures that support high-throughput, low-latency data movement across systems. You will anchor engagements from requirement gathering and solution architecture to More ❯

for front office use, capable of calculating and distributing option sensitivities and exposures in real time. It supports dynamic pricing, stress testing, and scenario analysis for high-volume, data-intensive trading activity. As Lead Developer, you will drive the architecture and implementation of a cloud native, microservice based risk framework, ensuring scalability, performance, and accuracy across all risk … containerised microservices (Kubernetes, Docker). Infrastructure: Kafka, Terraform, Jenkins, Git, CI/CD pipelines. Data: SQL/NoSQL databases, distributed data processing, data lake environments. Quant Integration: Comfortable working with quant libraries and APIs. Ideal Profile Built cloud native risk systems that calculate and distribute option sensitivities and exposures. Proven background building from More ❯

handover Coordinate activities across internal business stakeholders, external vendors, and service providers Manage vendor deliverables, SLAs, and contract milestones Oversee integrations between new solutions and internal systems (APIs, data flows, single sign-on) Lead change management, user acceptance testing, and go-live readiness Ensure projects are delivered on time, within scope, and to budget, following agreed governance Business … configuration instructions Assess and recommend suitable SaaS or cloud products based on functional fit and cost-effectiveness Facilitate vendor selection, RFP/RFI processes, and evaluation workshops Support data migration, configuration, and integration activities Develop business process documentation and support end-user training Vendor & Stakeholder Management Act as the main point of contact between the business and external … systems - Anaplan, DealCloud, Workiva, Alteryx or Microsoft 365 Basic familiarity with technologies that underpin an enterprise data platform built using Microsoft Azure technologies (Azure Data Lake, Synapse Analytics, Data Factory, Purview, Power BI) Awareness or experience with Generative AI, Agentic AI, or automation technologies (eg, ChatGPT, Microsoft Copilot, AI workflow tools) Prior experience More ❯

Copilot and Agents, Fabric and Azure range of products, which enables us to deliver powerful, connected business solutions that drive significant client value. The Role: Pre-Sales Data Solutions Architect – Microsoft Business Solutions (MBS) The Pre-Sales Data Solutions Architect will define and articulate data and AI strategies within Microsoft AI-powered business solutions. … This strategic role combines deep technical expertise in Microsoft’s data stack with the ability to translate business requirements into end-to-end Microsoft architectures, operating at the intersection of Microsoft Data, AI, and Application technologies. Responsibilities: Engaging with clients and internal teams to define data architecture and strategy within the Microsoft ecosystem. Designing … and presenting end-to-end Microsoft data architectures that integrate data technologies like Azure Synapse Analytics, Fabric and Power BI with Dynamics 365, Power Platform, AI Foundry, and Copilot Studio. Supporting sales and solution design processes by creating Microsoft-aligned proposals, solution diagrams, and proofs of concept. Acting as a trusted Microsoft data advisor More ❯

get the chance to work with likeminded people on an innovative project. You’ll join a team of 4 to contribute to the build of a greenfield market data platform that will enhance how this systematic fund will trade and analyse global markets. You'll integrate various data sources, including financial data, alternative data, and proprietary feeds. Real-time data processing and analytics will be a key part of your work, enabling to support high-frequency trading and quick decision-making. Ideally, you’ll have worked with market data platforms using Python or C#. DevOps technologies such as; OIDC/Entra, Nomad, Trino, Terraform are also a strong … and-coming projects such as: Building a new API for the market data platform. Writing a data dictionary for the platform. Adopting S3 for a datalake solution. If you're developer with a passion for building and supporting market data platforms, apply or reach out via email: megan@saragossa.io No up-to-date CV More ❯

Databricks Tech Lead – Azure Data Engineering (Contract) We are looking for a highly technical, hands-on … Databricks Tech Lead to join a large-scale digital transformation programme within the Energy Trading space. This role will focus on building, optimising, and scaling a data lake on Azure with particular emphasis on streaming pipelines, Delta Live Tables (DLT), and cost-efficient architecture. Role: Designing and developing streaming and batch data pipelines in Databricks … including DLT). Managing structured streaming in continuous mode, ensuring low-latency data delivery. Collaborating with architects, consultants, and business stakeholders to build a unified Azure-based lakehouse. Troubleshooting and optimising performance bottlenecks in high-volume streaming systems. Applying best practices for cloud cost management and efficient Databricks resource usage. Integrating data from on-prem and More ❯

Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month Rolling | I’m working with a commodities trading firm that’s embarking on a greenfield rebuild of their data-intensive trading platform, moving from traditional SQL infrastructure to a next-generation analytical stack built in .NET and … ClickHouse. They’re looking for a Data Developer/Engineer with a strong C# background and solid experience working with analytical databases and modern data lake technologies. The Details £800/day Inside IR35 6-month rolling contract Hybrid, 2 days onsite in London Key Focus Areas Strong experience with .NET/C# (backend-focused … Hands-on with analytical databases such as ClickHouse, SingleStore, Rockset, or TimescaleDB Experience with open-standard data lakes (e.g. Apache Iceberg, Delta Tables, Apache Spark, column stores) Comfortable working with large-scale data ingestion and processing (batch or streaming) Data Developer – Hybrid - £800/day Inside IR35 | C# | ClickHouse | SingleStore | Rockset | TimescaleDB | 6-Month More ❯

CD pipelines (Jenkins), version control (GitHub/GitLab/BitBucket), backend/frontend frameworks (Spring Boot, Angular, React), cloud and data platforms (Azure Databricks, Data Lake), monitoring, logging, and test automation tools to deliver high-quality, scalable, and secure software solutions. This is an excellent opportunity for someone to lead and shape the engineering and More ❯

This is a strategic, front-office-aligned architecture role shaping the evolution of a multi-billion-dollar investment management platform. You’ll operate at the intersection of technology, data, and business value—driving change across portfolio management, trading, risk, compliance, and client operations. The remit demands a commercially astute technologist who can influence senior stakeholders, challenge legacy thinking … risk, performance, and operations. Oversee the implementation and optimisation of SimCorp Dimension , embedding industry best practice, scalability, and alignment to business strategy. Define and execute a multi-year data and platform strategy positioning the organisation as a market leader in digital investment operations. Engage senior business sponsors and C-suite stakeholders , translating complex architecture into business outcomes and … total-cost-of-ownership advantages. Champion data-driven decisioning across investment management, using benchmarking and insights to accelerate adoption. Drive SaaS and cloud transformation , shaping roadmaps that unlock economies of scale and enable future AI/ML-driven capabilities. Mentor cross-functional teams on data architecture, cloud design principles, and front-office solution delivery. Represent the More ❯

these values are upheld only because of our people. Your role As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components. You will collaborate with data engineers, architects, and DevOps teams to deliver robust streaming solutions. Required: • Hands-on experience … with Apache Kafka (any distribution: open-source, Confluent, Cloudera, AWS MSK, etc.) • Strong proficiency in Java, Python, or Scala • Solid understanding of event-driven architecture and data streaming patterns • Experience deploying Kafka on cloud platforms such as AWS, GCP, or Azure • Familiarity with Docker, Kubernetes, and CI/CD pipelines • Excellent problem-solving and communication abilities Preferred: Candidates … Kafka Connect, Kafka Streams, KSQL, Schema Registry, REST Proxy, Confluent Control Center • Hands-on with Confluent Cloud services, including ksqlDB Cloud and Apache Flink • Familiarity with Stream Governance, Data Lineage, Stream Catalog, Audit Logs, RBAC • Confluent certifications (Developer, Administrator, or Flink Developer) • Experience with Confluent Platform, Confluent Cloud managed services, multi-cloud deployments, and Confluent for Kubernetes • Knowledge More ❯

Product Manager – Data & AI Innovation (Air Platform) Location: London (Hybrid) Salary: £100-120,000 + bonus Type: Full-time, Permanent About Our Client Our client is a global financial technology leader driving innovation across data, automation, and AI. Their solutions power some of the world’s largest financial institutions, enabling them to transform operational efficiency, accuracy … and performance. They are now seeking a strategic Product Manager with deep expertise in data-driven product development and AI integration to lead innovation across their flagship Air Platform — a next-generation solution focused on intelligent automation, orchestration, and data optimisation. This is an opportunity to sit at the heart of AI transformation — defining strategy, shaping … product direction, and delivering next-level user experiences powered by AI agents, LLMs, and emerging technologies. The Opportunity As Product Manager – Data & AI Innovation, you will drive the roadmap for advanced data orchestration and AI-enabled features. You’ll collaborate with data scientists, engineers, and go-to-market teams to ensure each innovation is More ❯

and analysing vast datasets, their collaborative agent system predicts client needs before they arise, delivering the “silver bullet” of foresight to financial institutions. With an intelligent data lake that learns continuously, this technology has the potential to revolutionize B2B sales productivity and client service delivery on a global scale. THE ROLE As CTO , you’ll be both … leader who can turn an ambitious vision into a scalable, intelligent platform. You’ll own technology decisions, defining the product roadmap, and build a world-class engineering and data team. From shaping the MVP to driving innovation and investor credibility, this is a rare opportunity to create lasting impact in an emerging AI frontier. Specifically, you can expect … for the Predictive Intelligence platform. Designing and overseeing the development of the MVP and scaling it to enterprise-grade readiness. Building and mentoring a high-performing engineering and data team from the ground up. Partnering closely with the founding team on product direction, innovation, and go-to-market execution. Owning decisions around tech stack, tooling, and infrastructure — balancing More ❯

onsite per week) Contract Type: Contract Duration: 6–12 months (possibility of extension) Start Date: ASAP Overview We are seeking an experienced Machine Learning Engineer to join our data science and AI engineering team on a contract basis in London. The ideal candidate will be responsible for designing, developing, and deploying machine learning models and scalable data … advanced analytics and intelligent automation initiatives. This role offers a hybrid work arrangement , combining flexibility with collaboration, and is ideal for a contractor who thrives in fast-paced, data-driven environments. Key Responsibilities Design, build, and deploy machine learning models and AI-driven solutions to address business challenges. Collaborate with data scientists to transition prototypes into … production-ready systems . Develop and maintain end-to-end ML pipelines for data ingestion, training, testing, and deployment. Optimise model performance, scalability, and reliability using MLOps best practices. Work with large-scale structured and unstructured datasets for model training and validation. Implement model monitoring, versioning, and retraining processes to ensure continuous improvement. Collaborate cross-functionally with engineering More ❯

objective from discovery through to adoption into BAU, utilising a combination of agile and traditional project and change management techniques. There is also a large-scale focus on data analysis and modelling. We put a large focus on internal advocacy, you will get real responsibility and accountability from the outset, you tell us how far you want to … combined minimum of 5 years Business Analysis experience in a previous consultancy or in industry Financial Services experience across Investments, Insurance, Asset Management or Wealth Management Experience in data analysis, data modelling, data lakes, visualisation techniques and implementation of digital dashboards Experience in identifying, scoping and implementing opportunities for non-technical and digitally enabled More ❯

General Ledger system to Finance functions across their EMEA entities. The main focus will be in Finance Data & Processing Architecture including the roll out of Azure Databricks Lake House and Oracle Cloud platforms supplemented with process orchestration, workflow and microservices. This is a newly created highly visible role, on a greenfield programme. A brilliant opportunity! The following … skills/experience is required: Strong Delivery Manager/Project Manager background. Previously implemented a General Ledger system Good working knowledge of finance processes and associated data sets/taxonomies. Understanding of Data lakes, Data sourcing, accounting rules engines, reference data, is desirable. Understanding of accounting is desirable. Excellent communication skills. Salary More ❯

Role As the UK Engineering and SRE Lead (Backend) , you’ll own the performance, scalability, and operational resilience of our UK backend systems — including payment gateways, settlement, fraud monitoring, datalake, and core banking services. You’ll combine deep backend engineering expertise with a strong Site Reliability Engineering mindset, leading a hybrid team of software, DevOps, and SRE engineers. This role More ❯