23 of 23 Data Lake Jobs in the City of London

engineering team Cloud Data Platform & Infrastructure • Design and build enterprise-grade data solutions across Azure and GCP (Data Lake, Synapse, BigQuery, event streaming) • Own infrastructure using Infrastructure as Code (Terraform/Bicep) and implement CI/CD pipelines • Ensure platforms are highly available … warehousing & ELT) o Dataflow (Apache Beam for ETL processing) o Pub/Sub (event streaming ingestion) o Cloud Storage (data lake ingestion layers) o Cloud Composer (Airflow orchestration) • Proven experience building and optimising lakehouse architectures (Delta Lake, Databricks, Snowflake, BigQuery) • Hands-on experience with ...

data products, working closely with architecture where required. Implement and maintain data pipelines and ETL workflows in Databricks (PySpark, Delta Lake). Contribute to CI/CD pipelines for data applications using Azure DevOps and infrastructure-as-code (Terraform) in line with established … communicate clearly with technical and non-technical stakeholders. Data Engineer (New Technology/Microsoft) Strong experience with Databricks (Spark, PySpark, Delta Lake, and Unity Catalog advantageous). Proficiency in Azure data services (Azure Data Factory, Data Lake, Azure Functions advantageous ...

Title: Manager – Cloud Data Architect (AWS & Snowflake) Protiviti’s UK ED&A practice offers a comprehensive range of data use cases delivered through various delivery and commercial routes. We work on the full data lifecycle with highly skilled and experienced data professionals. … years in a cloud-native environment. Proven expertise with AWS cloud services , including but not limited to: S3, Glue, Redshift, Lambda, Kinesis, Athena, Lake Formation. Strong hands-on experience with Snowflake – architecture, performance tuning, security, and data sharing features. Proficient in data modelling, data ...

opportunity for you to join a leading London Market underwriter within a well-established, high-performing change and transformation function as a Senior Data Business Analyst. As the Senior Data Business Analyst, you’ll have the artistic freedom to define and shape how data … Business Analysis perspective, setting the standards, approach, and best practices for the function. Key Responsibilities: Lead the initiation, discovery, and delivery of multiple data and BI projects across the change portfolio, ensuring scope, timelines, and governance standards are met within a mature change function. Serve as the first ...

Role: Data Engineer - Join Our Fintech Revolution! Location: London, UK Job Type: Full-time, in-office Reports To: Chief Technology Officer Salary: Competitive About Us We are an innovative fintech organisation committed to reshaping the future of homeownership by providing cutting-edge mortgage and insurance products. Our mission … meet our business needs. Key Responsibilities Data Platform & Engineering Build and maintain data ingestion pipelines using Azure Data Lake (ADLS Gen2) and Microsoft Fabric. Seamlessly integrate third-party platforms and implement data transformations. Develop datasets for Power BI and support management ...

Data Bricks Product Owner, Microsoft Fabric Product Owner, Data Engineering, AI Data Analytics, Microsoft Stack, Azure, Data Bricks, ML, Azure, Mainly Remote Data Bricks Product Owner, Microsoft Fabric Project Owner, Data Engineering/Technology Product Owner required … Engineering (Data Bricks, Microsoft Fabric etc) before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance Development Framework experience within Microsoft Stack Technologies Experience with implementing ...

Data Architect (AI Data Foundations) Location - Erskine, London, Farnborough or Newcastle Candidates are required to be eligible for clearance We are seeking an AI Data Architect to design and implement AI-ready data foundations. You will define data models, storage … patterns, pipelines, and governance frameworks that support machine learning and analytics. Working closely with data engineers and ML engineers, you will ensure data is well-structured, accessible, secure, and scalable for AI use cases. Key Responsibilities Design and maintain data models and schemas (relational ...

engineers to deliver robust and reusable data products Manage data lakes and warehouses using formats such as Delta Lake and Parquet Implement best practices for data governance, performance, and security Continuously evaluate and adopt new technologies to evolve the organisation’s data … junior engineers and contribute to team capability building Technical Stack Core: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Gen2 SQL Server Databricks Enhancements: Python (PySpark, Pandas) CI/CD (Azure DevOps) Infrastructure as Code (Terraform, Bicep) REST APIs GitHub Actions Desirable: Microsoft ...

Permanent Opportunity for an eDV Cleared Data Engineer with AWS Cloud Experience for a leading National Security Consultancy in London. Up to £85,000 DoE plus bonuses Active eDV required London Location – full-time on-site when required Expertise required in AWS, Data Pipelines, ETL, Data … analytics and reporting. Develop ETL/ELT workflows to move data efficiently into data warehouses, data lakes and lake houses using open-source and AWS tooling. Apply DevOps practices, including CI/CD, infrastructure as code and automation, to improve and streamline data ...

Data Engineering Product Owner, AI Data Analytics, Microsoft Stack, Azure, Data Bricks, ML, Azure, Mainly Remote Data Engineering/Technology Product Owner required to join a global Professional Services business based in Central London. However, this is practically a remote role … must have been working within Data Engineering before moving into Product Ownership Technical proficiency:Familiarity with Azure services (e.g., Data Lake, Synapse, Fabric) and Databricks for data engineering, analytics, performance optimisation, and governance Development Framework experience within Microsoft Stack Technologies Experience with implementing ...

Senior Data Engineer Location: London (Hybrid) Function: Data Engineering/Data Platform Salary: Up to £140,000 base + bonus + benefits About the Role Our client is a global commodities and energy trading firm operating at the intersection of quantitative research, technology … significantly expanded its capabilities in renewable power optimisation, analytics, and physical gas trading across international markets. They are now hiring a Senior Data Engineer to join their Technology Data, AI & UX team in London. This team sits close to the trading floor and is responsible ...

Senior Data Engineer | £600 per day Outside IR35 | 6 Month Contract A PE-backed asset/wealth management firm managing multi-billion pounds in assets is seeking a Senior Data Engineer to design and deliver a new Azure-based data warehouse. The organisation … take a hands-on role building a robust data platform from ingestion through to consumption. Tech Environment: Azure Data Lake Storage Azure Synapse Medallion Architecture ETL/data ingestion pipelines Dimensional modelling Strong governance, security, and error handling Ideal Experience: Azure-based data ...

companies globally – with offices in New York, London, Madrid and Singapore. We are at an early and exciting stage of embedding AI and data capabilities across the firm. This hire is central to that effort. The Role: We are looking for a commercially minded AI and data … into the business in a practical, considered way Data Infrastructure and Reporting Help maintain and extend our Snowflake-based data lake, supporting data quality and accessibility across the business Build and maintain Power BI dashboards and reports that drive commercial decision-making across ...

existing Netezza structures. Produce the EDW logical and physical data models, dimensional models for the Semantic Layer, and Data Lake zone architecture (Bronze/Silver/Gold). Define Enterprise Semantic Layer design, including pre-computed aggregations, dimensional models, and Tableau connectivity specifications. Lead source … with at least 3 years leading enterprise data model design. Experience designing Lakehouse architecture: medallion architecture (Bronze/Silver/Gold), Delta Lake, or equivalent. Proficiency in dimensional modelling (Kimball methodology) and enterprise data modelling. Experience with Databricks (Unity Catalog, Delta Lake) or Snowflake ...

working with a well known education provider based in London to hire a Power BI Analyst. This role will involve transforming raw data into actionable insights and playing a key role in delivering dashboards, KPI frameworks and analytical solutions across the organisation. As the Power BI Analyst … closely with stakeholders across the business to gather requirements, design and develop interactive dashboards, and deliver scalable BI solutions. You’ll also support data governance, improve data quality across SQL, Dataverse and Synapse environments, and contribute to predictive analytics and machine learning initiatives. Skills required ...

Senior Data Architect Location: Remote (UK-based) Employment Type: Permanent Sector: Consulting/Public Sector Eligibility: Applicants must have the existing right to work in the UK. Visa sponsorship is not available. Overview We are seeking a Senior Data Architect (20+ years’ experience) to lead … design and delivery of enterprise-scale data platforms within consulting and public sector environments. This role requires strong architectural leadership, stakeholder engagement, and deep expertise in modern data platforms that support advanced analytics and AI-enabled solutions. Key Responsibilities • Lead the architecture and design of enterprise ...

Business Analyst – Technology, Data & AI Transformation About Valcon At Valcon, we are a European powerhouse in technology, data, and AI-driven business transformation. We combine deep expertise in digital technology, data platforms, and AI with our heritage in operational excellence, failsafe delivery, and organisational … scaling quickly while maintaining a collaborative, hands-on, and down-to-earth culture. 💥 Your Impact As a Business Transformation Analyst (Business, Technology, Data & AI), you will help organisations translate complex strategic & operational challenges into practical solutions across technology, data, and AI-enabled transformation programmes. Working ...

Head of Data & Analytics Engineering £110,000 + 30% Bonus London | Hybrid (3 days in the office) We’re delighted to be partnering exclusively with a global Food & Beverage organisation on their search for a Head of Data & Analytics Engineering. This is a pivotal leadership hire … award-winning group that’s investing heavily in its data platform and analytics foundations, and is looking for someone to shape the data engineering strategy as the business continues to scale. You’ll lead the data engineering function end-to-end, defining how data ...

C# Engineer with exposure to datalakes & Python | £80,000–£90,000 | London | Hybrid | 3 days in office We’re hiring a C# Engineer to join a commodities trading firm based in London. This is a hands-on role spanning support, enhancements, and new project builds, with a strong focus … What you’ll be doing: Supporting and maintaining existing applications Contributing to new builds and project delivery Working closely on a data lake migration programme Enhancing systems aligned to evolving data architecture What we’re looking for: Strong C#/.NET engineering experience Background ...

numi is proud to partner with a growing global technology consultancy seeking multiple Mid/Senior/Principal Data Engineers to join their team in London on a hybrid basis. An idea of some of the hires we are making: 8 AWS Data Engineers 1 Cloud … Engineer AWS 2 Data Engineers with Oracle 5 Snowflake Engineers with AWS 2 Data Engineers with Azure This consultancy empowers some of the world's biggest businesses by delivering advanced data, AI, cloud, and digital solutions. They are committed to providing a platform ...

Senior Product Manager – Data & AI (London) A growing FinTech business operating across capital markets is hiring a Senior Product Manager to lead the development of data and AI-driven products. The firm has built a centralised data platform capturing large-scale transactional data across trading and post-trade workflows. This role will focus on transforming that data into client-facing analytics, predictive insights, and decision-support tools used by institutional market participants. The Role Define and execute a Data & AI product roadmap aligned to business and client ...

leading global commodities trading firm is seeking a Senior .NET Developer to join its high-performing Data Platform team. This role sits within a business-critical engineering function responsible for building and maintaining high-throughput, low-latency data systems that underpin trading, analytics, and operational decision … making across the firm. This is not a typical backend development role. While predominantly software engineering focused, it carries elements of data engineering — building streaming pipelines, designing high-performance components, and handling significant data volumes across distributed systems. You’ll join a collaborative Scrum-based team ...

design, configuration, and implementation within an international investment-banking environment. Systems Expertise: Deep practical knowledge of Oracle ERP/EPM modules, financial data integration, reporting tools, API-based integrations, ETL technologies, data lakes, accounting rules engines, and reference data. This is a fascinating role with ...