1 to 25 of 69 Data Lake Jobs in the City of London

for the Databricks Lakehouse Platform. Architectural Design: Lead the end-to-end design of the Databricks Lakehouse architecture (Medallion architecture), including data ingestion patterns, storage layers (Delta Lake), processing frameworks (Spark), and consumption mechanisms. Technology Selection: Evaluate and recommend optimal Databricks features and integrations (e.g., Unity Catalog, Photon, Delta Live Tables, MLflow) and complementary cloud services (e.g. … Azure Data Factory, Azure Data Lake Storage, Power BI). Security & Governance Frameworks: Design robust data governance, security, and access control models within the Databricks ecosystem, ensuring compliance with industry standards and regulations. Phase 2: Core Platform Build & Development Hands-on Implementation: Act as a lead engineer in the initial build-out of … sessions to ensure long-term sustainability of the platform. Required Skills & Experience Proven Databricks Expertise: Deep, hands-on experience designing and implementing solutions on the Databricks Lakehouse Platform (Delta Lake, Unity Catalog, Spark, Databricks SQL Analytics). Cloud Data Architecture: Extensive experience with Azure data services (e.g., Azure Data Factory, Azure Data More ❯

Social network you want to login/join with: Senior Azure Data Engineer + Power BI, london (city of london) col-narrow-left Client: Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 4 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: EVOCS is looking for … data marts, and data warehouse structures Integrate data from various sources including SQL databases, APIs, and cloud storage (e.g., Azure Data Lake, OneLake) Implement and maintain standards around data quality, security, and governance Participate in discussions with cross-functional teams to ensure that technical solutions align with business needs … processing using tools such as Event Hubs, Kafka, or equivalents Drive usage of Microsoft Fabric features within modern data architectures, especially OneLake, Lakehouse, and Direct Lake Power BI datasets Effectively communicate across diverse technical stakeholders and navigate challenging peer review or architectural debates Qualifications 5+ years of experience in data engineering with a More ❯

My client, a leading multi-strategy hedge fund, is seeking a mid-level Data Engineer to join their dynamic and rapidly growing team based in London. This is an exciting opportunity to join a high-performing investment firm that places technology and innovation at the core of its operations. You’ll play a key role in empowering the … front-office investment team through the delivery of data solutions - enabling informed decision-making across the board. The successful individual will take ownership of MI & BI reporting and data analysis, partnering closely with front-office teams. Your work will support business-critical initiatives through the design, maintenance, and enhancement of ETL pipelines, while also contributing to … streamline key workflows. You’ll also be responsible for: Migrating and enhancing business reports using Power BI Managing data ingestion into the firm’s data lake and data warehouse Troubleshooting data issues, performing log analysis, and owning resolution processes Supporting both manual and automated testing for new data solutions More ❯

we are looking for a Head of BI to lead our global Business Intelligence organisation. This key leadership role is aligned with our strategy - a modular, cloud-native data-centric architecture designed to democratise data access, strengthen governance, and maximise business value. Key Responsibilities : Lead the global BI organisation across APAC, EMEA, and the AMERICAS , with … years' experience in Business Intelligence, with 5+ years in a BI leadership role in a global or matrixed organisation . Proven expertise in modern BI architecture (Data Lake, EDW, Streaming, APIs, Real-Time & Batch Processing). Demonstrated experience delivering cloud-based analytics platforms (Azure, AWS, GCP). Strong knowledge of data governance, cataloguing, security, automation … of BI will work within a modern, cloud-based BI ecosystem , including : Data Integration: Fivetran , HVR, Databricks , Apache Kafka, Google BigQuery , Google Analytics 4 Data Lake & Storage: Databricks Delta Lake, Amazon S3 Data Transformation: dbt Cloud Data Warehouse: Snowflake Analytics & Reporting: Power BI, Excel, Snowflake SQL REST API Advanced Analytics More ❯

Social network you want to login/join with: Data Architect (GCP), london (city of london) col-narrow-left Client: Anson McCade Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Role : Data Architect (GCP … Location : London We are supporting a global technology services provider in the strategic expansion of their Google Cloud Data and AI practice, with multiple opportunities available for experienced professionals across architecture and engineering. This unit is driving major transformation initiatives with flagship enterprise clients, with a focus on intelligent data platforms, AI-driven analytics, and scalable … cloud-native solutions. Role Overview This is a strategic and hands-on opportunity for an experienced Data Architect to lead the development of a robust, scalable data architecture on Google Cloud Platform (GCP). You’ll be responsible for defining the platform strategy, leading a team of data engineers, and ensuring high standards of More ❯

Role: Senior or Lead Data Architect Location: UK-wide, with a preference towards London Salary: £80,000 - £130,000 + Bonus + Benefits Package Clearance: Must be eligible to work in the UK We’re working with a world-leading consultancy that’s delivering cutting-edge data and cloud architecture across some of the UK’s … most recognisable enterprises. As their Data & Intelligence practice continues to expand, we’re looking for experienced Senior Data Architects as well as proven Lead Data Architects to join the team. Whether your strength lies in hands-on solution architecture or enterprise-wide strategy, there’s a place for you to lead, shape and scale … modern data capabilities across sectors like public services, finance, telco, manufacturing, and retail. About the Role You’ll be embedded into high-impact client projects, defining, designing, and delivering modern data platforms, from initial strategy and modelling through to governance, integration, and delivery. Roles are tailored to experience, Senior Architects will lead solution and delivery workstreams More ❯

different format of this document, please get in touch with at [emailprotected] or call TCS London Office number 02031552100 with the subject line: “Application Support Request”. Role : Data Architect Job Type: Permanent (Hybrid) Location: London, United Kingdom Ready to utilize your skills in designing, creating, and managing data architecture? Join us as a Data … learning opportunities. • Be part of an exciting team where you will be challenged every day. • Build strong relationships with a diverse range of stakeholders. The Role As a Data Architect, you will be responsible for designing, creating, and managing data architecture. You will also ensure that data is efficiently and securely stored, organized, and … accessible across the enterprise. Build the foundation for databases, data warehouses, data lakes, and other data storage solutions, ensuring they meet both business and technical requirements. Key responsibilities: - Develop and design the data architecture framework for the organization. - Create models for databases, data warehouses, data lakes, and other More ❯

Location: London Contract Type: Contract Working Model: Hybrid Overview: We are seeking an experienced Data Architect to join our growing data team and lead the design and implementation of scalable, secure, and high-performance data solutions. You’ll play a key role in architecting modern data platforms using Snowflake , SQL , Python , and … leading cloud technologies to support advanced analytics, reporting, and machine learning initiatives across the business. Key Responsibilities: Design and maintain end-to-end data architectures, data models, and pipelines in Snowflake and cloud platforms (AWS, Azure, or GCP). Develop and optimize scalable ELT/ETL processes using SQL and Python. Define data governance … tools (e.g., Airflow, dbt) and version control (Git). Solid understanding of data governance, security, and compliance frameworks . Nice to Have: Experience with data lake architectures (Delta Lake, Lakehouse). Familiarity with BI/visualization tools (Tableau, Power BI, Looker). Knowledge of streaming data tools (Kafka, Kinesis). Background in More ❯

The Opportunity A leading global consultancy organisation is seeking a skilled Data Architect to design and deliver robust, scalable data platforms on Google Cloud Platform (GCP). The ideal candidate will bring extensive experience in building and maintaining large-scale data warehouses, ensuring high standards of data quality, and adhering to best … practices in data architecture. Key Responsibilities Define and develop the overall data strategy in line with client requirements and compliance standards. Lead and mentor a team of data engineers to implement scalable and efficient data solutions. Translate business needs into technical solutions by collaborating with both technical and non-technical stakeholders. Ensure … data platforms follow GCP best practices for performance, reliability, and security. Required Skills and Experience Proven background in designing data warehouse and data lake architectures. Demonstrable experience in building and operating large-scale data platforms on Google Cloud Platform, with a focus on data quality at scale. Hands-on More ❯

Product Owner (Data & Analytics) London Hybrid - 3 days pw onsite £60,000 to £75,000 We currently have an exciting opportunity for a Data Product Owner to join a one-of-a-kind customer centric organisation in the not-for-profit space, whose solutions support customers and their families across the UK. In this role, you … ll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business … stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring More ❯

London/Hybrid | 💷 £750/day | 🗓 12-Month Rolling | ✅ Outside IR35 Our client, a leading Investment Management firm, is looking for a contract Data Engineer with strong Python and Databricks skills to help drive their data platform modernisation. You’ll be working on business-critical data pipelines and analytics infrastructure, supporting both investment and … operations teams. This is a hands-on role in a fast-moving environment, ideal for someone who thrives in financial services. What you’ll be doing: Building scalable data pipelines in Python and Databricks Designing data models to support analytics, reporting & regulatory needs Working with cloud-based data platforms (Azure preferred … Partnering closely with data analysts, quants, and tech teams Tech you’ll be using: Python (strong hands-on coding essential) Databricks/Spark Azure Data Lake/Delta Lake SQL/ETL frameworks CI/CD tools and version control (Git, Azure DevOps) What we’re looking for: Strong commercial experience as a Data More ❯

Social network you want to login/join with: Data Architect/Database Analyst, london (city of london) col-narrow-left Client: Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 3 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Role: Interim Data Architect … it can meet the future reporting requirements Assessing the feasibility and desirability of transitioning CDS to a future cloud-based Enterprise Data Warehouse/Data Lake Designing a cohesive data model and data dictionary, Collaborating with business and technology stakeholders to assess, plan and implement effective data solutions which …/manipulation Understanding of Azure SQL Database and Azure SQL Managed Instance Knowledge of Azure Data Factory (ADF) for ETL Processes Experience of Azure Data Lake and Azure Synapse Analytics Microsoft SQL Server 2018 Microsoft SQL Server Integration Services (SSIS) Microsoft SQL Server Profiler SQL Server T-SQL Programming Data Modelling, Design and More ❯

My client, a leading private capital asset manager, is seeking a talented Data Engineer to join their growing Technology team based in London. As a Data Engineer, you will work at the heart of the firm’s data operations, building robust pipelines, modernising reporting frameworks, and enhancing data automation across business-critical … functions. This is a collaborative, hands-on role interfacing with stakeholders across the business to deliver efficient, scalable data solutions. You’ll join a close-knit and dynamic team with direct exposure to senior leadership and the chance to influence Pollen Street’s data architecture as the … firm expands its private credit and equity platforms. Responsibilities Develop and support data pipelines to ingest, transform and manage data in the data lake and warehouse. Design and deliver insightful MI and BI reports from a variety of sources including SQL databases and Excel. Translate business needs into technical reporting requirements, liaising with More ❯

Senior Azure Data Engineer Remote Working - UK Home-based with occasional travel into the office £39,784 - £49,477 (National) £45,456- £55,149 (London within the M25) Additional allowance for exceptional candidates - Max Salary - £62,000 (National) and £67,000 (London within the M25) Homeworking allowance of £581 per annum Job Ref: J12964 A Senior Azure Data Engineer is required to design, build, test and maintain data on the enterprise data platform, allowing accessibility of the data that meets business and end user needs. The successful individual will be responsible for maximising the automations, scalability, reliability and security of data services, focusing on opportunities for re-use … adaptation and efficient engineering. Additionally you will support the team but knowledge sharing and mentoring more junior members of the team. Accountabilities: Design, build and test data pipelines and services, based on feeds from multiple systems using a range of different storage technologies and/or access methods provided by the Enterprise Data Platform, with a More ❯

Data Engineer 6 month initial contract Outside IR35 Hybrid, 3 days a week in London We're working with a Global Consultancy to find data-driven professionals to join them in their digital function. We're looking for individuals who have experience across data engineering, data science, and product development projects. Knowledge … of data mining, machine learning, and natural language processing is an advantage. Skills they're looking for... Python Strong analytical and problem-solving skills with deep expertise in data modeling, ETL processes, data warehousing, and machine learning lifecycle management. Strong experience with Data Lakes SQL Building and managing fully automated data pipelines (ETL, ELT, ELTL) including: Designing and building data interfaces to source systems Combining and transforming data into the appropriate format for storage Developing data sets for analytics purposes Developing pipelines that can handle common issues/errors in a robust and automated way Cloud experience in AWS, Azure, or GCP Experience More ❯

join their team. They are one of the leaders within the Insurance space. They are currently going through a period of growth and are looking for an experienced Data Engineer to join their team. They are backed by a huge Multi National equity firm who are looking to bolster my client's financial position. They are expected to … experience in implementing solutions around Synpase, Azure Data Factory, Onelake, and Fabric. Excellent understanding of Microsoft SQL Server and data modelling, An understanding of One Lake, Data Factory, Notebooks, Fabric (MUST), and Data Pipelines. Strong understanding of the wider Microsoft solution stack. Strong hands-on experience in Data Warehouse … and Data Lake technologies, preferably around Azure. This role is an urgent requirement; there are limited interview slots left. If interested, send an up-to-date CV to Shoaib Khan - S.Khan@Tenthrevolution.com or call 0191 338 7493 for a catch-up in complete confidence. TRG's Data Team offers more opportunities across the UK than More ❯

Senior Engineering Manager – Data Platform Tech Stack Knowledge - Databricks, Kafka, AWS 1 Day a Week Onsite - London We are seeking a customer-centric Senior Engineering Manager – Data Platform to lead the teams responsible for building and evolving our core data infrastructure. In this role, you will oversee the development of our foundational data platform — encompassing experimentation frameworks, event ingestion pipelines, data lakes, governance frameworks, data observability, and real-time analytics capabilities. You will collaborate closely with data scientists, machine learning engineers, backend engineers, and product leaders to ensure our data systems are scalable, secure, observable, and foster innovation across the organization. Key Responsibilities … Partner with cross-functional stakeholders in Product, Data, and Engineering to align strategic goals with platform capabilities. Lead and mentor 1–2 engineering squads focused on experimentation, analytics event logging, batch and real-time data infrastructure, observability, and governance. Define and drive the technical roadmap for a modern data platform, enabling reliable, scalable, and More ❯

a positive contribution to the world of banking and society. THE ROLE We are looking for a visionary and results-driven Head ofData & Analytics to lead our global data strategy, governance, andanalytics initiatives within the Corporate Global IT organization. This role iscritical in transforming data into actionable insights that drive businessperformance, innovation, and competitive advantage. You … into the core of our operations. Additionally, youwill oversee the ownership and evolution of enterprise budgeting andforecasting software, ensuring it supports strategic financial planning andintegrates seamlessly with broader data and analytics frameworks. OPPORTUNITIES You will Data Strategy & Leadership: Define and execute the enterprise-wide data and analytics strategy aligned with global business goals, offering … architecture, data warehousing, and modern analytics platforms (e.g., Snowflake, Power BI, Tableau, Databricks). Hands-on experience with Microsoft Data Factory, Azure Data Lake, and Microsoft Fabric. Strong knowledge of data governance, privacy regulations (e.g., GDPR), and data lifecycle management. Excellent communication and stakeholder management skills. Experience in change More ❯

Social network you want to login/join with: Data and AI - Senior Consultants/Senior Managers, london (city of london) col-narrow-left Client: Wavestone Location: london (city of london), United Kingdom Job Category: Other - EU work permit required: Yes col-narrow-right Job Views: 2 Posted: 16.06.2025 Expiry Date: 31.07.2025 col-wide Job Description: Company Description … For more information, visit www.wavestone.com and become part of our journey to shape a positive and impactful future. Job Description Becoming part of the UK team in our Data & AI Service Line will present new opportunities for you to make a positive impact as we embark on securing major projects with our top international clients. This will mean … working with our FTSE100 clients and beyond on a wide range of advisory projects, bringing deep business and technology expertise to help address Data and AI opportunities and challenges across their organisations. Wavestone has a significant and growing capability in Data & AI that is in high demand from our clients. Our clients trust us to tailor More ❯

Data Engineering Consultant (all levels) We’re working with a globally recognised consultancy that delivers cutting-edge digital, data, and analytics solutions to some of the most complex infrastructure projects across the UK and beyond. With a strong commitment to technical excellence, inclusion, and client impact, they partner with high-profile organisations to help them unlock … the full potential of their data assets. Due to continued growth and demand for their data services, they are expanding their specialist engineering team and seeking talented Data Engineering Consultants at various seniority levels — from experienced engineers to those ready to step into leadership roles. The Role As a Data Engineering Consultant … and contribute to internal knowledge repositories and best practice libraries Key Skills & Experience Strong hands-on experience with Azure tooling, including: Databricks, Data Factory, Data Lake, and Synapse (or similar data warehouse tools) Azure Analysis Services or comparable BI tooling Solid programming capability in: SQL, Python, Spark, and ideally DAX Familiarity with CI More ❯

Data Engineering Manager | Top Brokerage in London | £110,000 - £120,000 Base + Bonus I'm looking for an experienced Data Engineering Manager to join a leading Brokerage in Central London and lead an initial team of 2 Senior Data Engineers. You will be responsible for managing large-scale data pipelines, ensuring … data quality and integrity, and supporting cross-functional teams with reliable and scalable data solutions—primarily using Microsoft Azure, Python, Databricks , as well as the integration of Microsoft Fabric . This role will require 3 days a week onsite in their state of the art office and will remain a technically hands on role. Key Responsibilities … Design, build, and manage scalable data pipelines and ETL/ELT processes in Azure Data Factory , Databricks , and other Azure services. Develop and maintain data models, data lakes, and data warehouses (e.g., Azure Synapse). Use Python for data manipulation, transformation, and automation tasks. Collaborate with data More ❯

My client is based in the London area are currently looking to recruit for an experienced AWS Databricks Data Architect to join their team. They are one of the leaders within the consulting space and are currently going through a period of growth and are looking for an experienced Data Architect to join their team. They … the market. Your role will include: Responsible for designing and implementing effective Architectural solutions around the AWS Severless Technologies (S3, Lambda, Athena, Kafka) and Databricks including Data Lake and Data Warehousing. Assess database implementation procedures to ensure they comply with GDPR and data compliance. Guide, influence and challenge the technology teams and stakeholders … Terraform, Excellent understanding of Data Modelling & Kinesis An understanding of SQL/database management. Strong hands-on experience in Data Warehouse and Data Lake technologies preferably around AWS. My client is providing access to; Hybrid 2 days (London), 28 Days Holiday, Plus Bank Holiday Private Medical Health Pension Scheme And More... This role More ❯

Data Analytics Developer Location: London (Hybrid) Type: Permanent | Full-Time My client is seeking a talented and driven Data Analytics Developer to join our fast-paced and evolving data team. This is a reporting-first technical role, ideal for someone with a passion for building insightful dashboards, collaborating with senior stakeholders, and working at … the forefront of cloud-based data platforms. We're looking for someone who thrives in a dynamic, start-up-style environment - adaptable, switched-on, and ready to take ownership of their work while contributing to the development of our growing data ecosystem. Key Responsibilities: * Design, develop, and maintain high-impact dashboards and reports using Power BI … dashboard/report development and DAX * Solid experience in SQL/T-SQL for data extraction and transformation * Hands-on experience with Azure technologies (Data Lake, Data Factory, Synapse, etc.) * Data modelling experience (star/snowflake schemas, normalization, etc.) * Familiarity with ETL processes and working alongside Data Engineers * Excellent More ❯

Social network you want to login/join with: Data Engineer - Pyspark/Palantir, City of London col-narrow-left Location: City of London, United Kingdom Job Category: Information Technology EU work permit required: Yes col-narrow-right Job Reference: BBBH63893_1748355123 Job Views: 5 Posted: 27.05.2025 Expiry Date: 11.07.2025 col-wide Job Description: Data Engineer … Pyspark/Palantir Whitehall Resources require a Data Engineer with experience with Pyspark & Palantir to work with a key client on an initial 6 month contract. *Inside IR35. *This role will require on site work in London 2-3 days per week. Data Engineer - Pyspark/Palantir Key responsibilities: • Developing Data Stores and Data Warehouse solutions • Design and develop data pipelines bring data from variety of data sources to Azure Databases and Azure Data Lake using self-integration runtime • Work with Product owners and Solution Architect to understand the requirements and deliver in Azure platform, • Design, Estimation and Planning • Executing the PoC/Project More ❯

result in low levels of production issues Awareness of industry best practice and new and upcoming technology trends Full solution architectural understanding across networking and software Experience of data programmes and data technologies, ideally gained within an enterprise scale organisation or within technology or development team or similar. Technical exposure to and/or experience in … a range of technologies and architectural best practice concepts, specifically Data … Engineering Design Snowflake expert with hands-on experience of data modelling and best practises MS Azure Data Stack - Data Factory, Data Lake Storage, Azure SQL, Azure ML, Power BI Automation of CICD pipelines across different technologies including Power BI, Snowflake and the Azure Data Stack Data Science More ❯