26 to 50 of 243 Data Lake Jobs in London

can solve the world's toughest hiring problems. As a Data Engineer II, you should be an expert with data lake fundamentals around storage, compute, etc., familiar with multiple data processing stacks like Spark, and core data concepts (e.g. Data Modeling). You should have deep understanding of the architecture for enterprise level data lake/mesh solutions using NAWS stack or other cloud stacks. You should be an expert in the design, creation, management, and business use of large data-sets. The … or to scale the existing platform. Our ideal candidate thrives in a fast-paced environment, relishes working with large transactional volumes and big data, enjoys the challenge of highly complex business contexts (that are typically being defined in real-time), and, above all, is a passionate about data More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

Data Engineer | London Market Broker | London/Hybrid | £50 - 55,000 (doe) Are you passionate about designing and optimizing data infrastructures? Do you have a flair for working with large datasets and cloud technologies? We are seeking a highly skilled Data Engineer to join … our client, who are a boutique London market broker. As a Data Engineer, you will play a vital role in developing scalable data pipelines, ensuring data quality, and enabling efficient data processing to support business intelligence and advanced analytics. You will also … be involved in their Cloud migration project. Some key responsibilities include: Design, develop, and maintain scalable and reliable data pipelines. Build and optimize data architectures, data lakes, and data warehouses. Develop ETL/ELT processes to extract, transform, and load data More ❯

Work with us Title: ETRM Data Architect Requisition ID: 46439 City: London Country/Region: GB Introduction We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your … heart of this. Our people are the tip-of-the-spear driving change, come join us! Responsibilities Extensive years of experience working in Data related projects (Data Migration, Data warehouse, Data analytics, Data Visualization, Cloud Platforms) projects in various capacities … Architect, with a focus on Azure. Strong knowledge of Azure data services such as Azure SQL Database, Azure Data Lake, Azure Synapse Analytics, and Azure Data Factory. Proficiency in SQL, Python, or other relevant programming languages. Excellent problem-solving skills and attention More ❯

We are Hiring! We are looking for a passionate and skilled Data & AI Solutions Architect (Pre-Sales) to join our team and help design & sell cutting-edge solutions to our public & private sector customers. Job Description for Data Service Line Practitioner Job Title: Data … UK, US, Europe, the Middle East, and Asia Pacific. Mastek helps enterprises across the spectrum of services including digital experience & engineering, cloud implementations, data, automation & AI, and cloud managed services. A preferred Oracle, Salesforce, Microsoft, AWS and Snowflake partner, Mastek has 6000+ employees and delivers right-fit solutions … to both medium businesses and global Fortune 1000 clients. We are a leading provider of innovative technology solutions focused on transforming businesses through data and artificial intelligence. Our Data & AI service line empowers clients to harness the potential of their data, unlock actionable insights More ❯

Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with cutting-edge technology? If so, we have an exciting new role for … secure clinical data in-motion and at-rest. Shape Data Workflows: Use your expertise with Databricks components such as Delta Lake, Unity Catalog, and ML Flow to ensure our data workflows are efficient, secure, and reliable. Key Responsibilities Data Engineering with … data lakes to support data analytics and machine learning. Requirements Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow. Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration. Clinical More ❯

Data Solutions Architect - Microsoft Fabric London - 3 days a week Up to £95,000 plus a competitive bonus and benefits Industry: Real Estate Role Summary: We're seeking a delivery-focused Data Solutions Architect to lead the design … and oversight of key data initiatives. You'll provide expertise in developing strategic data solutions, including a data lake on Fabric, a data governance platform, and an Asset data programme. Collaboration with security and infrastructure teams is crucial to … ensure aligned data integration across our data estate, consistent with Enterprise Architecture. Key Responsibilities: Data Design: Define standards and guide data modelling activities. Solution Design: Evaluate and recommend optimal data solutions. Strategic Programme Support: Define data requirements, assess More ❯

up our clients' potential, thereby fulfilling our own. Take it seriously. Make it fun. Know it matters. As we develop an enterprise-wide data and digital strategy that moves us toward greater focus on the use of data and data-driven insights, we are … seeking a Data & Digital Solutions Architect. The Data & Digital Solutions Architect is a hands-on, execution focused role helping translate the data and digital strategy to architecture and to execution. In this role you will have an understanding of our data and … and experience working within a data driven organization Hands-on experience with architecting, implementing, and performance tuning of: Data Lake technologies (e.g. Delta Lake, Parquet, Spark, Databricks) API & Microservices Message queues, streaming technologies, and event driven architecture NoSQL databases and query languages Data More ❯

with cutting-edge technology? If so, we have an exciting new role for you! Join our dynamic and forward-thinking team as a Data Engineer and help us build secure, scalable microservices that operationalise clinical research applications. This is your chance to make a meaningful impact on healthcare … to secure clinical data in-motion and at-rest.Shape Data Workflows: Use your expertise with Databricks components such as Delta Lake, Unity Catalog, and ML Flow to ensure our data workflows are efficient, secure, and reliable.Key Responsibilities Data Engineering with Databricks … and data lakes to support data analytics and machine learning.Requirements Expertise in Databricks: Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow.Azure Data Factory Knowledge: Experience with Azure Data Factory for data orchestration.Clinical Data More ❯

Senior GCP Data Engineer (Contract) Position: Senior GCP Data Engineer Location: London (Hybrid 3 days onsite) Contract Type: 12-month Contract Day Rate: £500(Inside IR35) Start Date: ASAP Client: Leading Investment Bank (Cyber Security Division) ?? Why Join Us? Innovative Projects: Lead the development of cutting … edge data solutions within the cyber security domain. Collaborative Environment: Work alongside a team of seasoned professionals in a supportive setting. Professional Growth: Engage in projects that offer opportunities for skill enhancement and career advancement. ??? Role Overview We are seeking a seasoned Senior GCP Data Engineer … to spearhead data initiatives within our cyber security division. The ideal candidate will possess a robust background in data engineering, particularly within the Google Cloud Platform (GCP), and will be adept at designing and implementing scalable data solutions. ?? Key Responsibilities API Development: Design, develop More ❯

an exciting opportunity for an Associate Director to join the Global Decision Sciences & Insights (GDSI) team to help drive our transformation towards a data-driven decision-making organization. This position will be based in our Stockley Park regional headquarters in Uxbridge (UK) and will be reporting to the … Senior Director leading the overall group. This exciting role will bring our global commercial data assets to life through oversight and ownership of our data processes, ensuring our data is effectively onboarded onto the new cloud platform and stitched with other data … as well as ad-hoc and advanced analytics). This includes management and ownership of our ICF (International Cloud Foundation) global data lake, owning the Data Products and several key dashboards built on ICF. Success in this role will require collaboration and effective stakeholder management More ❯

Services Singapore Private Limited This role will focus on advising customers looking to enhance their business or operational outcomes through the use of Data and Analytics on AWS. In this role you will advise on architecture best practices, lead projects, manage customer stakeholders, conduct customer workshops, and implement … complex Data workloads with our customers and partners. Key job responsibilities Advise customer's technologists and business leads; help them to explore the art of the possible with Data and Analytics, and to develop scalable Data solutions on AWS to deliver business value in … experience with direct customer (internal or external) interaction with responsibilities in Data and Analytics solutions design, architecture, and implementation (Data Lake, Data Warehouse, Lake House, Data Mesh, Data as a Product and Data Governance including Data More ❯

Delivery Consultant - Data Analytics, ASEAN Professional Services Job ID: Amazon Web Services Singapore Private Limited The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers … Experience with direct customer (internal or external) interaction with responsibilities in Data and Analytics solutions design, architecture and implementation (Data Lake, Data Warehouse, Lake House, Data Mesh, Data as a Product and Data Governance including Data … GDPR) - Strong communication skills with the ability to explain technical concepts to both technical and non-technical audiences - Technical experience preferred, knowledge of Data Technology stack of AWS and integration with Machine Learning and Generative AI - Ability to obtain Singapore government security clearance Our inclusive culture empowers Amazonians More ❯

Sr. Delivery Consultant - Data Architect, ProServe SDT North The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS solutions … the organization through mentoring, training, and creating reusable artifacts BASIC QUALIFICATIONS - 5+ years' experience architecting and implementing data platforms (Data Lake, Data Lakehouse, Data Mesh, Data Warehouse) at enterprise scale - Experience building end-to-end data solutions … including data ingestion (batch/streaming), storage, orchestration, governance, security, analytics, and observability. - Highly technical and analytical mindset with ability to think strategically about business, product, and technical challenges in an enterprise environment - Extensive hands-on experience with data platform technologies, including at least three of More ❯

Job Details: Enterprise Data Governance & Architecture Lead Job Title: Enterprise Data Governance & Architecture Lead Reports to: Head of Technology Data, Architecture & Technology Strategy Department: Technology Location: Leeds/Manchester/Bristol/Glasgow DEPARTMENT DESCRIPTION The Data Platform team is a key … component of C4's Technology organization that provides an enriched and valuable ecosystem of data platform and data services that drive innovation for our partners and clients, within C4. Data is the most valuable asset in C4. The Data Platform Department is … dedicated to developing advanced technology (e.g. Cloud, Machine Learning and Big Data), systems and services to make data secure, high quality, rich, fast, and easy to use, enabling C4 to leverage its data asset effectively and timely to maximize technology/business development and More ❯

Data Architect - Active SC Clearance, Data Market Rate (Outside IR35) Location: London/Remote Duration: 6 months initially (Jan 2025 start) My client is an International Consultancy, who requires a Data Architect that holds an Active SC (Security) Clearance, and an in-depth understanding … of modern Data architectures including Data Lakehouse, Data mesh, to work closely with a key end client. Key Requirements: Active Security Clearance (SC) Proven experience as a Data Architect with knowledge of end-to-end Data Architecture Demonstrable experience in … defining and building BI/Data Warehouse Logical and Physical models, including normalised and dimensional models, as well as Data Lake architectures. Knowledge of Conceptual, Logical, and Physical Data Models Confident with mapping data from source to target. Ability to define More ❯

on growth in the UK and Europe, now is the perfect time to join us on this high-speed journey. Position: Head of Data Engineering & Architecture Location: London (Hybrid, 40% in office) Salary: £Salary + Bonus + Equity + Benefits We are recruiting for an experienced Head of … expert in data engineering infrastructure, technologies and practices. Have deep expertise in data modelling and warehouse design in the modern, lake house era. Are an experienced and committed people manager with technical leadership experience. Are passionate about agile software delivery with a track record of … and Airflow Docker and Terraform Kafka, Spark, Kafka Streams and KSQL DBT AWS, S3, Iceberg, Parquet, Glue and EMR for our Data Lake Elasticsearch and DynamoDB More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy, 2-for-1 share purchase More ❯

Key Responsibilities My client are expanding their data and technology capabilities and seeking a skilled Data Engineer to join this growing team. The successful candidate will help ingest, cleanse, and model data into unified, analytics-ready datasets supporting Business Intelligence, machine learning, and Data … -focused role Strong hands-on experience with Azure data services, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps & Logic Apps Azure Stream Analytics Azure Resource Manager tools: Terraform, Azure Portal, Azure CLI, and Azure PowerShell … Proficient in PySpark, Delta Lake, Unity Catalog, and Python Ability to write unit and integration tests using unittest, pytest, etc. Solid understanding of software engineering principles, including SOLID design, dependency injection, code structuring, and testing Experience with version control systems and CI/CD pipelines In-depth knowledge of More ❯

Key Responsibilities My client are expanding their data and technology capabilities and seeking a skilled Data Engineer to join this growing team. The successful candidate will help ingest, cleanse, and model data into unified, analytics-ready datasets supporting Business Intelligence, machine learning, and Data … -focused role Strong hands-on experience with Azure data services, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps & Logic Apps Azure Stream Analytics Azure Resource Manager tools: Terraform, Azure Portal, Azure CLI, and Azure PowerShell … Proficient in PySpark, Delta Lake, Unity Catalog, and Python Ability to write unit and integration tests using unittest, pytest, etc. Solid understanding of software engineering principles, including SOLID design, dependency injection, code structuring, and testing Experience with version control systems and CI/CD pipelines In-depth knowledge of More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from … architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This More ❯

Role: Data & Migration Workstream Lead Location: London (Oxford Circus) Hybrid: 1-2 days per week in the office About Monument Technology Limited In building its core UK banking business, Monument has developed an open, scalable, cloud native and world-leading banking technology platform, the third pillar of the … a fraction of the cost. From front end mobile apps, through core banking and CRM to the general ledger and a data lake, the platform can be consumed in whole (“bank in a box”) or in part as required. Our technology stack has gained positive attention from … architecture allows the platform to scale globally with many components adaptable to other geographies. THE ROLE We’re looking for a highly experienced Data & Migration Workstream Lead to drive the planning, execution, and delivery of all data-related activities across multiple complex projects and workstreams. This More ❯

DATA ARCHITECT Location: London, UK Reporting To: SVP, Technology Contract Term: Full time, permanent About LIV Golf The LIV Golf League is the world's only global golf league featuring 13 teams, a 14-tournament schedule, and many of the world's best golfers. Launched in 2022, the … level and create new value within the golfing ecosystem while enhancing the game's societal impact. Role Objective We are seeking a visionary Data Architect to lead the design, implementation, and optimization of LIV Golf's enterprise data ecosystem. This role will focus on building scalable … data infrastructure that supports real-time analytics, player performance tracking, fan engagement, and business intelligence initiatives. The ideal candidate will have a passion for sports, a deep understanding of data architecture, and a knack for solving complex data challenges in a dynamic environment. Responsibilities More ❯

Exciting Opportunity in Health Tech! Position: Data Engineer (Python/Databricks) Location: Remote Salary: up to £80,000 + Bens Reporting To: Vice President of Software Development Are you passionate about health tech and innovation? Do you want to be at the forefront of transforming clinical research with … secure clinical data in-motion and at-rest. Shape Data Workflows : Use your expertise with Databricks components such as Delta Lake, Unity Catalog, and ML Flow to ensure our data workflows are efficient, secure, and reliable. Key Responsibilities Data Engineering with …/CD pipelines and manage container technologies to support a robust development environment. Requirements Expertise in Databricks : Proficiency with Databricks components such as Delta Lake, Unity Catalog, and ML Flow. Azure Data Factory Knowledge : Experience with Azure Data Factory for data orchestration. Clinical More ❯

agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products. As a Senior Lead Data Lake Engineer at JPMorgan Chase within the Corporate Technology, Chief Data and Analytics Office Development Team, you will play a pivotal role in … discipline (e.g. data ingestion, data storage, data serving, APIs, etc.). Hands-on experience in data lake or data warehouse and related technologies (e.g. Spark, ETL, Databricks). Hands-on applied experience delivering system design, application development, testing, and More ❯

Databricks Data Engineer - Contract Day Rate: £450 - £550 P/day Location: Hybrid (Remote/2 Days a week in London) Start: Immediate Start Note: Capital Markets, or at least Banking experience is a MUST … Key expertise and experience we're looking for: Data Engineering in Databricks - Spark programming with Scala, Python, SQL Ideally experience with Delta Lake Databricks workflows, jobs, etc. Familiarity with Azure Data Lake: experience with data ingestion and ETL/ELT frameworks Data Governance experience - Metadata, Data Quality, Lineage, Data Access Models Good understanding of Data Modelling concepts, Data Products and Data Domains Unity Catalog experience is a key differentiator - if not then experience with a similar Catalog/Data More ❯