1 to 25 of 235 Data Lake Jobs in London

+ Excellent Benefits | Permanent Azure Data Platform | Azure Architecture | Data Platform Design | Databricks | Data Factory | Data Lake | Synapse Are you an experienced Azure Data Platform Manager, Azure Data Architect or Data Platform Lead with … solutions, defining data architecture and making technical design decisions across Azure Data Factory, Azure Databricks, Azure Data Lake, Azure SQL and Azure Synapse. You'll combine deep Azure Data Platform knowledge with leadership, stakeholder management and project delivery experience, helping ...

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

service provision from third‐party providers. This role will own the development of the Group’s data platforms — including data lake, data warehouse, and analytics tooling — with a strong emphasis on Microsoft Fabric and modern cloud‐based data engineering practices. … architecture, modelling, and governance frameworks. Hands‐on experience building data warehouses and data pipelines. Experience with modern data‐lake technologies — ideally Microsoft Fabric, Azure Data Lake, or similar. Strong knowledge of data integrity, quality tooling, and metadata management. ...

Perform data profiling, root cause analysis, and data quality assessments. Develop and optimise data warehouse, data lake, and lakehouse solutions. Produce source-to-target mappings, transformation rules, and technical documentation. Support data governance, security, and compliance requirements. Work collaboratively … Functions Amazon QuickSight Microsoft Azure Technologies Strong practical experience with: Microsoft Fabric Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Data Engineering Strong knowledge of: ETL and ELT design patterns Data Integration architectures Data Warehousing ...

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

from a wide range of legacy and enterprise source systems, and establishing scalable data flows into Azure Data Lake and Databricks. A key part of the role will also involve integrating data into a proprietary data transformation solution where … applicable. Key Skills & Experience Azure Data Engineering Azure Data Factory (ADF) Azure Data Lake Databricks Building ETL/ELT pipelines Large-scale data migration and integration Oracle and/or Oracle Fusion data sources SharePoint data extraction ...

Role Overview We are looking for an experienced Data Architect . This role will be responsible for defining and delivering data architecture that supports key business capabilities across risk, placement, broking, analytics, and operational data domains. The successful candidate will bring strong data … NoSQL technologies, including MongoDB Knowledge of document-based and operational data models Data warehousing and/or data lake architecture Metadata, lineage, and data governance Cloud platforms such as Azure, AWS, or GCP Strong analytical, problem-solving, and communication skills Domain ...

configure and support Microsoft Fabric solutions for our clients across public and private sector environments. This role will support the delivery of modern data platforms, analytics services and integrated data solutions, helping customers make better use of their data through Microsoft Fabric, Power … best practice. Experience with Azure data services such as Azure Data Factory, Azure Synapse Analytics, Azure SQL, Data Lake Storage or Databricks would be advantageous. Understanding of data governance, security, access control, data quality and data lifecycle ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

wider Data Engineering team, they will help shape, validate and consume the underlying pipelines, data warehouse and data lake that feed reporting, flagging data quality issues and new data needs as they arise. Working closely with stakeholders across … data standards Design, build and maintain data pipelines and the underlying data platform (Azure Synapse, Data Lake, Microsoft Fabric) that feeds reporting and analytics Monitor, troubleshoot and resolve data pipeline and platform issues, ensuring high availability and reliability ...

Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. … leading large scale data engineering projects. Excellent understanding of data architecture involving data mesh, data lake, data warehouse and data lakehouse. Demonstrated experience with Infrastructure as Code tooling such as Terraform Why Joining Artefact? Build the Future ...

diverse, ambitious team that celebrates creativity and collaboration. Ready to make your mark? Join us and be part of something bigger. As a Data Architect (Manager) in Kainos, youll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … capacity planning across heterogeneous data store technologies. Experience of establishing data governance processes Experience of architecting a data lake and solutions that reside within a data lake ecosystem Enterprise Data Architecture experience. Embracing our differences At Kainos ...

Data Engineering Lead Department: CSG - Operations Hub (Data/Intelligence/Support) Employment Type: Permanent Location: London - Woolgate Description We are looking for an experienced Data Engineering Lead to play a pivotal role in shaping and delivering our enterprise data platform. This … experience with Microsoft Azure data technologies, including: Azure Data Factory Azure Synapse Analytics Microsoft Fabric Azure Data Lake Advanced SQL development skills. Proficiency in Python and modern data pipeline orchestration tools, including their monitoring and automation. Track record of building reliable ...

Description Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … sources including API/feed handling and working with distributed data environments. Some other valued skills may include: Cloud & Data Lake Fundamentals: Exposure to AWS, data lake architectures, and catalogue‐based querying environments, supporting scalable data processing. Data ...

while individuals can do well, together we achieve something extraordinary. Role Purpose We are building a new R&D capability focused on developing data-driven and AI-enabled products for legal services and the wider business of law. The Data Scientist & Engineer will work within … workflows, coupled with rigorous validation of code, data transformations and analytical conclusions. Desirable Skills and Experience Experience with Azure Data Lake, Azure Data Factory, dbt, Airflow, MLflow, Power BI, Microsoft Purview or comparable tools. Experience with search indexes, vector databases, graph databases, knowledge ...

hackajob is partnering directly with Barclays to hire for this role. Join us as a Data Engineer within our Markets Post trade technology division where you will be accountable for delivering a set of enterprise, non-negotiable data strategy outcomes across the end-to-end lifecycle. … sources including API/feed handling and working with distributed data environments. Some other valued skills may include: Cloud & Data Lake Fundamentals: Exposure to AWS, data lake architectures, and catalogue-based querying environments, supporting scalable data processing. Data ...

automate routine mapping, query optimization, and regulatory documentation. This allows you to focus on driving high-impact platform architecture. Data Fabric & Lake Architecture: Architect and evolve the enterprise semantic data fabric, converting multi-stream clinical execution datasets into an object-centric model. Design and execute … modern Data Lake strategy centred on Apache Iceberg as the core storage format, ensuring high-performance querying and seamless interoperability with Snowflake and heterogeneous compute engines. AI-Accelerated Schema & Pipeline Engineering: Develop and maintain end-to-end multi-stream ingestion pipelines for complex clinical trial schemas. ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

## Senior Data Platform Engineer (Data Lake and Catalog)Apply: UK - London: Full time: Posted 2 Days Ago: End Date: October 19, 2026 (28 days left to apply): R-107322At Expedia Group, we help travelers explore the world, one journey at a time. … work. Join us and build for travelers everywhere.Expedia Group seeks a motivated and results-oriented **Senior Software Engineer** to join our **Data Lake and Catalog** team. As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group ...

## Lead Product Performance Data Analyst, GlobalApply: London, England: Full time: Posted Today: R24596# **About Vantage**Vantage powers, cools, protects and connects the technology of the world’s well-known hyperscalers, cloud providers and large enterprises. Developing and operating across North America, EMEA and Asia Pacific, Vantage … estimating data, change data, and benchmark reference points.* Experience with Databricks, Microsoft Fabric, Snowflake or equivalent data lake platforms and associated data governance services.* Dimensional data modeling or semantic model design for Power BI or similar platforms.* Python experience ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

world’s well-known hyperscalers, cloud providers and large enterprises. Developing and operating across North America, EMEA and Asia Pacific, Vantage has evolved data center design in innovative ways to deliver dramatic gains in reliability, efficiency and sustainability in flexible environments that can scale as quickly … estimating data, change data, and benchmark reference points. Experience with Databricks, Microsoft Fabric, Snowflake or equivalent data lake platforms and associated data governance services. Dimensional data modeling or semantic model design for Power BI or similar platforms. Python experience ...

experienced Senior Business Analyst is required to support the delivery of a large-scale data marketplace programme. The role will focus on data governance, data modelling, taxonomy development, data-sharing frameworks, and stakeholder engagement. You will help define standards, governance models … quality, and metadata management. Experience working with modern cloud data platforms such as Databricks, Snowflake, Microsoft Fabric, Azure Data Lake, or similar technologies. Knowledge of data catalogues, data lineage, master data management, and data governance tooling. ...

Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place … Unity Catalog. Strong knowledge of cloud ecosystems (AWS, Azure, GCP) and infrastructure-as-code (Terraform, CloudFormation). Hands-on expertise with data lake/lakehouse architectures and modern streaming solutions. Experience with SQL, NoSQL, ETL/ELT pipelines, and programming languages (Python, R, Java). Familiarity with ...