1 to 25 of 70 Permanent Data Lake Jobs in London

Acquisitions, and Citi Commercial Bank client segments in over 100 countries. As a critical component of the TWCS Business Execution team, the Data Organization is responsible for establishing and implementing the overall data strategy and governance framework, ensuring high-quality data to drive business … value. This Director-level role is a senior global position responsible for defining and executing the data strategy and roadmap, aligned with various Lines of Business (LOBs) that act as domain owners for their respective products. The role is pivotal in delivering the Technology Book of Work assigned ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

solutions* Evaluate and recommend architectural approaches for data storage, processing, and consumption, including lakehouse, data warehousing, and data lake patterns* Design technical architecture for cloud-based data platforms (AWS preferred: Redshift, Athena, S3, Glue)* Create and maintain architecture documentation, including data … tools that enhance Arriva's data and BI capabilities* Stay current with emerging trends including open table formats (Apache Iceberg, Delta Lake), data observability, real-time/streaming architectures, and cloud-native solutions* Conduct proofs-of-concept and technical assessments to validate new technologies before ...

IaaS, specifically: App Services, Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake & Fabric. Understand which Azure data focused components to use for which purpose.Microsoft certified architectDatabricksDesign and build high-performance data platforms: Utilize … Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services.Ability to Design, Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and Azure ML to develop predictive ...

initiative delivery outcomes. The supplier will validate data across the full data lifecycle, including ingestion, transformation, data lake, data warehouse, reporting and BI, APIs, metadata, lineage, and reconciliation.**Assignment Tasks/Deliverables**Full Stack Data Quality Engineering:* Design … execute data quality testing across ingestion, transformation, warehouse, reporting/BI, APIs, metadata, lineage, and reconciliation layers.* Validate Snowflake data lake and data warehouse outputs against source systems, business rules, transformation logic, and reporting requirements.* Test ETL and ELT processes, dbt models ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

Description The Role We are seeking a capable Consulting Data Architect to join our Insurance Technology Consulting practice and play a pivotal role in shaping, selling, and delivering data-led consulting engagements for insurance clients. Location: London, United Kingdom (Hybrid) Scope: UK-Based Role with Global … secure enterprise data platforms using technologies such as Microsoft Fabric, Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, Databricks, and Snowflake. Data Management, Governance & Controls – Experience establishing data governance frameworks, operating models, metadata management, lineage, cataloguing, data ...

best practices, and provide guidance to both technical and non-technical stakeholders. The role includes working to the Information Manager and Head of Data, contributing to the direction of BI initiatives and supporting the wider information team with data analysis, ad hoc requests, national/regional … mandatory returns, FOIs, and data transformation work, primarily using SQL. Main duties of the job Business Intelligence Support: Provide information to support the clinical and business needs of the trust, adopting a subject matter expert (SME) role within an area or more, shape/lead on best practice ...

Senior Databricks Architect Technology: Databricks (Spark, PySpark/SQL) and data lake architectures. Location: London, UK. Compensation: Competitive (including bonus). Job Description We are looking for a Data Architect to design, build, and operate scalable data pipelines and data products … support analytics, reporting, and domain-owned data products. Primary Skills Strong experience with Databricks (Spark, PySpark/SQL) and data lake architectures. Hands‐on experience with streaming technologies, especially Kafka/Confluent Kafka. Experience integrating legacy data sources such as DB2 (mainframe ...

work. Join us and build for travelers everywhere.Expedia Group seeks a motivated and results-oriented Senior Software Engineer to join our Data Lake and Catalog team.As a Senior Software Engineer on an industry-leading data platform, you will build the core of Expedia Group … with tools like Circus Train , a Hive dataset replication tool, and Waggle Dance , a federation service that allows access to data lake tables across multiple catalogs. Recently, we added Hive support to Apache Iceberg , a high-performance open table format for large analytic datasets that underpins many ...

Business Intelligence tools that are used to monitor compliance against the Trust Performance Assurance Framework, external and internal reporting requirements and escalating major data quality issues to the Information Manager and Head of Information. Main duties of the job Key responsibilities o To oversee the delivery … responsible for evaluating key business intelligence reports identified by pan organisational strategic developments, combining detailed operational awareness with knowledge of data and systems. Support cultural changes with regards to mobilisation and usage of business intelligence data. o To lead on the communication of complex technical specifications and intelligence ...

Title: Senior Principal Data Architect Role Summary (Executive View): Lead enterprise-scale data architecture, governance, and delivery oversight across cloud and AI-enabled ecosystems, driving modern data platforms, MDM excellence, and business-aligned outcomes. Key Responsibilities: Own end-to-end Data Architecture … strategy across enterprise platforms (Cloud, On-prem, Hybrid). Drive Delivery Governance ensuring quality, timelines, financials, and stakeholder alignment. Establish and operationalize Data Governance frameworks (data quality, lineage, catalog, compliance). Lead and enhance Informatica MDM (multi-domain) implementations, upgrades, and optimization. Architect Cloud Data ...

Principal Data Engineer Lead the design and delivery of a modern cloud-based data platform, driving engineering standards, architecture, and innovation across a growing data function. The Opportunity This is a senior technical leadership role responsible for shaping data engineering strategy, architecture … best practices across multiple product domains. Working within a modern cloud environment and Data Mesh architecture, you will drive the development of scalable, secure, and high-performing data solutions while mentoring engineers and influencing technical direction. Key Responsibilities Provide technical leadership across data engineering ...

Fabric Data Engineer Up to £70,000 - West London (Hybrid - 1 Day Onsite) We are partnering with a well-established international organisation operating within a sustainability-led sector that is investing heavily in its technology and data capabilities. As part of an ambitious digital transformation programme … particularly within Fabric Notebooks Exposure to Azure data technologies such as Azure Data Factory, Synapse Analytics or Data Lake What's on Offer Salary up to £70,000 Hybrid working model with 1 day per week onsite in West London Opportunity to work ...

Azure Data Engineer Rate - up to £350/day Outside IR35 Location - 2 days a week onsite in Central London Duration - 6 Months + Likely Extension We are working with a well-established consultancy supporting a high-impact data transformation programme for an end client based … Analytics . Optimise ETL/ELT processes to improve performance, reliability and efficiency. Integrate multiple data sources including Azure Data Lake (Gen2), SQL-based systems and APIs. Collaborate with Data Architects, Analysts, and stakeholders to define data models and ensure best ...

Data Engineer | Microsoft Fabric | Dynamics 365 | £65,000 | Hybrid (Brentford, 1 Day per Week) I'm working with a forward-thinking organisation that is making significant investment in its data, analytics, AI, and automation capabilities. As part of a major digital transformation programme, they are looking … stakeholder management experience Desirable Experience PySpark and/or Python development Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Storage Power BI development and data modelling Exposure to AI, Machine Learning, or advanced analytics projects Microsoft certifications such ...

Engineering, translating finance requirements into data solutions and managing development priorities. Administer and support the ongoing development of the Global Finance Datalake and Forecasting & Budgeting (FaB) tool, including user access, process configuration and governance. Work with Finance data stakeholders across the Group to resolve system … sets. Desirable: experience with TM1 Planning Analytics, Microsoft Dynamics 365 and/or Microsoft Fabric. Experience with enterprise reporting or data lake tools is preferred; prior exposure to a finance function would be beneficial. Salary will depend on experience and is expected ...

Engineering, translating finance requirements into data solutions and managing development priorities. Administer and support the ongoing development of the Global Finance Datalake and Forecasting & Budgeting (FaB) tool, including user access, process configuration and governance. Work with Finance data stakeholders across the Group to resolve system … sets. Desirable: experience with TM1 Planning Analytics, Microsoft Dynamics 365 and/or Microsoft Fabric. Experience with enterprise reporting or data lake tools is preferred; prior exposure to a finance function would be beneficial. Salary will depend on experience and is expected ...

Title: Snowflake Data Architect Salary: Paying up to £90,000 per annum Location: Wembley London - 5 days on-site Our client, a well-established and diversified multinational organisation, is seeking a Snowflake/Data Architect to join their team. Skills Solid experience in Data … experience with dbt (data build tool) or equivalent transformation frameworks. AWS Integration : Solid understanding of AWS IAM, S3 data lake patterns, and PrivateLink for cross-cloud data connectivity. AI Readiness : Practical experience architecting data infrastructure for AI/ML consumption - vector ...

Data Solution Architect - Customer £750.00 per day (Umbrella) 6 Month Contract London (Hybrid) Our client is seeking an experienced Data Solutions Architect to design customer data solutions within our Data Architecture & Design Team. In this role, you will collaborate with stakeholders … Proven experience designing and/or selecting secure, scalable, performant Customer data solutions in a Retail environment Understanding of data lake/lakehouse solutions and their role in Customer data architecture Strong knowledge of Analytics and Reporting best practices for Customer insights Familiarity ...

validate all technical designs and implementation plans of the 3rd party SI/vendors Provide technical knowledge and understand of existing applications, data & integration configuration Own collation and delivery of Control Risks’ Non‐Functional Requirements to the project Accountable for the assurance of the technical design, system configuration … Agile environment Desirable Implementing and supporting Microsoft D365 solutions, Microsoft Power Platform solutions and Microsoft Data solutions (Data Lake, Data Factory, Data Warehouse) MS SQL DB, TSQL language, ETL, SSRS, SSIS Experience Dataverse, Common Data Services, Synapse Experience Strong ...

Aker Systems was founded in 2017 by a team of experienced technology professionals who recognised an opportunity to provide highly secure enterprise data platforms to large organisations. Aker builds and operates ground-breaking, ultra-secure, high performance, cloud-based data infrastructure for the enterprise. Our proprietary … Platforms designing modern data platforms with appropriate architecture coving Data Mesh, Data Fabric, Data Lake etc. Data/Analytics - solving enterprise data and analytics problems using technology Cloud - hands-on Public Cloud experience in either ...

impressive multinational firm is looking for an accomplished Data Architect to join its team. Please note the role is hybrid – you will work from the office 3 days per week with 2 from home.In this role, you will be responsible for designing, developing, and maintaining scalable data … Fabric and Azure data services, including technologies such as Databricks, Data Factory, Azure SQL Managed Instances, and Data Lake solutions. You will have a proven track record of designing and optimising data warehouses and large-scale data platforms, supported ...

Title: Azure AI Data Engineer Location: London Hybrid Start Date: August Job Type: Contract - Inside IR35 We are seeking an experienced Azure AI Data Engineer to support the delivery of cutting-edge AI, data and analytics solutions within a large-scale digital transformation programme. … ready data platforms Engineer solutions for structured, semi‐structured and unstructured data Work with Azure Data Lake, Cosmos DB and Azure SQL/Synapse Support AI use cases including RAG, vector search and Azure AI Search Collaborate with business stakeholders to translate requirements ...

impressive multinational firm is looking for an accomplished Data Engineer to join its team. Please note the role is hybrid – you will work from the office 3 days per week with 2 from home.In this role, you will be responsible for designing, developing, and maintaining scalable data … Fabric and Azure data services, including technologies such as Databricks, Data Factory, Azure SQL Managed Instances, and Data Lake solutions. You will have a proven track record of designing and optimising data warehouses and large-scale data platforms, supported ...