1 to 25 of 83 Remote/Hybrid Data Lake Jobs in London

throughout its lifecycle. Modern Data Platforms Design and assure solutions across modern data-platform environments. Contribute to data lake architecture and solutions operating within data lake ecosystems. Assess different approaches to data storage, integration, processing and analytics. Maintain … Capacity planning across complex data environments. Establishing and embedding data governance processes and frameworks. Designing and implementing data lake architectures. Working with solutions built within modern data lake ecosystems. Enterprise-level Data Architecture and strategic data ...

build tool) – modelling layers, testing, documentation, incremental strategies Application Databases Data Integration AWS – S3, RDS, Aurora, Redshift (migration context), Glue, Lake Formation, IAM, VPC Data Governance Data lineage, cataloguing (Apache Atlas/Collibra/Snowflake Horizon), GDPR, BCBS … contracts, schema versioning Redis Cache invalidation, persistence strategy, data consistency MongoDB TimescaleDB NATS JetStream AWS S3/Glue Data lake staging, archival, batch ingestion into Snowflake Partitioning, file format (Parquet/ORC), Lake Formation governance Finance Domain Knowledge Candidates should have hands ...

clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture. The role acts as the design authority, ensuring the solution is secure, scalable, auditable … operating environments with multiple security classifications. Key responsibilities Define the target data architecture and design principles for the AWS data lake and associated ingestion patterns. Design secure data integration patterns across multiple security classifications and operating environments. Specify API-based, file-based, legacy ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data.* Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery.* Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices.* Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

Artefact is a new generation of data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we’re enjoying skyrocketing growth. … leading large scale data engineering projects. Excellent understanding of data architecture involving data mesh, data lake, data warehouse and data lakehouse. Demonstrated experience with Infrastructure as Code tooling such as Terraform Why Joining Artefact? Build the Future ...

automate routine mapping, query optimization, and regulatory documentation. This allows you to focus on driving high-impact platform architecture. Data Fabric & Lake Architecture: Architect and evolve the enterprise semantic data fabric, converting multi-stream clinical execution datasets into an object-centric model. Design and execute … modern Data Lake strategy centred on Apache Iceberg as the core storage format, ensuring high-performance querying and seamless interoperability with Snowflake and heterogeneous compute engines. AI-Accelerated Schema & Pipeline Engineering: Develop and maintain end-to-end multi-stream ingestion pipelines for complex clinical trial schemas. ...

automate routine mapping, query optimization, and regulatory documentation. This allows you to focus on driving high-impact platform architecture. Data Fabric & Lake Architecture: Architect and evolve the enterprise semantic data fabric, converting multi-stream clinical execution datasets into an object-centric model. Design and execute … modern Data Lake strategy centred on Apache Iceberg as the core storage format, ensuring high-performance querying and seamless interoperability with Snowflake and heterogeneous compute engines. AI-Accelerated Schema & Pipeline Engineering: Develop and maintain end-to-end multi-stream ingestion pipelines for complex clinical trial schemas. ...

Lead Solution Data Architect in ARCHITECTURE Leeds, United Kingdom London, United Kingdom Job Description Lead Solution Data Architect in Architecture, Technology Directorate Permanent Full time Location - Leeds or London Flexible Working Options: We support a range of flexible working patterns including hybrid working, flexible start … expertise and demonstrable hands-on design experience with cloud-based services for modern analytics on the Microsoft Cloud (e.g. e.g. Azure Data Lake, Azure Data Factory, Azure Databricks & Unity Catalog, MS Purview, PowerBI, Ms Fabric) Deep expertise in data architecture, including data ...

Title**: Data Architect (with Financial Services)**Location**: London**About the Job you are considering:**We are seeking an experienced Data Architect to lead the design, development, and governance of enterprise-wide data architecture solutions that support business growth, digital transformation, analytics, and data … your home; noting that you will be unable to work at home 100% of the time.**Your Role:*** Design and maintain enterprise data architecture data models and data standards* Define data integration storage and governance frameworks* Ensure data quality security ...

Data Architect – Leading Investment Bank – London/Hybrid (Tech stack: Data Architecture, Enterprise Data Strategy, Data Warehouse, Master Data Management, ERP, CRM, BI, ETL/ELT, Azure Data Factory, Data Lakes, RDBMS, NoSQL, AWS Glue … Capital Markets Data) Our client is a leading global investment bank with a strong presence across financial markets and commodities. They are now looking for an experienced Data Architect to help shape and deliver their enterprise-wide data strategy, working across business and technology ...

Data Architect - Leading Investment Bank - London/Hybrid (Tech stack: Data Architecture, Enterprise Data Strategy, Data Warehouse, Master Data Management, ERP, CRM, BI, ETL/ELT, Azure Data Factory, Data Lakes, RDBMS, NoSQL, AWS Glue … Capital Markets Data) Our client is a leading global investment bank with a strong presence across financial markets and commodities. They are now looking for an experienced Data Architect to help shape and deliver their enterprise-wide data strategy, working across business and technology ...

action, plus an ambitious acquisition strategy bringing exciting new events into our mix. Alongside our market-leading events, we’re building tech and data-driven products that supercharge connections – from one-to-one meeting programs and curated table talks to year-round engagement platforms. Whatever your role … ourselves and others, and remember that optimism wins. If that sounds like you, you’ll fit right in. About you As Director of Data & AI, you will define and execute Hyve's enterprise data and AI strategy, turning trusted data and responsible AI into ...

Senior Data Engineer Department: Services Employment Type: Permanent Location: Remote, UK Description We are seeking a highly skilled Senior Data Engineer to join our team and play a pivotal role in designing, implementing, and managing new data technology infrastructure. You will be responsible … Data Factory, Azure Databricks). Experience with data warehousing concepts and technologies (e.g., Azure Synapse Analytics, Azure Data Lake Storage). Familiarity with big data technologies and frameworks (e.g., Hadoop, Spark) is a plus. Knowledge of data governance ...

Technology Stack You will work with a modern Microsoft data platform including: Azure Data Factory Azure Data Lake Gen2 Azure SQL Database/SQL Server Microsoft Power BI Tabular Models T-SQL PowerShell Azure Cloud Services Experience with the following would be advantageous … modelling techniques. Experience working with large and complex datasets from multiple sources. Expertise in Azure Data Factory, Azure Data Lake and Azure SQL technologies. Strong Power BI and data visualisation experience. Advanced SQL and data transformation skills. Excellent analytical ...

Technology Stack You will work with a modern Microsoft data platform including: Azure Data Factory Azure Data Lake Gen2 Azure SQL Database/SQL Server Microsoft Power BI Tabular Models T-SQL PowerShell Azure Cloud Services Experience with the following would be advantageous … modelling techniques. Experience working with large and complex datasets from multiple sources. Expertise in Azure Data Factory, Azure Data Lake and Azure SQL technologies. Strong Power BI and data visualisation experience. Advanced SQL and data transformation skills. Excellent analytical ...

shape the future of motor insurance? Prima could be the place for you. Since 2015, we’ve been using our love of data and tech to rethink motor insurance and bring drivers a great experience at a great price. Our story began in Italy, where we’ve quickly … expanding to help millions more drivers in the UK and Spain. To help fuel that growth, we need a Senior Data Engineer to join our Engineering team. This team is the beating heart of Prima. You’ll be joining over 350 engineers across software development, infrastructure, operations ...

Engineer in a Data Field Strong Azure data skills, including: Azure Data Factory V2 Azure Data Lake Storage V2 Azure Databricks Azure Function Apps& Logic Apps Azure Stream Analytics Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell … Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of software development practices, such as SOLID principals, structuring code, testing, IOC, etc. Strong repositories, CI/CD skills. Strong knowledge of Kimball data ...

ownership of our data transformation and orchestration tooling; batch and streaming infrastructure and exploration tools (Databricks, Airflow, dbt) and look after our Datalake (ingestion, storage, governance, privacy). You’ll work with a modern, cutting‐edge data stack and play a key role in shaping data … design within a modern cloud‐based environment Advanced experience working and understanding the tradeoffs of at least one of the following Data Lake table/file formats: Delta Lake, Parquet, Iceberg, Hudi Experience working with lakehouse/medallion architectures in Databricks Experience with experimentation support tooling ...

OneLake Developing data models and analytics solutions Power BI development ETL/ELT SQL and SQL Server Azure Data Lake Internal and third-party API integrations Azure DevOps and Git CI/CD and production deployments Supporting existing Synapse solutions during the transition The client … experience across several of the following: SQL Data modelling ETL/ELT development Azure data platforms Azure Data Lake API integrations Git/source control Azure DevOps CI/CD Developing, deploying and supporting production solutions Azure Synapse would be useful but isnt ...

Location: London/Hybrid Working Pattern: Full Time (35 hours) About the role: The Data Engineer will design, build, maintain, and optimise the data platforms, pipelines, and infrastructure that enable PhP to collect, store, process, and analyse data at scale. The role is responsible … developing and supporting reliable data pipelines that integrate data from a range of source systems, including legacy platforms, into centralised data stores. Working closely with product, engineering, and analytics teams, the Data Engineer will help drive data migration initiatives, ensure ...

Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data‐lead, by equipping them with robust data platforms. You'll also join a data team on its mission … data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. Key responsibilities Define, shape and perfect data strategies in central and local government. Help public sector teams understand the value of their data ...

strategic business capability enabling Vodafone to deliver innovative digital products, services, and customer experiences at scale. Achieving this requires an end-to-end, data-led approach across customer journeys, IT systems, and network domains.The Digital & IT Data Science & Engineering Lead is a critical senior leadership role … responsible for establishing data as a strategic product and trusted asset, supporting Vodafone's digital transformation ambitions while ensuring regulatory compliance, operational excellence, and customer confidence. The role is accountable for defining, governing, and delivering end-to-end data, analytics, architecture, and AI capabilities across Digital ...

Lead Data Engineer Department: Technology Employment Type: Permanent Location: Any UK Office Hub (Bristol/London/Manchester/Swansea) Compensation: £80,000 - £96,000/year Description As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping … public sector organisations become truly data-lead by equipping them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. Combining cloud engineering knowledge ...

Senior Data Architect – Wealth & Asset Management Location: London (Hybrid) | Practice Area: Data & Analytics | Type: Permanent Design the blueprint. Architect the future of Wealth & Asset Management. Empower data transformation through modern, AI-enabled ways of working. The Role Capco is seeking a Senior Data … appropriate controls. Bonus Points For Data or cloud architecture certifications, such as AWS, Azure, GCP or Databricks. Experience in data lake design and large-scale data migrations. Familiarity with graph computing, semantic data modelling, or AI-enabled approaches to data ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...