1 to 25 of 121 Data Lake Jobs in the UK excluding London

insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted and actionable insight … Engineering & Platform Leadership * Lead the design, development and ongoing management of the Society's data architecture, including the data lake and associated data environments. * Ensure robust, scalable and secure data pipelines are in place to support timely and accurate data ...

Lead Funds Data Architect will be a pivotal member of our team, responsible for bridging the gap between business needs and technical solutions within the Funds domain. This individual will lead the design, development, and implementation of data strategies and architectures that support Fund accounting, Fund … Administration, ETFs, IBOR (Investment Book of Record), ABOR (Accounting Book of Record), and various regulatory and client reporting functions. A profound understanding of data governance, data lineage, data modeling, and core data concepts specific to the investment and funds industry is paramount. ...

Data & Automation Lead, Data Laking, Data Lake, Data Lakes, AWS, AI, LLM, Automation, Part Remote, Part Central London AI Data & Automation Lead required to work for a fast growing and already established company based in Central London. This … more details... Key Responsibilities Lead the design and evolution of a modern data architecture, leveraging cloud-based data lake technologies and scalable data engineering practices. Define and deliver a roadmap for transforming investment operations through automation, workflow modernisation and AI enabled solutions. Build ...

risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience in Big Data and Data Lake environments , including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will … automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence Big Data & Data Lake Testing Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets Validate large-scale ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

properly articulated, understood, and realized as secure and robust solutions. Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … such as UML) or tools such as ERwin, Power Designer, or MagicDraw. Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. Knowledge ...

responsible for building and operating an Azure-based data platform, ensuring it provides a secure, scalable and trusted data lake using Azure Databricks. Working alongside data architects and engineering teams, you will help deliver new data products, onboard data … external data sharing. Implement data governance, security, access controls, backup, retention and monitoring to maintain the data lake as a trusted single source of truth. Develop and maintain data ingestion, transformation and data product pipelines. Collaborate with data ...

measures, calculations, and critical data elements. Support the migration of data and reporting assets into an Azure Data Lake environment. Build and maintain Power BI reports and dashboards. Develop reporting and analytics solutions to improve business insight and operational efficiency. Support data … measures, calculations and critical data elements. Knowledge of ETL frameworks and data integration processes. Experience with Azure Data Lake and dimensional modelling. Background in both data analytics and data engineering Hays Specialist Recruitment Limited acts as an employment agency ...

reporting and analytics * Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts * Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: * Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service * Architecture and design concepts ...

accountability for end‐to‐end data architecture. Strong understanding of data modelling, data warehousing and data lake architectures (e.g. lakehouse patterns), and data integration using event driven and API led approaches. Experience designing architectures across hybrid cloud … MODCloud – ICE, ACE environments AWS data services (e.g. S3, Redshift, EKS, Kinesis) Azure data services (e.g. Data Lake, Synapse, AKS) GCP Kubernetes‐based platforms and containerised data services Telicent Understanding of NATO data standards, interoperability requirements, or multi‐national ...

everyone has access to healthcare today and for generations to come. Join Roche, where every voice matters. The Position Job Description The Principal Data Architect, Information Architect, and Lead Data Modeler drives the strategic vision, structural design, and semantic definition of the organization’s enterprise data ecosystem. This role bridges the gap between high-level business strategy and technical execution, leading the design of scalable data architectures, comprehensive information blueprints, and robust enterprise data models. As a Principal Data Architect, you will champion data democratization, mentor ...

data migration using AWS-native tools such as DMS, Glue, DataSync, Step Functions, Redshift, Athena, Lambda, RDS, EC2, S3 Data Lake, and CloudWatch. Strong knowledge of data extraction, transformation, and loading (ETL) processes, leveraging tools such as Talend, Informatica, Matillion, Pentaho, MuleSoft, Boomi … security features (IAM, KMS, RBAC). Knowledge of Azure data engineering tools (ADF, Azure DB, Azure Synapse, Azure Data Lake, Azure Monitor) for hybrid migration scenarios. Proficiency with cloud automation/orchestration tools such as Terraform and Airflow. Strong analytical skills to assess data ...

reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts* Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … delivery outcomes.We're looking for demonstrable experience in:* Multiple data storage technologies used in data warehouse and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ ...

queries, stored procedures and analytical views within Azure Synapse Analytics. Manage data ingestion, transformation and storage across Azure Data Lake Storage (ADLS) and Azure SQL environments. Support processing of structured and semi-structured data formats, including Delta Lake and JSON. Collaborate with …/ELT pipelines. Experience with Change Data Capture (CDC) and data migration frameworks. Knowledge of Azure Data Lake Storage (ADLS) and Azure SQL Database. Experience working with Delta Lake and JSON data formats. Minimum 5 years' experience within cloud-based ...

modern data platforms using Microsoft Fabric, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, Azure SQL and Data Lake technologies . Proven experience implementing Lakehouse, Data Warehouse and Medallion Architecture patterns, including data modelling, governance and performance optimization . … PySpark for data engineering, analytics and automation workloads. Experience with Azure Databricks and/or Microsoft Fabric engineering workloads, including notebooks, Delta Lake, data transformation, optimization and operationalization of data solutions. An understanding of data governance, security, lineage and data ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

Venesky-Brown’s client, a public sector organisation in Glasgow, is currently looking to recruit Data Modeller for initial 8 month contracts with potential to extend on a rate of £526/day (Inside IR35). These roles will be hybrid working with a minimum of 2 days … week in their Glasgow office. Responsibilities: - The Data Modeller will be responsible for designing, developing, and maintaining high-quality data models and datamarts that support analytical and reporting needs. They will translate business requirements into scalable, performant, and well-structured data models that enable ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

Data Engineer | Hybrid | South Wales | 3 months initially | Outside IR35 IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team … modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control ...

Role: Data Engineer Location: Remote but able to attend client sites in Doncaster/London Exp. Start Date: ASAP Contract Duration: 6 Months initially Rate: £500 per day (Umbrella) Job Specification: See attached Experience Oracle experience beneficial Snowflake experience Experience Working with Data teams IDMC, Kafka … data sources. Understanding of Data Architecture patterns/Data lakes/kimbol Practical experience of Platforms Cloud platforms structuring Data Relational database Snowflake going through the cloud platform Informatica experience Change data capture experience Working with various data ...

Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … Data Engineer or Solutions Architect Strong expertise in Databricks, Apache Spark, PySpark and SQL Experience designing and implementing modern data lake or lakehouse architectures Hands-on experience with Kafka Strong understanding of AWS data services, particularly Amazon S3 Experience integrating data ...

Title: HR Data Delivery Lead Role Overview A new data lake solution is being implemented and the HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role … will be accountable for connecting data from the new Oracle HCM Cloud to the new AWS Snowflake solution and unifying data layer between legacy and new HRIS system feed to data warehouse. The role ensures high-quality, timely, and governed delivery of data ...

client stakeholders and internal delivery leadership Experience with multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS, NoSQL, Graph databases, Cloud object storage & DB as a service Architecture and design concepts for ETL/ELT solutions … reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with ...

tomorrow’s public sector skill demands. This high-impact initiative offers a unique opportunity to join a team dedicated to building a scalable, data-driven recruitment ecosystem. Through redesigning, building, and rolling out a sophisticated Big Data system, our diverse roles span across architecture, project management … scalable ETL/ELT pipelines using modern tools and framewor ks.Cloud Platforms: Familiarity with AWS (Redshift, Athena, S3) or Azure (Synapse, Data Lake, AD F).Data Governance: Understanding of GDPR, PII, and secure data management principl es.Communication: Strong data storytelling skills to simplify ...