1 to 25 of 157 Data Lake Jobs in the UK

Project descriptionWe are seeking a Data Architect to join our AI project team. In this role, you will design and implement the data architecture needed to support machine learning and AI solutions, including defining data models, storage patterns, and governance frameworks. You will ensure … modern data architecture concepts and patterns. This could include implementing or working with data lakehouse architectures (combining data lake flexibility with data warehouse performance), data mesh principles (decentralising data ownership to domain teams), or event-driven/ ...

Cloud Engineer based out of Milton Keynes.In this role, you will be responsible for engineering, operating, and evolving the AWS data lake platform, including the cloud infrastructure, shared services, and data engineering applications that sit on top of it. You will work closely with data … role, focused on building and running cloud platforms rather than line management.The difference you’ll make:Engineering and operating the AWS data lake infrastructure, ensuring high availability, resilience, performance, and securityDesigning, building, and maintaining Infrastructure as Code (IaC) for AWS environments, shared services, and data ...

Data & Automation Lead, Data Laking, Data Lake, Data Lakes, AWS, AI, LLM, Automation, Part Remote, Part Central London AI Data & Automation Lead required to work for a fast growing and already established company based in Central London. This … more details... Key Responsibilities Lead the design and evolution of a modern data architecture, leveraging cloud-based data lake technologies and scalable data engineering practices. Define and deliver a roadmap for transforming investment operations through automation, workflow modernisation and AI enabled solutions. Build ...

week) Duration: Initial 6 months+ Robert Half are supporting a leading global risk consulting firm organisation on a major Finance Data Lake, Self-Service Reporting and AI Enablement programme and are seeking an experienced Enterprise Data Architect with deep Databricks expertise. This is a hands … Lineage Frameworks Experience integrating Dynamics 365 Finance & Operations (D365 F&O) into enterprise data platforms Experience delivering Finance Data Lake, Data Warehouse or Lakehouse programmes Strong stakeholder engagement and solution design capabilities Highly Desirable Previous experience working within specialist Databricks consultancies ...

diverse, ambitious team that celebrates creativity and collaboration.Ready to make your mark? Join us and be part of something bigger.As a Data Architect (Manager) in Kainos, you’ll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … models and capacity planning across heterogeneous data store technologies.Experience of establishing data governance processesExperience of architecting a data lake and solutions that reside within a data lake ecosystemEnterprise Data Architecture experience.Embracing our differences At Kainos, we believe ...

diverse, ambitious team that celebrates creativity and collaboration.Ready to make your mark? Join us and be part of something bigger.As a Data Architect (Manager) in Kainos, you’ll be responsible for providing SME guidance in traditional data architecture disciplines around data structures, data … models and capacity planning across heterogeneous data store technologies.Experience of establishing data governance processesExperience of architecting a data lake and solutions that reside within a data lake ecosystemEnterprise Data Architecture experience.Embracing our differences At Kainos, we believe ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

summary To assist in the design, implementation, and optimization of data pipelines to load and maintain thedatawarehouses,to support theTrust'sdata and analytics needs. The post holder will be a technical expert in data engineering tools and practices and will drive the development of robust … scalable data architectures to enable advanced analytics and reporting capabilities across the organization. The post holder will be responsible for the development and deployment of the Trust's data within the data warehouse environment, which consists of multiple SQL Server databases that capture data ...

umbrella)Duration: Initial 6 months+Robert Half are supporting a leading property and real estate organisation on a major Finance Data Lake and Data Transformation programme and are looking for an experienced Data Architect to join the team. This role requires a hands … Platform expertiseDevOps/CI/CD experience within data environmentsStrong stakeholder engagement and solution design capabilitiesExperience delivering enterprise-scale data lake initiativesDesirable:Finance Data Lake programme experienceLead Data Engineering backgroundExperience working within large transformation programmesRobert Half Ltd acts ...

Data Architect Permanent | Remote (UK) with occasional travel to London Up to £120k + bonus + benefits (depending on experience and level) All candidates must be eligible for UK Security Clearance (SC) Architect the Future of Enterprise Data Platforms Are you a Data Analytics … across the Microsoft data ecosystem, including: Microsoft Fabric Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Strong understanding of modern data engineering concepts including: Data pipelines ETL/ELT frameworks Data ingestion patterns ...

responsible for building and operating an Azure-based data platform, ensuring it provides a secure, scalable and trusted data lake using Azure Databricks. Working alongside data architects and engineering teams, you will help deliver new data products, onboard data … external data sharing. Implement data governance, security, access controls, backup, retention and monitoring to maintain the data lake as a trusted single source of truth. Develop and maintain data ingestion, transformation and data product pipelines. Collaborate with data ...

modelling, optimisation and supporting data solutions. You'll be working with Azure Databricks, Data Factory, Synapse, Data Lake, SQL and Python/PySpark. Key responsibilities: Build and enhance data pipelines across Azure and Databricks Develop ETL/ELT solutions … sources Transform and model data for use across analytics and reporting Support the ongoing development of the organisation's Data Lake and wider cloud data environment Troubleshoot pipeline and data issues, improving performance and reliability Help maintain strong standards around data ...

Data Engineer Permanent - £50k - £60k Glasgow area - approx. 2 days a month onsite We're looking for an experienced Data Engineer to join a growing Data Team within a global organisation and play a key role in the development of its next-generation data … hear from you. Experience of Microsoft Azure would also be highly advantageous, particularly: Azure Data Factory Azure SQL Azure Data Lake/ADLS Azure DevOps Microsoft Fabric Azure Databricks Experience with PySpark, Airflow, Dagster, Prefect or other orchestration technologies would also be useful. ...

measures, calculations, and critical data elements. Support the migration of data and reporting assets into an Azure Data Lake environment. Build and maintain Power BI reports and dashboards. Develop reporting and analytics solutions to improve business insight and operational efficiency. Support data … measures, calculations and critical data elements. Knowledge of ETL frameworks and data integration processes. Experience with Azure Data Lake and dimensional modelling. Background in both data analytics and data engineering Hays Specialist Recruitment Limited acts as an employment agency ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

reporting and analytics * Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts * Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: * Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service * Architecture and design concepts ...

Olympic Committee, and Mercedes-Benz. Our services span the full digital delivery lifecycle, including architecture, engineering, delivery management, user-centred design, business analysis, data, DevOps, and AI.We operate as a collaborative and inclusive organisation that empowers our people to take ownership, innovate, and develop their expertise. … approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. The Role: We are looking for experienced Data Architects to work on our projects with our public sector clients, helping to deliver Solirius’ services to the highest standard.The role will involve working ...

Senior Azure Data Engineer 6-month Contract Cheshire Hybrid Are you an experienced Azure Data Engineer looking for the opportunity to help shape a modern enterprise data platform? We're working with a leading organisation undergoing a significant digital and data transformation … Cloud data migration experience Strong understanding of data quality, governance and production support Experience working with Azure Data Lake technologies Excellent stakeholder engagement and communication skills Desirable Experience Delta Lake Power BI optimisation Azure DevOps/CI/CD ITIL environments Experience ...

reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts* Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … delivery outcomes.We're looking for demonstrable experience in:* Multiple data storage technologies used in data warehouse and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ ...

Data Engineer/Data Analyst (Microsoft Azure) - SC Cleared Contract | Inside IR35 | Up to £570 per day | 6 Months | September Start We are seeking an experienced Data Engineer/Data Analyst with strong Microsoft Azure expertise and active SC Clearance to join … Proven expertise across the Microsoft Azure Data Platform , including: Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Azure SQL Power BI Strong SQL and data modelling skills. Experience building and maintaining cloud-based data solutions. Excellent stakeholder ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

transformation, and integration processes. Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments. Business Logic Development: Implement business logic, calculations, and data processing solutions using Python. Collaboration: Work closely with business stakeholders … analytical and problem-solving skills. Excellent stakeholder management and communication skills. Highly Desirable: Experience with Spark/PySpark. Familiarity with Azure Data Lake, Snowflake, or similar platforms. Knowledge of orchestration tools like Airflow or Azure Data Factory. Exposure to financial services environments. Experience supporting large ...

Venesky-Brown’s client, a public sector organisation in Glasgow, is currently looking to recruit Data Modeller for initial 8 month contracts with potential to extend on a rate of £526/day (Inside IR35). These roles will be hybrid working with a minimum of 2 days … week in their Glasgow office. Responsibilities: - The Data Modeller will be responsible for designing, developing, and maintaining high-quality data models and datamarts that support analytical and reporting needs. They will translate business requirements into scalable, performant, and well-structured data models that enable ...