1 to 25 of 113 Data Lake Jobs in the UK

insights that support strategic decision-making and operational performance. The role combines leadership of data engineering capability (including the data lake, pipelines and environments) with ownership of analytics and reporting outputs, ensuring data is transformed into accessible, trusted and actionable insight … Engineering & Platform Leadership * Lead the design, development and ongoing management of the Society's data architecture, including the data lake and associated data environments. * Ensure robust, scalable and secure data pipelines are in place to support timely and accurate data ...

Data & Automation Lead, Data Laking, Data Lake, Data Lakes, AWS, AI, LLM, Automation, Part Remote, Part Central London AI Data & Automation Lead required to work for a fast growing and already established company based in Central London. This … more details... Key Responsibilities Lead the design and evolution of a modern data architecture, leveraging cloud-based data lake technologies and scalable data engineering practices. Define and deliver a roadmap for transforming investment operations through automation, workflow modernisation and AI enabled solutions. Build ...

week) Duration: Initial 6 months+ Robert Half are supporting a leading global risk consulting firm organisation on a major Finance Data Lake, Self-Service Reporting and AI Enablement programme and are seeking an experienced Enterprise Data Architect with deep Databricks expertise. This is a hands … Lineage Frameworks Experience integrating Dynamics 365 Finance & Operations (D365 F&O) into enterprise data platforms Experience delivering Finance Data Lake, Data Warehouse or Lakehouse programmes Strong stakeholder engagement and solution design capabilities Highly Desirable Previous experience working within specialist Databricks consultancies ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

summary To assist in the design, implementation, and optimization of data pipelines to load and maintain thedatawarehouses,to support theTrust'sdata and analytics needs. The post holder will be a technical expert in data engineering tools and practices and will drive the development of robust … scalable data architectures to enable advanced analytics and reporting capabilities across the organization. The post holder will be responsible for the development and deployment of the Trust's data within the data warehouse environment, which consists of multiple SQL Server databases that capture data ...

business-critical decision-making. Essential to this role are strong python skills, expertise in MS Fabric, SQL, data warehousing, Data Lake and Azure technologies. The Role As the Lead Data Engineer, you will be responsible for designing, developing, and maintaining modern data … development skills. Experience building and optimising ETL/ELT pipelines. Strong understanding of Lakehouse, Data Warehouse, and Data Lake architectures. Experience with Azure Data Factory, Azure Synapse, and Apache Spark. Knowledge of data modelling, semantic models, and enterprise reporting solutions. Experience ...

Data Architect Permanent | Remote (UK) with occasional travel to London Up to £120k + bonus + benefits (depending on experience and level) All candidates must be eligible for UK Security Clearance (SC) Architect the Future of Enterprise Data Platforms Are you a Data Analytics … across the Microsoft data ecosystem, including: Microsoft Fabric Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Strong understanding of modern data engineering concepts including: Data pipelines ETL/ELT frameworks Data ingestion patterns ...

responsible for building and operating an Azure-based data platform, ensuring it provides a secure, scalable and trusted data lake using Azure Databricks. Working alongside data architects and engineering teams, you will help deliver new data products, onboard data … external data sharing. Implement data governance, security, access controls, backup, retention and monitoring to maintain the data lake as a trusted single source of truth. Develop and maintain data ingestion, transformation and data product pipelines. Collaborate with data ...

modelling, optimisation and supporting data solutions. You'll be working with Azure Databricks, Data Factory, Synapse, Data Lake, SQL and Python/PySpark. Key responsibilities: Build and enhance data pipelines across Azure and Databricks Develop ETL/ELT solutions … sources Transform and model data for use across analytics and reporting Support the ongoing development of the organisation's Data Lake and wider cloud data environment Troubleshoot pipeline and data issues, improving performance and reliability Help maintain strong standards around data ...

Data Engineer Permanent - £50k - £60k Glasgow area - approx. 2 days a month onsite We're looking for an experienced Data Engineer to join a growing Data Team within a global organisation and play a key role in the development of its next-generation data … hear from you. Experience of Microsoft Azure would also be highly advantageous, particularly: Azure Data Factory Azure SQL Azure Data Lake/ADLS Azure DevOps Microsoft Fabric Azure Databricks Experience with PySpark, Airflow, Dagster, Prefect or other orchestration technologies would also be useful. ...

Experience Essential Advanced experience of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake technologies Advanced knowledge of Azure infrastructure or other cloud computing platforms, including Data Factory, ETL processes, Databricks and Data Lake … query optimization, complex Stored procedures/views/functions) Knowledge of supporting & developing Microsoft Azure ETL pipeline solutions, triggers, connections/data lake, data bricks, power apps/automate. Experience of supervising/mentoring junior members of the team. Desirable Experience of NHS information ...

measures, calculations, and critical data elements. Support the migration of data and reporting assets into an Azure Data Lake environment. Build and maintain Power BI reports and dashboards. Develop reporting and analytics solutions to improve business insight and operational efficiency. Support data … measures, calculations and critical data elements. Knowledge of ETL frameworks and data integration processes. Experience with Azure Data Lake and dimensional modelling. Background in both data analytics and data engineering Hays Specialist Recruitment Limited acts as an employment agency ...

every report and every operational data feed at ECP, continue the migration of our data warehouse and data lake to a modern dimensional model, finish the rollout of a principle-of-least-privilege security model across a multi-server SQL estate, and continue … personally delivering target architecture for the ECP data estate the data warehouse, data hub, data lake, raw/ODS layers, dimensional model, audit and schema-change tracking, and the load schedules that tie them together. Hands-on T-SQL, stored procedure ...

reporting and analytics * Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts * Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: * Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service * Architecture and design concepts ...

Senior Azure Data Engineer 6-month Contract Cheshire Hybrid Are you an experienced Azure Data Engineer looking for the opportunity to help shape a modern enterprise data platform? We're working with a leading organisation undergoing a significant digital and data transformation … Cloud data migration experience Strong understanding of data quality, governance and production support Experience working with Azure Data Lake technologies Excellent stakeholder engagement and communication skills Desirable Experience Delta Lake Power BI optimisation Azure DevOps/CI/CD ITIL environments Experience ...

reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts* Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … delivery outcomes.We're looking for demonstrable experience in:* Multiple data storage technologies used in data warehouse and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ ...

time data pipelines that ingest data from legacy and modern platforms Lead the development of cloud-based data lake architectures within AWS Build streaming data solutions using Kafka Design and implement Medallion Architecture (Bronze, Silver, Gold layers) to support analytics … Essential Experience Strong hands-on expertise with Databricks Extensive experience using Spark, PySpark and SQL Proven track record designing and implementing data lake architectures Experience building both batch and streaming data pipelines Strong knowledge of Kafka Good understanding of AWS data services, particularly ...

transformation, and integration processes. Infrastructure Management: Create and maintain data models, tables, and supporting infrastructure within Databricks and associated data lake/lakehouse environments. Business Logic Development: Implement business logic, calculations, and data processing solutions using Python. Collaboration: Work closely with business stakeholders … analytical and problem-solving skills. Excellent stakeholder management and communication skills. Highly Desirable: Experience with Spark/PySpark. Familiarity with Azure Data Lake, Snowflake, or similar platforms. Knowledge of orchestration tools like Airflow or Azure Data Factory. Exposure to financial services environments. Experience supporting large ...

Venesky-Brown’s client, a public sector organisation in Glasgow, is currently looking to recruit Data Modeller for initial 8 month contracts with potential to extend on a rate of £526/day (Inside IR35). These roles will be hybrid working with a minimum of 2 days … week in their Glasgow office. Responsibilities: - The Data Modeller will be responsible for designing, developing, and maintaining high-quality data models and datamarts that support analytical and reporting needs. They will translate business requirements into scalable, performant, and well-structured data models that enable ...

Data Engineer | Hybrid | South Wales | 3 months initially | Outside IR35 IntaPeople are excited to be appointed to recruit an experienced Data Engineer for a team that needs additional project resource for an interim period of time. You will be joining a small data team … modelling and data warehousing within platforms such as Azure. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Experience in using Git, Azure DevOps, or GitHub Actions for version control ...

within large-scale, complex environments. Strong experience designing modern cloud-based data platforms using AWS. Experience designing enterprise-scale Data Lake and Lakehouse architectures. Strong knowledge of Amazon S3 storage strategies, including Bronze, Silver and Gold data layer architectures. Experience designing scalable data … designs and supporting artefacts and design scalable ingestion patterns supporting databases, APIs and file-based integrations. You be involved with defining Data Lake and Lakehouse architecture using Amazon S3, supporting Bronze, Silver and Gold data layers, as well as design transformation, orchestration and processing patterns ...

Architect - London (Hybrid) - Databricks - Spark - PySpark - AWS - Up to £115,000 + Bonus Our client, a large-scale organisation undergoing significant investment in data and cloud technologies, is seeking an experienced Senior Databricks Architect to join its expanding Data & AI practice. This is an exciting opportunity … Data Engineer or Solutions Architect Strong expertise in Databricks, Apache Spark, PySpark and SQL Experience designing and implementing modern data lake or lakehouse architectures Hands-on experience with Kafka Strong understanding of AWS data services, particularly Amazon S3 Experience integrating data ...

Title: HR Data Delivery Lead Role Overview A new data lake solution is being implemented and the HR Data Delivery Lead will be responsible for end-to-end delivery of data products, pipelines, and reporting solutions across multiple teams. This role … will be accountable for connecting data from the new Oracle HCM Cloud to the new AWS Snowflake solution and unifying data layer between legacy and new HRIS system feed to data warehouse. The role ensures high-quality, timely, and governed delivery of data ...