1 to 25 of 169 Data Lake Jobs in the UK

Data Engineer, you will: Build, test and maintain scalable data pipelines using Azure Synapse Pipelines and Data Lake Storage Develop and maintain solutions to support the NHS Federated Data Platform Contribute to the design and automation of data flows … Delivering and maintaining data engineering solutions within a cloud-based data platform using Azure Synapse Pipelines and Data Lake Storage or similar Developing and optimising curated datasets using Synapse SQL, Spark notebooks such as PySpark or equivalent technologies Ttranslating requirements into effective data ...

collecting, transforming, and loading data into various data stores. Build and maintain data warehousing and data lake solutions Develop and deploy data models that support various business requirements Lead the design of data solutions with quality, automation … governance Expertise in developing Data Warehouses In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh Strong knowledge of data architecture and data modelling practices Cost ...

Data Architect Hybrid — Staffordshire (2-3 days a week ideally, but can be flexible for the right person) Salary is based on experience About the Organisation Join a nationally recognised organisation that is significantly investing in its data and AI capabilities as part of a multi … data, innovation and continuous improvement Technology You’ll Work With Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines and orchestration Architecture & Governance: Enterprise data ...

Data Architect Hybrid RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … modelling and data warehousing within platforms such as Azure or AWS. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Robust understanding of data governance, data quality ...

Data Architect | Hybrid | RCT (South Wales) IntaPeople are proud and excited to be appointed to recruit an experienced Data Architect for a Welsh-based not-for-profit sector client on an exclusive growth project. This is a very exciting opportunity to join their fast-growing Data … modelling and data warehousing within platforms such as Azure or AWS. Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures. Robust understanding of data governance, data quality ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

architecture design for projects, producing Data Architecture Assessments Design and deliver cloud data architectures using Azure Data Lake, Azure Data Factory, Synapse, SQL and related services Lead project-level data architecture, defining data models, flows, integrations … with hands-on experience delivering enterprise data models Strong hands-on experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, Databricks or Fabric Expertise in conceptual and logical data modelling, ideally using UML Deep understanding of Azure-aligned data ...

flows (statistics, APIs, surveillance intelligence, unstructured sources). Evaluate 2 to 3 infrastructure options, including Azure-based Analytical Platform (e.g., Data Lake, Data Factory, Databricks, or Fabric), Microsoft Fabric "small org" model, and a Hybrid model Produce the Data infrastructure blueprint. Design … Strong practical knowledge of Microsoft 365/Azure investments and services, specifically those for data and analytics (e.g., Azure Data Lake, Azure Data Factory, Databricks, Microsoft Fabric). Experience with Reproducible Analytical Pipelines (RAPs) , including the setup of appropriate Python/R environments ...

Responsibilities Include: Designing and owning conceptual, logical, and physical data models Defining and evolving data warehouse and data lake architectures Providing architectural leadership across relational and NoSQL databases Advising on data integration patterns , including ETL/ELT and streaming architectures Supporting … Modeller Strong expertise in data modelling (conceptual, logical, and physical) Demonstrable experience designing data warehouses and data lake architectures Advanced SQL skills and strong understanding of relational and NoSQL databases Experience with cloud data platforms (AWS, Azure, and/ ...

Senior Data Engineer (Python) - HUGE DATA LAKE! North Lincolnshire/Hybrid Groundbreaking data and AI projects Are you Data Engineer looking to work across … complex Data lake on a truly enterprise-level scale, using modern Cloud tech Trust me, this isn't your average Datalake in regards to both size and scale and as a techy... One you will want to get your hand on! My well-known client need you.It ...

Data Architect, Data Lake, AWS, Azure, Insurance, Cloud We are seeking an experienced and forward-thinking Data Architect to lead and optimise our data architecture initiatives, with a strong focus on the insurance sector. You will be responsible for designing, implementing … Computer Science, Information Technology, or a related field. This opening can be based from multiple locations Data Architect, Data Lake, AWS, Azure, Insurance, Cloud McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds. ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data … Keywords Senior Data Engineer, Data Engineer, Microsoft Fabric, Azure Data Engineer, Data Warehouse, Data Lake, Lakehouse, ETL, Data Pipelines, SQL Server, SQL, Power BI, Python, M Language, R, Microsoft Partner, Consultancy, MSP, Scotland, Remote, Hybrid ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

major client in the energy sector. The position focuses on designing, developing, and maintaining Azure-based data platforms-particularly Delta Lake and modern analytics services-while providing architectural leadership and hands-on engineering expertise. The role operates on a hybrid model, requiring three days per week onsite … Glasgow. Key Responsibilities Develop and maintain Azure data architecture , including Delta Lake, ensuring compliance with data governance and security standards. Analyse and resolve data integration and system interoperability challenges across complex environments. Design and implement Azure data solutions using services such ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...

strategic data leader ready to shape the future of a modern, digitally-enabled building society? Dudley Building Society is looking for an exceptional Head of Data to lead our enterprise-wide data strategy and transform how data enables insight, innovation, regulatory confidence … Azure and Fabric data platforms and Microsoft Purview governance environment. Oversee architecture, roadmap and optimisation across Azure Data Lake, Data Factory, Databricks, Synapse, SQL, Fabric Lakehouse and Power BI. Ensure data platforms meet regulatory and best-practice expectations (GDPR, PRA/ ...