1 to 25 of 178 Data Lake Jobs in the UK

with stakeholders, engineers, and analysts. Technical Stack: Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker Data: Snowflake, Delta Lake, Redis, Azure Data Lake Infra & Ops: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable skills/knowledge/experience: Knowledge … data platforms (e.g. Snowflake, Azure Data Lake). Experience deploying models as APIs (FastAPI, Azure Functions). Understanding of monitoring, model performance tracking, and observability best practices. Familiarity with orchestration tools like Airflow or Azure Data Factory. ...

Data Engineer, you will: Build, test and maintain scalable data pipelines using Azure Synapse Pipelines and Data Lake Storage Develop and maintain solutions to support the NHS Federated Data Platform Contribute to the design and automation of data flows … Delivering and maintaining data engineering solutions within a cloud-based data platform using Azure Synapse Pipelines and Data Lake Storage or similar Developing and optimising curated datasets using Synapse SQL, Spark notebooks such as PySpark or equivalent technologies Ttranslating requirements into effective data ...

collecting, transforming, and loading data into various data stores. Build and maintain data warehousing and data lake solutions Develop and deploy data models that support various business requirements Lead the design of data solutions with quality, automation … governance Expertise in developing Data Warehouses In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh Strong knowledge of data architecture and data modelling practices Cost ...

Data Architect Hybrid - Staffordshire (2-3 days a week ideally, but can be flexible for the right person) £70-90,000 based on experience About the Organisation Join a nationally recognised organisation that is significantly investing in its data and AI capabilities as part … data, innovation and continuous improvement Technology You'll Work With Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines and orchestration Architecture & Governance: Enterprise data ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

tooling is required Understanding of financial regulations and regulatory reporting Auditing experience Knowledge of or skills in Data warehousing, Data Lake and Big Data solutions (understanding SQL would be useful) Knowledge of Cloud based big data frameworks such as data lake, relational, Graph and other no-SQL databases Familiar with Cloud and Data Management trends, including open source projects, methodologies (connect and collect, hub and spoke, data fabrics, etc.) and leading commercial vendors that relate to data acquisition, management ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

Role – Data Modelling Lead Technology – Snowflake, SQL Server, PostgreSQL, Data Warehousing, Data Lake, Medallion, Data Vault, Data Fabric, Semantic modelling Location – London, UK Job Description We are seeking an experienced Data Modeler who can analyze and understand … existing customer data and analytics models on SQL Server, and design efficient data models for Snowflake. This individual will work closely with multiple Business Analysts to gather requirements and translate them into optimized data structures, ensuring scalability and compliance with industry standards. A strong ...

architecture design for projects, producing Data Architecture Assessments Design and deliver cloud data architectures using Azure Data Lake, Azure Data Factory, Synapse, SQL and related services Lead project-level data architecture, defining data models, flows, integrations … with hands-on experience delivering enterprise data models Strong hands-on experience with Azure Data Factory, Synapse, Data Lake, Azure SQL, Databricks or Fabric Expertise in conceptual and logical data modelling, ideally using UML Deep understanding of Azure-aligned data ...

flows (statistics, APIs, surveillance intelligence, unstructured sources). Evaluate 2 to 3 infrastructure options, including Azure-based Analytical Platform (e.g., Data Lake, Data Factory, Databricks, or Fabric), Microsoft Fabric "small org" model, and a Hybrid model Produce the Data infrastructure blueprint. Design … Strong practical knowledge of Microsoft 365/Azure investments and services, specifically those for data and analytics (e.g., Azure Data Lake, Azure Data Factory, Databricks, Microsoft Fabric). Experience with Reproducible Analytical Pipelines (RAPs) , including the setup of appropriate Python/R environments ...

ability to drive business impact through data Technical Environment Languages: Python, SQL, Bash Cloud: Azure, AWS Data & Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Tools: Airflow, DBT, Docker Infrastructure & Operations: Terraform, GitHub Actions, Azure DevOps, Azure Monitor Desirable Skills Experience with … data platforms such as Snowflake or Azure Data Lake Experience deploying models as APIs (e.g. FastAPI, Azure Functions) Knowledge of monitoring, model performance tracking and observability practices Familiarity with orchestration tools such as Airflow or Azure Data Factory ...

Responsibilities Include: Designing and owning conceptual, logical, and physical data models Defining and evolving data warehouse and data lake architectures Providing architectural leadership across relational and NoSQL databases Advising on data integration patterns , including ETL/ELT and streaming architectures Supporting … Modeller Strong expertise in data modelling (conceptual, logical, and physical) Demonstrable experience designing data warehouses and data lake architectures Advanced SQL skills and strong understanding of relational and NoSQL databases Experience with cloud data platforms (AWS, Azure, and/ ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations and streaming technologies (event hub). Version control (Git), Agile Delivery, and DevOps ...

Title: Data Architect Location: London (Hybrid – minimum 2 days per week in the office) Day Rate: Market rate (Inside IR35) Contract Duration: 6 months Role Overview We are seeking an experienced Data Architect to work with a high-performing data team, designing and delivering … supporting cloud migrations. Languages: Python (primary), SQL, Bash Cloud: Azure, AWS Tools: Airflow, DBT, Docker, Fargate, FastAPI Data Platforms: Snowflake, Delta Lake, Redis, Azure Data Lake Infrastructure and Operations: Terraform, GitHub Actions, Azure DevOps, Grafana, Azure Monitor Desirable Skills and Experience Experience working with ...

architectural Experience with: Microsoft Fabric (OneLake, Data Engineering, Data Warehouse, Real-Time Analytics, Power BI). Azure Databricks (Delta Lake, Spark, Unity Catalog, MLflow). Azure Synapse Analytics (Dedicated & Serverless SQL) Data ingestion (ADF, Synapse Pipelines, Databricks Workflows). Azure Data Lake Storage Gen2 Strong understanding of Lakehouse architecture, medallion patterns, batch and streaming data processing AI & Advanced Analytics Experience: Des igning AI-ready enterprise data platforms. Experience with: Machine Learning pipelines and MLOps o Generative AI and Retrieval-Augmented Generation (RAG) Vector search ...

Data Architect, Data Lake, AWS, Azure, Insurance, Cloud We are seeking an experienced and forward-thinking Data Architect to lead and optimise our data architecture initiatives, with a strong focus on the insurance sector. You will be responsible for designing, implementing … Computer Science, Information Technology, or a related field. This opening can be based from multiple locations Data Architect, Data Lake, AWS, Azure, Insurance, Cloud McGregor Boyall is an equal opportunity employer and do not discriminate on any grounds. ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data … Keywords Senior Data Engineer, Data Engineer, Microsoft Fabric, Azure Data Engineer, Data Warehouse, Data Lake, Lakehouse, ETL, Data Pipelines, SQL Server, SQL, Power BI, Python, M Language, R, Microsoft Partner, Consultancy, MSP, Scotland, Remote, Hybrid ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

grade data pipelines from ingestion to consumption within modern big data architectures Build scalable ETL workflows and data lake solutions using AWS-native services Engineer high-performance data processing solutions using Python, Java, Scala, Spark and SQL Integrate structured and unstructured … Strong AWS cloud expertise, particularly across data and analytics services Hands-on experience building ETL processes and data lake/warehouse architectures Proficiency in Python, Java, Scala, Spark and SQL Experience processing large-scale structured and unstructured datasets Experience extracting and integrating data ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...