1 to 25 of 139 Data Lake Jobs in the UK

collecting, transforming, and loading data into various data stores. Build and maintain data warehousing and data lake solutions Develop and deploy data models that support various business requirements Lead the design of data solutions with quality, automation … governance Expertise in developing Data Warehouses In-depth understanding of modern data architecture such as Data Lake, Data Warehouse, Lakehouse, and Data Mesh Strong knowledge of data architecture and data modelling practices Cost ...

Data Architect Hybrid - Staffordshire (2-3 days a week ideally, but can be flexible for the right person) £70-90,000 based on experience About the Organisation Join a nationally recognised organisation that is significantly investing in its data and AI capabilities as part … data, innovation and continuous improvement Technology You'll Work With Cloud & Data Platforms: Azure Synapse, Azure Data Lake, Azure Data Factory Data Modelling & Integration: SQL, ETL tools, data pipelines and orchestration Architecture & Governance: Enterprise data ...

platform that directly supports board-level decision making. The technology stack is Microsoft-led, with an Azure environment, Azure Data Lake, Power BI, and Power Apps, alongside a bespoke operational system and an ERP that need to be integrated. Key Responsibilities Design and build … modern Azure-based data platform, including: Azure Data Lake Data ingestion pipelines Data modelling and transformation Automate ingestion of data from: Bespoke operational systems ERP systems High-volume transactional sources (1,000+ transactions per hour) Establish robust data ...

using Azure Data Factory and related services Develop data solutions using Azure Synapse Analytics, Azure SQL, and Data Lake Implement data modelling solutions for analytics and reporting Ensure data quality, reliability, and performance across data systems Collaborate … Data Engineer in an Azure environment Hands-on expertise with: Azure Data Factory Azure Synapse Analytics Azure Data Lake (Gen2) Azure SQL/SQL Server Advanced SQL skills Experience with Python or Scala for data processing Solid understanding of data ...

Edinburgh/Hybrid Were looking for a TechnicalBusiness Analysts to join a forward-thinking team working alongside cross-functional software and data engineers. You will help define the roadmap for implementing our clients data strategy, taking in streams from across their product suite and beyond Main … integrations and databases) Have hands-on experience in projects relating to data solutions (data delivery/management, data lake, system integration, data migration, data warehousing experience with cloud-based data platforms) Data Modelling (e.g. ...

flows (statistics, APIs, surveillance intelligence, unstructured sources). Evaluate 2 to 3 infrastructure options, including Azure-based Analytical Platform (e.g., Data Lake, Data Factory, Databricks, or Fabric), Microsoft Fabric "small org" model, and a Hybrid model Produce the Data infrastructure blueprint. Design … Strong practical knowledge of Microsoft 365/Azure investments and services, specifically those for data and analytics (e.g., Azure Data Lake, Azure Data Factory, Databricks, Microsoft Fabric). Experience with Reproducible Analytical Pipelines (RAPs) , including the setup of appropriate Python/R environments ...

Responsibilities Include: Designing and owning conceptual, logical, and physical data models Defining and evolving data warehouse and data lake architectures Providing architectural leadership across relational and NoSQL databases Advising on data integration patterns , including ETL/ELT and streaming architectures Supporting … Modeller Strong expertise in data modelling (conceptual, logical, and physical) Demonstrable experience designing data warehouses and data lake architectures Advanced SQL skills and strong understanding of relational and NoSQL databases Experience with cloud data platforms (AWS, Azure, and/ ...

having you join our journey and seeing how far we can go, together! The position: We're looking for a Senior Database & Cloud Data Engineer who will be responsible for designing, developing, and maintaining robust, scalable, and secure data solutions across on-premises and cloud environments. … SSIS, etc. Experience with Python, PySpark, or Scala for data processing. Familiarity with CI/CD practices. Experience with Data lake, Data warehouse and Medallion architectures. Understanding of API integrations and streaming technologies (event hub). Version control (Git), Agile Delivery, and DevOps ...

Data Officer - Financial Services (London) Permanent | Full Time | Hybrid (2-3 days in office) Senior Manager or Manager level (depending on experience) An established international financial institution is seeking a Data Officer to join its London operation. This newly created role sits within the Risk function … with close collaboration across Technology, Operations and front-office business areas. It offers the opportunity to shape and lead the firm's data governance strategy during a period of organisational growth. The Role The Data Officer will be responsible for developing, embedding and overseeing the organisation ...

Senior Data Engineer, Databricks, £ 60000 - 70000 + benefits. Strong Data Modelling, Data Design and Databricks required. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks and Performant SQL is required for this role as is very … SDLC, including testing and delivery in an agile environment. Excellent knowledge of ETL Experience of data warehousing and data lake solutions. Good experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand ...

Senior Data Engineer Location: Scotland based, flexible working Salary: Up to £80,000 + benefits Euro Projects Recruitment is working with a leading Microsoft Partner in Scotland to recruit a permanent Senior Data Engineer . This is a hands-on, customer-facing Senior Data … Keywords Senior Data Engineer, Data Engineer, Microsoft Fabric, Azure Data Engineer, Data Warehouse, Data Lake, Lakehouse, ETL, Data Pipelines, SQL Server, SQL, Power BI, Python, M Language, R, Microsoft Partner, Consultancy, MSP, Scotland, Remote, Hybrid ...

Role: Data Architect Location: Edinburgh or Luton (hybrid/onsite as required) Engagement: Contract - Inside IR35 Rate: £550 - £650 per day Security Clearance: Active SC Clearance required Project Description We are seeking an experienced Data Architect to lead the design, implementation, and governance of enterprise-scale … roles High proficiency in SQL and database technologies (e.g. Oracle, SQL Server, PostgreSQL, MySQL) Strong knowledge of data warehouse, data lake, and lakehouse architectures Experience with ETL/ELT frameworks and orchestration tools (e.g. Informatica, Talend, Apache Airflow) Proven experience establishing and maintaining data ...

role will involve working closely with business users, developing modern reporting solutions, and strengthening our data platform across our data lake and data warehouse environments. Key Responsibilities: Reporting Deliver MI and BI reporting across the business. Analyse and report on data … semantic models, stored procedures, views, tables, and underlying source data. Develop, maintain, and expand ETL pipelines for ingestion into the data lake and data warehouse. Liaise with third parties regarding file deliveries and resolve import or data quality issues. Perform log and error ...

regulatory standards. Proficiency in AWS ETL technologies, including Glue, Data Sync, DMS, Step Functions, Redshift, DynamoDB, Athena, Lambda, RDS, EC2 and S3 Datalake, CloudWatch for building and optimizing ETL pipelines and data migration workflows. Working knowledge of Azure data engineering tools, including ADF (Azure … Data Factory), Azure DB, Azure Synapse, Azure Data lake and Azure Monitor providing added flexibility for diverse migration and integration projects. Prior experience with tools such as MuleSoft, Boomi, Informatica, Talend, SSIS, or custom scripting languages (Python, PySpark, SQL) for data extraction ...

analytics-ready formats. Optimise pipeline performance and ensure high availability of data services. Infrastructure & Architecture Architect and deploy scalable data lake solutions using Azure Data Lake Storage. Implement governance and security measures across the platform. Leverage Terraform or similar IaC tools … Develop and optimise data jobs using PySpark or Scala within Databricks. Implement the medallion architecture (bronze, silver, gold layers) and use Delta Lake for reliable data transactions. Manage cluster configurations and CI/CD pipelines for Databricks deployments. Monitoring & Operations Implement monitoring solutions using Azure ...

Data Architect Harrogate- Hybrid workingUp to £80,000 (DOE) + Benefits Are you an experienced Data Architect looking to shape the data foundations of a modern, forward-thinking organisation? This is a rare opportunity to take ownership of enterprise-wide data architecture … play a central role in how data is structured, governed, protected, and leveraged across the business. In this role, you'll define the organisation's data vision and turn strategic goals into real, scalable data capabilities - ensuring data is trusted, secure ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...

Senior Data Architect Data & AI | Remote (Occasional travel to Glasgow or Reading) Salary £115,000 (Package) Are you a Senior or Data Architect who thrives on designing elegant, scalable cloud data solutions? Do you enjoy helping organisations become truly data … delivering cloud-based data platforms using Azure services such as Databricks, Synapse Analytics, Microsoft Fabric, Azure SQL Database, Data Lake/Blob Storage, Cosmos DB, Azure Data Factory and Power BI Producing conceptual, logical and physical data models optimised for analytical ...

Data Architect (SC Cleared) Location: Edinburgh or Newcastle preferred Other locations considered: Luton, Bristol, Southampton (Hybrid – predominantly onsite ) Contract: 6 months initially (potential to extend) Rate: Up to £69.44 per hour umbrella ( rate may be negotiable ) Clearance: Active SC clearance required Nationality: UK Eyes Only – sole British nationality … required The Opportunity We are seeking an experienced Data Architect to support a high-profile, security-critical programme within a UK government/defence environment. This role focuses on the design, implementation and governance of enterprise-level data architectures , ensuring data is accurate, secure ...

Data Architect (SC Cleared) Location: Edinburgh or Newcastle preferred Other locations considered: Luton, Bristol, Southampton (Hybrid – predominantly onsite ) Contract: 6 months initially (potential to extend) Rate: Up to £69.44 per hour umbrella ( rate may be negotiable ) Clearance: Active SC clearance required Nationality: UK Eyes Only – sole British nationality … required The Opportunity We are seeking an experienced Data Architect to support a high-profile, security-critical programme within a UK government/defence environment. Ready to make your application Please do read through the description at least once before clicking on Apply. This role focuses ...

distribution keys, sort keys , and workload management. Implement Redshift Spectrum to query data in S3 using external tables. 3. Data Lake & Iceberg Implement and maintain Apache Iceberg tables on AWS for schema evolution and ACID operations. Build Iceberg-based ingestion and transformation pipelines using Glue …/Iceberg for low-cost, serverless analytics. Manage Glue Data Catalog integrations and table schema management. 5. Storage (S3) & Data Lake Architecture Design secure, cost-efficient S3 data lake structures (bronze/silver/gold zones). Implement data lifecycle ...

Data Architect 3 days a week onsite in London 35hr working week with flexible working hours We're looking for an experienced Data Architect to join a well-established company who are going through an enterprise-wide modernisation programme. This is a brand-new role within … Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture ...

Data Architect 3 days a week onsite in Sunderland 35hr working week with flexible working hours We're looking for an experienced Data Architect to join a well-established company who are going through an enterprise-wide modernisation programme. This is a brand-new role within … Leadership Evaluate and recommend modern data technologies and tooling Stay current with industry trends such as open table formats (Apache Iceberg, Delta Lake), data observability, and cloud-native services Lead proofs-of-concept and technical assessments for new technologies Ensure the data architecture ...

Overview We are seeking a highly skilled Data Analyst to play a pivotal role in transforming Chambers into a truly data-driven insights business. Working within a dedicated data team alongside analysts, data engineers and AI engineers, you will translate business needs … Python, Databricks and visualisation tools (Power BI, Tableau). Investigate and reconcile data across operational databases, the data lake, and the lakehouse to support business and data governance needs. Develop and maintain business intelligence dashboards across various domains Collaborate closely with stakeholders ...

Engineer across data analytics and data engineering domains Strong hands-on experience with: Amazon S3 (data lake patterns, partitioning, lifecycle management) AWS Glue (Jobs, Crawlers, PySpark, orchestration) Amazon Redshift (data modelling, performance tuning, WLM, Spectrum) Advanced Python (PySpark … Proven ability to engage senior stakeholders and clearly communicate technical trade-offs Experience working in Agile delivery environments Nice to Have: Experience with AWS Lake Formation, Lambda, Step Functions, Athena, EMR, DataBrew Familiarity with data quality, lineage, or observability tooling Knowledge of GDS ways of working ...