26 to 50 of 95 Data Lake Jobs in the UK

Rate: £550 per day (Inside IR35) Sector: UK Public Sector/Government Clearance: Active SC Clearance Required Overview We are seeking an experienced Data & Analytics Architect to join a high-profile public sector programme. This role will play a key part in defining, designing and governing enterprise-scale … data architecture solutions, enabling data-driven decision making and supporting the delivery of modern digital services across government. The successful candidate will work closely with business stakeholders, technical teams, delivery leads, and data professionals to establish strategic data architectures, analytics capabilities ...

This team sits at the heart of the organisation, bringing together data from across the business into a centralised data lake and transforming it into reporting, analytics and insight that supports operational, tactical and strategic decision-making. You'll work with a collaborative team based … customers. Centralise, cleanse, validate and model data from multiple business systems within modern data platforms and data lake environments. Build and maintain data pipelines, automated solutions and analytical tools using technologies including Python, SQL and Power BI. Design and deliver forecasting ...

years of experience as a Product Manager/Owner of a data product, managing data & analytics solutions (Data Lake/DWH/Cloud Service).Experience in the iGaming or iLottery industry is highly beneficial. Proficiency in data modeling, infrastructure, and analytics. … workflows, and contemporary cloud data architectures. Experience with current cloud data platforms such as Snowflake, Azure Data Lake, Azure SQL, dbt, Airflow, or similar tools. Ability to understand and work with SQL queries and data models. Knowledge of data ...

Title: Data Delivery Lead/Data Squad Lead - Corporate & Investment Banking Location: London - Liverpool Street Contract: 6 months (potential extension) Working pattern: Hybrid - 2-3 days per week in the office Job Type: Full-time Rate: Circa £745/Day We are looking for an experienced … Data Delivery Lead/Data Squad Lead to join a leading financial services organisation, supporting its Corporate & Investment Banking data platform and delivery function. This is an excellent opportunity for someone with a strong background in Corporate or Investment Banking, combined with experience leading ...

NASDAQ: EXLS) is a global data and AI company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. Bringing together domain expertise with robust data, powerful analytics, cloud and AI to create agile, scalable solutions and execute … operations for the worlds leading corporations. EXL was founded on the core values of innovation, collaboration, excellence, integrity and respect, creating value from data to ensure faster decision-making and transforming operating models. Key industries include Insurance, Healthcare, Banking and Financial Services, Media, and Retail, among others. Headquartered ...

/MIDLANDS/DATA/SQL/MICROSOFT FABRIC/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME/BIRMINGHAM/NOTTINGHAM/LEICESTER/MIDLANDS/DATA/SQL/MICROSOFT FABRIC …/PYTHON/PYSPARK/DATA WAREHOUSE/DATA LAKE/DATA FACTORY/HOME ...

patterns. 7+ years strong hands-on experience with Azure-based data platforms, including Azure Data Factory, Databricks, data lake architectures, SQL, and dimensional data modeling, with the ability to build practical end-to-end solution designs. Proven ability to own solution … data, or AI architecture. Core Technology Stack Data platform : Azure Data Factory, Databricks, Azure data lake, SQL, dimensional modeling, ETL/ELT, orchestration. AI platform : Azure OpenAI, Azure AI Foundry, Azure AI Search, Copilot Studio, Semantic Kernel, Prompt Flow. Analytics : Power ...

patterns. 7+ years strong hands-on experience with Azure-based data platforms, including Azure Data Factory, Databricks, data lake architectures, SQL, and dimensional data modeling, with the ability to build practical end-to-end solution designs. Proven ability to own solution … data, or AI architecture. Core Technology Stack Data platform : Azure Data Factory, Databricks, Azure data lake, SQL, dimensional modeling, ETL/ELT, orchestration. AI platform : Azure OpenAI, Azure AI Foundry, Azure AI Search, Copilot Studio, Semantic Kernel, Prompt Flow. Analytics : Power ...

client is looking for an experienced Data Engineer with a strong eye towards solution architecture. This is a hands-on engineering role for someone who enjoys building robust data solutions but is also comfortable looking beyond individual pipelines or features to consider how the overall platform … ownership of significant technical problems, translate business requirements into well-designed solutions, and help establish the architectural and engineering standards that allow our data platform to scale. The successful candidate will be an experienced engineer first and foremost, with the capability and ambition to take increasing responsibility ...

Create scalable data solutions on AWS leveraging S3, Glue, Lambda, and related services. Integrate & Automate: Implement ETL processes and data lake/lakehouse architectures that ensure accuracy and reliability. Collaborate & Advise: Partner with technical and business stakeholders to translate requirements into effective data … preferred). Experience with AWS cloud services including S3, Glue, Lambda, IAM. Familiarity with ETL design, data modelling, and data lake/lakehouse concepts. Understanding of data governance and compliance frameworks. Experience in the healthcare sector or knowledge of NHS data ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Responsibilities Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business … technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management principles Hands-on SQL experience Experience designing modern data platforms and cloud-based solutions ...

Platform. From an MSB perspective the role will require the design, development, support and deployment of the AeroConnect Platform to provide connectivity and data analytic solutions for the manufacturing environments. This will focus on the integration of the latest manufacturing technologies both at the production sites and research … analysis. • Implement and manage data lakes, data warehouses, and other data storage solutions, including SQL and Cloud Lake solutions. Data Security & Compliance • Implement and enforce best architectural practices for data security, ensuring compliance with relevant data regulations ...

exciting opportunity has arisen for a Senior Data Engineer to join a growing data team and contribute to the development of a modern cloud-based data platform. You'll be responsible for developing scalable data pipelines, integrating multiple data sources … processes Strong communication and stakeholder engagement skills Desirable Skills Azure Data Factory Databricks Synapse Analytics Microsoft Fabric Azure SQL Data Lake technologies Experience within regulated sectors Cloud-based data platform experience ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

want to know about the requirements for this role, read on for all the relevant information. Design scalable, secure, and efficient data architectures Develop data platforms, data lakes/lakehouses, and ETL/ELT solutions Translate business requirements into technical solutions Create data roadmaps aligned to business objectives and regulatory requirements Collaborate with stakeholders across business and technology teams Essential Experience Proven Data Architect experience, ideally within Financial Services or a regulated industry Strong knowledge of data architecture, data modelling, and data management ...

Data Factory and Azure Databricks . Build data models and analytics solutions using Synapse Analytics and Azure Data Lake Storage . Develop and optimise ETL/ELT processes. Work directly with clients to understand requirements and deliver robust data solutions. Troubleshoot … with Microsoft Azure Data Engineering . Hands-on expertise with Azure Data Factory, Databricks, Synapse Analytics and Data Lake Storage . Development experience in Python, Scala or SQL . Knowledge of data modelling and analytics solutions. Excellent communication skills and experience ...

Senior Data Engineer Location : Bolton Salary : Circa £55,000 depending on experience Working Pattern: Hybrid working 2 days per week onsite An exciting opportunity has become available for a Senior Data Engineer to join a leading defence engineering organisation, helping to develop and deliver advanced data solutions across a wide range of business and engineering functions. This role offers the opportunity to transform complex data from engineering systems, simulations, manufacturing operations and business platforms into reliable, accessible and valuable insights. You'll play a key role in designing scalable data ...

pipelines using Dataflow Gen2 and Fabric Notebooks • Develop and maintain Lakehouse solutions using Medallion architecture • Work with SQL, Python, Spark SQL and Delta Lake • Integrate data from APIs, databases, CRM, ERP and third party platforms • Support both batch and real time data processing • Develop … Lakehouse architecture • Strong SQL and Python skills • Experience with Spark and Spark SQL • Proven experience designing scalable ETL and ELT pipelines • Data Lake and Delta Lake experience • Experience integrating data from multiple structured and unstructured sources • Good understanding of CI/CD, DevOps ...

Data Engineer (Python SQL AWS) London/WFH to 85kDo you have experience of building data pipelines within finance/Fintech environments? You could be progressing your career in a hands-on Data Engineer role at a scaling Investment Research tech company with great … benefits and perks. As a Data Engineer you will be at the intersection of data engineering, database management and platform delivery. You will help build and evolve a modern, scalable AWS cloud based data platform. Your focus will be on designing and maintaining data ...

client is looking fort a Senior Data Engineer. Responsible for developing and implementing data management processes, including data integration, data migration, and data storage. Responsible for ensuring that data is secure and compliant with relevant regulations, such … GDPR. This may involve implementing data access controls, data encryption, and data masking. Responsible for creating and maintaining ETL (Extract, Transform, Load) processes for structured and unstructured data. Responsible for the technical approach to data integrity and back-out plans ...

technical detail Hands on implementation experience, ideally from a data engineering or developer background Databricks at architecture level on Azure, including Delta Lake, Unity Catalog and Spark optimisation Lakehouse and medallion patterns, batch and streaming ingestion, event driven design Conceptual, logical and physical data modelling. … Loader and Structured Streaming Microsoft Purview for data governance, cataloguing and lineage Azure Data Factory, Azure SQL, Data Lake Storage Gen2 Azure DevOps or GitHub Actions, Databricks Asset Bundles, Terraform or Bicep Entra ID, Key Vault, private endpoints, RBAC UK GDPR ...

role focused on designing and governing end-to-end GCP Data & AI platform, spanning data ingestion, governed data lake/lakehouse, data products, Knowledge Graph, Digital Twin data foundations, and Agentic AI platforms. The role requires an architect capable … shaping the complete data ecosystem rather than individual technology layers in isolation. In this role you will play a key role in: Design and govern enterprise-scale GCP data platforms using BigQuery, Spanner Graph DB, Dataplex, Dataflow, Pub/Sub, BigLake and Cloud Storage. Develop architectures ...

Description Test Engineer, Cloud & Data Key Responsibilities Design, develop, and execute comprehensive test strategies for cloud-native data platforms. Build and maintain automated test frameworks for platform, integration, API, and end-to-end testing. Validate platform functionality across cloud services, infrastructure, data pipelines … transformation processes o Data quality and reconciliation Strong SQL skills. Familiarity with data warehouses and data lake technologies. DevOps & CI/CD Experience with: o Jenkins o GitHub Actions o Azure DevOps o Bamboo Understanding of Infrastructure as Code (Terraform preferred ...