25 of 25 Data Lake Jobs in the Midlands

Will Bring Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and cloud tools. Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leveraging ...

order to be considered for this role, you will need to be eligible for UK Security Clearance You will join the Enterprise Data Management practice in Capgemini’s Insights and Data (I&D) business unit. Insights and Data is a global business unit covering … Enterprise Data Management, Cloud Platforms, Enterprise Content Management and AI & Analytics. Our practice has a strong focus on leading technology vendors, spanning data warehousing, data quality, data governance, data integration and analytics. Capgemini is proud to be a leading partner ...

reporting and analytics * Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts * Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: * Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service * Architecture and design concepts ...

reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service Architecture and design concepts ...

reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We’re looking for demonstrable experience in: Multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS NoSQL Graph databases Cloud object storage DB as a service Architecture and design concepts for ETL/ELT solutions ...

queries, stored procedures and analytical views within Azure Synapse Analytics. Manage data ingestion, transformation and storage across Azure Data Lake Storage (ADLS) and Azure SQL environments. Support processing of structured and semi-structured data formats, including Delta Lake and JSON. Collaborate with …/ELT pipelines. Experience with Change Data Capture (CDC) and data migration frameworks. Knowledge of Azure Data Lake Storage (ADLS) and Azure SQL Database. Experience working with Delta Lake and JSON data formats. Minimum 5 years' experience within cloud-based ...

reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts* Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … delivery outcomes.We're looking for demonstrable experience in:* Multiple data storage technologies used in data warehouse and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ ...

client stakeholders and internal delivery leadership Experience with multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS, NoSQL, Graph databases, Cloud object storage & DB as a service Architecture and design concepts for ETL/ELT solutions … reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with ...

Data Engineer – NPPV 3 Cleared – Contract – Outside IR35 – Hybrid – Midlands VIQU have partnered with a well-established public-sector organisation in the Midlands, who are seeking a Data Engineer to join a major RMS (Records Management System) replacement programme. The successful Data Engineer will … projects involving multiple source and target systems. Strong understanding of data modelling, relational databases, data warehousing, and data lake architectures. Hands-on experience with Microsoft Azure data services and cloud-based data platforms. Experience working with technologies such ...

Data Architect - SC Cleared Telford (Hybrid - 2 days onsite per week) 6-Month Contract £550 - £600 per day InsideIR35 Active SC Clearance is essential for this role We are supporting a major UK public sector digital transformation programme and are looking for an experienced Data Architect … join a high-profile delivery team designing enterprise-scale data and analytics solutions. You will take ownership of end-to-end data architecture, working closely with technical teams and senior stakeholders to design scalable, secure and governed data solutions. Responsibilities: - Designing enterprise data ...

pipelines Developing Power BI semantic models and supporting reporting solutions Engineering robust Azure Data Factory integrations Building secure Azure Data Lake solutions Working with SQL Server and advanced SQL development Delivering API integrations across internal and third-party systems Supporting Azure DevOps and CI/… also bring strong experience across: Microsoft Fabric (essential) Azure Synapse Analytics (essential) Power BI Azure Data Factory Azure Data Lake SQL Server ETL/ELT development Azure DevOps Git Enterprise cloud data engineering AI Experience We're looking for engineers who have already ...

Data Architect Telford/Hybrid - 2 days per week onsite £640 inside ir35 6 months contract Active SC clearance We're looking for an experienced Data Architect to join a major UK Government programme, designing enterprise-scale data solutions that support critical public services. … lead the architecture of modern data platforms, working across cloud, hybrid and on-premise environments to deliver robust, secure and scalable data solutions. This role will see you designing end-to-end data architectures, driving data governance, supporting cloud migration initiatives ...

Build and optimize data pipelines using Azure Data Factory (ADF) and SSIS . Leverage Databricks and Azure Data Lake to innovate and streamline workflows. Create high-impact reporting solutions in Power BI . Collaborate with multi-functional product teams and mentor junior developers. … Looking For: Languages: Strong proficiency in SQL and Python . Data Platforms: Hands-on experience with Databricks and Azure Data Lake . ETL: Proven ability to build efficient pipelines (ADF, SSIS, APIs). Desirable: PySpark, Dimensional Modelling, DAX/SSAS, or an interest ...

Senior Data Engineer – Azure/Databricks £70,000 + bonus Hybrid Working – 1 day on-site per week East Midlands based I'm working with a business that's continuing to invest in its Azure data platform and is looking for a Senior Data … evolution of the Azure data platform Key experience: Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Advanced SQL and Python CI/CD with Azure DevOps Strong stakeholder engagement and communication skills What's on offer: Flexible hybrid working ...

based role (40% in the office). Main responsibilities: Lead an outstanding Agile technical team Build data pipelines and data lake Deliver quality software Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards …/Hadoop Strong experience with AWS cloud services including AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience of the full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira Significant experience of programming using Scala or Python. Configuration as code ...

Data Engineer needed in Lincoln Paying £27.95 per hr ref 376144 Full time hours on a temporary basis Key Responsibilities Design, develop, and maintain scalable data pipelines and data integration solutions. Build and optimise ETL/ELT processes to extract data from … various source systems. Develop and maintain data warehouses, data lakes, and cloud-based data platforms. Ensure data quality, accuracy, integrity, and consistency across all data assets. Monitor and troubleshoot data pipelines, resolving performance and reliability issues. Collaborate with ...

Data Engineer 2-3 days p/w on site in Milton Keynes Contract until the end of the year Technical Skills. Expert in Data Bricks, ADF & SQL (SQL queries, SQL Server Integration Services (SSIS) (Stored Procedures Development). Expert in Data Modelling & Data … Teams/SharePoint/One Drive Understanding of database management systems and ETL (Extract, transform, load) framework Understanding of MS Azure data lake design (e.g. dimensional modelling) and data mining Business Skills Proven abilities to take initiative and be innovative Analytical mind with a problem ...

Developer/Senior Developer - Azure Data Platform/DataBricks Location: Leicester (Hybrid: 3 days per week in-office) Contract Type: 12-Month Fixed Term Contract Job Schedule: Full-time The Opportunity We are seeking a skilled Developer/Senior Developer to join a rapidly expanding Business Intelligence Systems … similar Spark-based platforms) and Azure Data Factory (ADF). Languages: SQL and Python. Data Platforms: Azure Data Lake and SQL Server RDBMS. ETL Tools: SQL Server Integration Services (SSIS) and ADF. Soft Skills: Excellent English communication skills and a proven ability ...

candidate will be part of the team transforming from a traditional SQL team to a modern hybrid cloud platform bringing together the best data, analytical and reporting tools to deliver new and enhance existing products and support our users. You will work with Finance, Product, Warehouse, Marketing … skills. Essential Skills DataBricks or similar and Azure Data Factory Languages: SQL, Python Data Platform: Azure data lake and SQL Server RDBMS ETL: SQL Server Integration Services and ADF Experienced in effectively working in a collaborative manner in a large, fast paced environment ...

Capital One UK is seeking a Senior Manager Architect in Data to shape the architecture of a cloud-based data ecosystem. You will lead cross-functional teams, influence senior stakeholders, and define standards for distributed data processing, data lakes, and data products. You will collaborate with engineers, data scientists, and governance teams to drive real-time data capabilities, ML/AI readiness, and scalable data platforms across the organization. #J-18808-Ljbffr ...

Data Architect Telford/Hybrid - 2 days per week onsite Max rate: £644 per day inside IR35 6 months initial contract Active SC clearance Are you a seasoned Data Architect with deep SAS expertise? We're looking for a technical leader to own the architecture … large-scale or highly regulated environments Active SC clearance Nice to Have SAS Viya experience Cloud platform exposure (AWS, Azure, GCP) Data lake/lakehouse knowledge Experience with legacy-to-Viya modernisation If you are interested in this Data Architect role, apply now or email ...

have) Generative AI & RAG Architectures: Design and deploy Retrieval-Augmented Generation (RAG) pipelines to contextualize Large Language Models (LLMs) with proprietary OT data, maintenance manuals, and historian logs for intelligent operator assistance and automated root-cause analysis. Edge AI & MLOps: Operationalize lightweight machine learning models as containerized Azure … scale, Event Hubs, and Azure Functions. Data Topologies: Build highly resilient, real-time ingestion pipelines feeding into ADX, Data lake, and cloud-native AI/ML workspaces. Digital Twin Modeling: Formulate and deploy Azure Digital Twins concepts to map complex physical operations to digital, event ...

Power Apps and Power Pages Creating integrations between Dynamics 365 and other business systems Working with APIs, Azure services, and cloud technologies Supporting data and reporting solutions using Microsoft tools Contributing to release management, deployments, and DevOps processes Collaborating with architects, project teams, and business stakeholders … large-scale transformation programmes Microsoft Fabric Power BI Dual Write and Dynamics integrations SharePoint integrations Microsoft Entra ID Azure Function Apps, Data Lake, or Key Vault BENEFITS Flexible working options 33 days holiday including bank holidays Holiday purchase scheme Enhanced family friendly benefits (maternity, adoption, paternity ...

Power Apps and Power Pages Creating integrations between Dynamics 365 and other business systems Working with APIs, Azure services, and cloud technologies Supporting data and reporting solutions using Microsoft tools Contributing to release management, deployments, and DevOps processes Collaborating with architects, project teams, and business stakeholders … large-scale transformation programmes Microsoft Fabric Power BI Dual Write and Dynamics integrations SharePoint integrations Microsoft Entra ID Azure Function Apps, Data Lake, or Key Vault BENEFITS Flexible working options 33 days holiday including bank holidays Holiday purchase scheme Enhanced family friendly benefits (maternity, adoption, paternity ...

maturing project and steer the next crucial stage of its delivery. The primary focus of the role is to ensure the Dynamics data is captured and modelled in Snowflake to meet business requirements, working with colleagues from IT Services and the wider business. What you will be doing … constructively with colleagues in Admission, Student Recruitment and IT Services, including the Dynamics product team. Take a leading role in development of data models in Snowflake, ensuring compliance with institutional data governance. Contribute to development of data lakes and the data warehouse ...