1 to 25 of 40 Data Lake Jobs in the Midlands

Will Bring Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and cloud tools. Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leveraging ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data. Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery. Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices. Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

IaaS, specifically: App Services, Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake & Fabric. Understand which Azure data focused components to use for which purpose. Microsoft certified architect Databricks Design and build high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Ability to Design, Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles … Python, Java, and R Strong knowledge of AI frameworks such as TensorFlow or PyTorch. Experience in Data Science techniques and methodologies. Azure Datalake, Databricks, Python (Azure Reference architecture). Excellent problem-solving skills and ability to work in a team environment. Thorough and proven understanding of the principles ...

order to be considered for this role, you will need to be eligible for UK Security Clearance You will join the Enterprise Data Management practice in Capgemini’s Insights and Data (I&D) business unit. Insights and Data is a global business unit covering … Enterprise Data Management, Cloud Platforms, Enterprise Content Management and AI & Analytics. Our practice has a strong focus on leading technology vendors, spanning data warehousing, data quality, data governance, data integration and analytics. Capgemini is proud to be a leading partner ...

responsible for building and operating an Azure-based data platform, ensuring it provides a secure, scalable and trusted data lake using Azure Databricks. Working alongside data architects and engineering teams, you will help deliver new data products, onboard data … external data sharing. Implement data governance, security, access controls, backup, retention and monitoring to maintain the data lake as a trusted single source of truth. Develop and maintain data ingestion, transformation and data product pipelines. Collaborate with data ...

high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Design and oversee the delivery of secure data warehouses and data lakehouses: Implement data … platforms with a strong understanding of data warehousing concepts and practices. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage, Databricks, and Azure Data Factory. Excellent problem-solving and analytical skills and strong communication and teamwork skills. Passion for data ...

modelling, optimisation and supporting data solutions. You'll be working with Azure Databricks, Data Factory, Synapse, Data Lake, SQL and Python/PySpark. Key responsibilities: Build and enhance data pipelines across Azure and Databricks Develop ETL/ELT solutions … sources Transform and model data for use across analytics and reporting Support the ongoing development of the organisation's Data Lake and wider cloud data environment Troubleshoot pipeline and data issues, improving performance and reliability Help maintain strong standards around data ...

reporting and analytics * Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts * Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … outcomes. We're looking for demonstrable experience in: * Multiple data storage technologies used in data warehouse and data lake solutions, such as: o Relational DBMS o NoSQL o Graph databases o Cloud object storage o DB as a service * Architecture and design concepts ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … strong understanding of data warehousing, dimensional modelling, and lakehouse concepts. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage/ADLS Gen2, Microsoft Fabric (OneLake, Workspaces, Capacity), Azure Synapse and/or SQL, and Azure Data Factory. Excellent problem-solving ...

reporting and analytics* Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts* Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with … delivery outcomes.We're looking for demonstrable experience in:* Multiple data storage technologies used in data warehouse and data lake solutions, such as:o Relational DBMSo NoSQLo Graph databaseso Cloud object storageo DB as a service* Architecture and design concepts for ETL/ ...

client stakeholders and internal delivery leadership Experience with multiple data storage technologies used in data warehouse and data lake solutions, such as: Relational DBMS, NoSQL, Graph databases, Cloud object storage & DB as a service Architecture and design concepts for ETL/ELT solutions … reporting and analytics Advising clients on architecture/infrastructure, platform and engineering best practices across data warehouse/data lake solutions and modelling concepts Taking ownership of client requirements, deliverables and accountabilities, ensuring adherence to architecture governance processes, industry best practices and alignment with ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You Will Be Working With... As a Data Engineer at Capgemini, you'll design, build and operate reliable, scalable data pipelines and data products: the trusted foundations that … Specialist tracks (we'd love depth in one of these; you don't need all of them): Azure/Databricks Azure Data Lake Storage, Databricks, Apache Spark, Delta Lake, Azure Data Factory, MLflow; and, for the AI edge, Databricks Mosaic AI, Vector Search ...

Data Architect Salary: Up to £72,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 01/09/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we’d love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

pipelines Developing Power BI semantic models and supporting reporting solutions Engineering robust Azure Data Factory integrations Building secure Azure Data Lake solutions Working with SQL Server and advanced SQL development Delivering API integrations across internal and third-party systems Supporting Azure DevOps and CI/… also bring strong experience across: Microsoft Fabric (essential) Azure Synapse Analytics (essential) Power BI Azure Data Factory Azure Data Lake SQL Server ETL/ELT development Azure DevOps Git Enterprise cloud data engineering AI Experience We're looking for engineers who have already ...

Build and optimize data pipelines using Azure Data Factory (ADF) and SSIS . Leverage Databricks and Azure Data Lake to innovate and streamline workflows. Create high-impact reporting solutions in Power BI . Collaborate with multi-functional product teams and mentor junior developers. … Looking For: Languages: Strong proficiency in SQL and Python . Data Platforms: Hands-on experience with Databricks and Azure Data Lake . ETL: Proven ability to build efficient pipelines (ADF, SSIS, APIs). Desirable: PySpark, Dimensional Modelling, DAX/SSAS, or an interest ...

Senior Data Engineer – Azure/Databricks £70,000 + bonus Hybrid Working – 1 day on-site per week East Midlands based I'm working with a business that's continuing to invest in its Azure data platform and is looking for a Senior Data … evolution of the Azure data platform Key experience: Azure Databricks Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Advanced SQL and Python CI/CD with Azure DevOps Strong stakeholder engagement and communication skills What's on offer: Flexible hybrid working ...

initiatives for the Technology and Compliance departments, alongside our Contact Centre partners, leveraging tools such as Azure stack (Azure Data Factory, Azure Datalake), Databricks and PowerBI to innovate and streamline workflows. As part of a product team, you will develop solutions tailored to meet business requirements, including initiatives … infrastructure. Technical Expertise Languages: Strong proficiency in SQL and Python. Data Platform: Hands‐on experience with Azure Data Lake and Databricks. Data Integration (ETL): Proven capability in building efficient data pipelines using Azure Data Factory (ADF), SSIS ...

based role (40% in the office). Main responsibilities: Lead an outstanding Agile technical team Build data pipelines and data lake Deliver quality software Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards …/Hadoop Strong experience with AWS cloud services including AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience of the full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira Significant experience of programming using Scala or Python. Configuration as code ...

based role (40% in the office). Main responsibilities: Lead an outstanding Agile technical team Build data pipelines and data lake Deliver quality software Collaborate with the risk, security and compliance teams to ensure adherence to regulatory requirements (e.g., GDPR, PCI DSS) and industry standards …/Hadoop Strong experience with AWS cloud services including AWS Glue, S3, Step Strong experience building data pipelines and data lake Experience of the full development lifecycle/application Lifecycle Management Tools - BitBucket & Jira Significant experience of programming using Scala or Python. Configuration as code ...

Data Engineer 2-3 days p/w on site in Milton Keynes Contract until the end of the year Technical Skills. Expert in Data Bricks, ADF & SQL (SQL queries, SQL Server Integration Services (SSIS) (Stored Procedures Development). Expert in Data Modelling & Data … Teams/SharePoint/One Drive Understanding of database management systems and ETL (Extract, transform, load) framework Understanding of MS Azure data lake design (e.g. dimensional modelling) and data mining Business Skills Proven abilities to take initiative and be innovative Analytical mind with a problem ...

LocationNorthampton, United Kingdom# Senior Data Architect at N Consulting LtdLocationNorthampton, United KingdomSalary£450 - £500/dayJob TypeFull-timeDate PostedApril 8th, 2026Apply Now**Role:** Senior Data Architect**Experience:** 10years**Location:** Northampton, UK**Work mode:** Hybrid**Key Responsibilities:****Data Architecture & Engineering Deliverables****Understand Data Requirements & Authoritative Data Source Assessment**: Engage early to capture business and technical data needs.**Create and Maintain Architecture Artifacts**:o **Data Flow Diagrams (DFD)** and **Logical/Physical Data Models** for end-to-end lineage.o **Data Dictionary**: Define ...

LocationNorthampton, UK, United Kingdom# Data/Solution Architect at N Consulting LtdLocationNorthampton, UK, United KingdomSalary£450 - £500/dayJob TypeContractDate PostedApril 8th, 2026Apply Now**Job title: Data/Solution Architect- 2 roles ( 1- Sr Architect and 1- Architect)****Location: Northampton, UK****Job type: Contract- Hybrid … days onsite****Required Skills**Minimum 8+ years of experience working as Data Architect for AWS Cloud Dataware house Data Architecture & Engineering DeliverablesUnderstand Data Requirements & Authoritative Data Source Assessment: Engage early to capture business and technical data needs.Create and Maintain Architecture ...

Developer/Senior Developer - Azure Data Platform/DataBricks Location: Leicester (Hybrid: 3 days per week in-office) Contract Type: 12-Month Fixed Term Contract Job Schedule: Full-time The Opportunity We are seeking a skilled Developer/Senior Developer to join a rapidly expanding Business Intelligence Systems … similar Spark-based platforms) and Azure Data Factory (ADF). Languages: SQL and Python. Data Platforms: Azure Data Lake and SQL Server RDBMS. ETL Tools: SQL Server Integration Services (SSIS) and ADF. Soft Skills: Excellent English communication skills and a proven ability ...