1 to 25 of 62 Permanent Data Lake Jobs in the UK excluding London

Will Bring Design and build high-performance data pipelines: to extract, transform, and load data into Cloud Data Lake Storage and other Cloud services. Develop and maintain secure data warehouses and data lakehouses: Implement data models, data … Extract, Load, Transform (ELT) workflows to seamlessly move data from source systems to Data Warehouses, Data Lakes, and Lake Houses using Open Source and cloud tools. Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leveraging ...

risks, improving testing standards, and mentoring engineering teams. The ideal candidate will have strong experience in Big Data and Data Lake environments , including testing both structured and unstructured datasets, and will be comfortable operating in highly automated CI/CD-driven delivery environments. You will … automated testing is fully integrated within GitLab CI/CD pipelines for rapid feedback and release confidence Big Data & Data Lake Testing Lead testing activities across Big Data and Data Lake solutions containing structured and unstructured datasets Validate large-scale ...

warehouse architectures: Implement logical and physical data models, data quality controls, and governance practices using Amazon S3 (data lake), AWS Lake Formation, Amazon Redshift, and Amazon Athena to ensure trusted data. Ability to design AI/ML-enabled solutions: Enable feature-ready … governed delivery. Stay ahead of the curve: Continuously learn and adapt to the evolving AWS data and analytics landscape, including AWS Glue, Lake Formation, Redshift, Athena, EMR, and related best practices. Define the platform operating model: Establish AWS multi-account strategies, environment separation (dev/test/ ...

IaaS, specifically: App Services, Azure SQL Database, SQL Server, Storage, Synapse Analytics, Purview, Databricks, Azure data Factory, Azure data lake & Fabric. Understand which Azure data focused components to use for which purpose. Microsoft certified architect Databricks Design and build high-performance data platforms: Utilize Databricks and Apache Spark to extract, transform, and load data into Azure Data Lake Storage and other Azure services. Ability to Design, Build and deploy AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ...

order to be considered for this role, you will need to be eligible for UK Security Clearance You will join the Enterprise Data Management practice in Capgemini’s Insights and Data (I&D) business unit. Insights and Data is a global business unit covering … Enterprise Data Management, Cloud Platforms, Enterprise Content Management and AI & Analytics. Our practice has a strong focus on leading technology vendors, spanning data warehousing, data quality, data governance, data integration and analytics. Capgemini is proud to be a leading partner ...

good, whether you're championing cyber security, defining how we harness the power of technology to improve our business, or working with data to guide the innovation of consumer loved products. Working globally across functions, you'll own your projects and process from start to finish, with … many different businesses, from Research and Product Development to Sales, you'll keep learning exciting new approaches. About the role The Global Data Governance Director is a senior leadership role responsible for building, executing, and sustaining the enterprise-wide data governance strategy. Reporting ...

understood, and realized as secure and robust solutions. \n \n Design and assess end-to-end solution architectures for enterprise-scale platforms, including data modeling, meta-modeling, master and reference data management, data quality, metadata management, data taxonomy, data integration … tools such as ERwin, Power Designer, or MagicDraw. \n \n Knowledge of data architecture options including ODS, Data Lake, Data Catalog (DCAT), Data Warehousing, OLTP, and OLAP, and the treatment of data as a technology asset. \n \n Knowledge ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … vault, etc.) Data architecture frameworks and methodologies Data governance and data management Experience with Data Lake, Lakehouse, and Data Mesh architectures Strong knowledge of SQL and modern data platforms , including NoSQL and distributed systems Experience designing ...

Data Architect £Up to £120,000 GBP Competitive Bonus + Car Allowance Hybrid WORKING Location: London; Bristol; Manchester, Central London, Greater London - United Kingdom Type: Permanent Data Architect London | Manchester | Bristol | Hybrid | Permanent Our client is a leading global technology and consulting organisation , recognised … vault, etc.) Data architecture frameworks and methodologies Data governance and data management Experience with Data Lake, Lakehouse, and Data Mesh architectures Strong knowledge of SQL and modern data platforms , including NoSQL and distributed systems Experience designing ...

Factory and Python enabling efficient data ingestion and transformation Develop and manage data solutions using Azure Data Lake, Synapse Analytics and other Azure data services Support integration and migration of key data sources Write, optimise and maintain … Data Engineer delivering solutions in cloud-based environments Strong hands-on experience with Azure Data Factory, Azure Data Lake and Azure Synapse Analytics Solid understanding of ETL processes, data integration and pipeline development Advanced SQL skills as well as Python/ ...

leading role across a modern Microsoft technology stack, including: Microsoft Fabric (Lakehouse, Warehouse & OneLake) Azure Data Factory Azure Data Lake Azure Synapse Analytics SQL Server & advanced SQL development Enterprise ETL/ELT pipelines Power BI semantic models and reporting API integrations across internal and third … data technologies. You'll ideally bring experience in: Microsoft Fabric Azure Data Factory Azure Synapse Analytics Azure Data Lake SQL Server ETL/ELT design API integration Azure DevOps Git Power BI data modelling Cloud-native data engineering ...

largest global platform for the LGBTQ+ business community. Please do not contact the recruiter directly. Who You'll Be Working With As a Data Solution Architect at Capgemini, you will design and lead the delivery of modern data platforms that enable analytics, AI, GenAI, and data … strong understanding of data warehousing, dimensional modelling, and lakehouse concepts. Experience with Microsoft Azure cloud platform, including Azure Data Lake Storage/ADLS Gen2, Microsoft Fabric (OneLake, Workspaces, Capacity), Azure Synapse and/or SQL, and Azure Data Factory. Excellent problem-solving ...

Analytics · Provide advice to clients on architecture/infrastructure, platform and engineering best practices across Data Warehouse/Data Lake solutions and modelling concepts. · Take ownership of the client requirements, deliverables and accountabilities to ensure adherence to Architecture Governance processes, industry best practices … both AWS and Azure · Experience with multiple data storage types and technologies in data warehouse and data lake solutions. Examples include relational DBMS (e.g. Oracle), Hadoop, NoSQL (e.g. Hbase), Columnar DBs (e.g .Amazon Redshift), Graph DBs (e.g. Neo4J), cloud object storage (e.g. Amazon ...

will have the opportunity to design and develop scalable data pipelines, shape the architecture of a Microsoft-based data lake and work directly with senior stakeholders across technology and finance. Reporting to the Group IT Director, you will build and maintain data solutions … pipelines Building data architecture that brings together multiple business systems Developing and supporting a Microsoft-based enterprise data lake Designing and maintaining MS SQL databases and related data systems Building ETL and data transformation solutions using Databricks and Azure ...

through to release, optimisation, and retirement Collaborate closely with product owners and data scientists to align platform capabilities with business needs Lead datalake migration initiatives, including consolidation of legacy data, medallion architecture design, schema evolution, and cutover planning Provide hands-on data engineering expertise … Databricks, AWS) Proven ability to design and manage scalable data pipelines, models, and schemas Solid SQL and relational database expertise Experience with datalake migration concepts (medallion architecture, incremental loads, backfill, cutover) Strong understanding of data governance, quality, and lifecycle management Experience with BI tools such ...

solutions and guide delivery teams through best practice. You will architect solutions using Azure Synapse, Data Factory, Databricks, Fabric, Data Lake, SQL and Power BI, with a strong focus on governance, security, performance and reliability. This position suits someone who enjoys a mix of hands … professional services. Key Skills: Azure Data Architecture and solution design Azure Synapse, Data Factory, Databricks, Fabric, Data Lake Data modelling, integration, pipelines and governance Strong stakeholder engagement and consulting experience Experience working within a Microsoft Partner or consultancy environment ...

role with purpose, influence and opportunity, ICAEW is a place where your future can truly take shape. We're looking for a Data Engineering Lead to join our team in Milton Keynes on a permanent basis. This role offers a salary of £75,000 - £85,000 per annum … track record leading data engineering delivery within a Microsoft-first environment - Azure Data Factory, Databricks, Synapse, Azure Data Lake Hands-on experience building and managing ETL/ELT pipelines, data lakes and data warehouses in a cloud environment Proficient ...

Principal Data Engineer Lead the design and delivery of a modern cloud-based data platform, driving engineering standards, architecture, and innovation across a growing data function. The Opportunity This is a senior technical leadership role responsible for shaping data engineering strategy, architecture … best practices across multiple product domains. Working within a modern cloud environment and Data Mesh architecture, you will drive the development of scalable, secure, and high-performing data solutions while mentoring engineers and influencing technical direction. Key Responsibilities Provide technical leadership across data engineering ...

Data Engineer £70,000 - West London (Hybrid - 1 day onsite) We are seeking a Data Engineer to join a well-established, international organisation operating within a sustainability-focused industry. The business is undergoing a significant digital and data transformation, with major investment in modern … PySpark, particularly within Fabric Notebooks Exposure to Azure data services such as Data Factory, Synapse or Data Lake Power BI experience, including supporting reporting and dashboarding requirements What's on Offer Salary of up to £70,000 Hybrid working model (West London with ...

faster, and act with confidence across complex domains. \n We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. \n We operate as small teams delivering fast value, blending ...

faster, and act with confidence across complex domains. \n We deliver situational awareness and information advantage across C5ISR, fusing cyber, geospatial, and kinetic data into an operational picture. This transforms fragmented data into a shared understanding of the battlespace, delivering actionable insight when it matters most. … secure-by-design, built from the ground up to protect sensitive information and ensure resilience in contested environments. We simplify complex heterogeneous data sources into a rich picture of fused intelligence, providing a digital backbone that underpins success. \n We operate as small teams delivering fast value, blending ...

Project Data Architect Salary: Up to £72,000, based on skills and experience Contract Type: Permanent– 35 hours a week Location: Hybrid working (office based in Birmingham) – typically 2 days in the office per week Closing Date: 03/08/26 Shape Brighter Futures with Wesleyan Established … innovation, and integrity, we’d love to hear from you. Find out more about who we are: About Wesleyan Make a Difference in Data Architecture and Engineering This role sits in a fast paced, dynamic data architecture team who are adding huge value to programs ...

requires in terms of skills and experience If you are a good match, make an application. \n Description \n As a Lead Data Engineer or architect at Made Tech, you'll play a pivotal role in helping public sector organisations become truly data-lead, by equipping … them with robust data platforms. You'll also join a data team on its mission to get data knowledge and skills out of silos and embedded into delivery teams. You'll also help implement efficient data pipelines & storage. \n Key Responsibilities ...

Data Engineer | Microsoft Fabric | Dynamics 365 | £65,000 | Hybrid (Brentford, 1 Day per Week) I'm working with a forward-thinking organisation that is making significant investment in its data, analytics, AI, and automation capabilities. As part of a major digital transformation programme, they are looking … stakeholder management experience Desirable Experience PySpark and/or Python development Azure Data Factory (ADF) Azure Synapse Analytics Azure Data Lake Storage Power BI development and data modelling Exposure to AI, Machine Learning, or advanced analytics projects Microsoft certifications such ...

Engineering, translating finance requirements into data solutions and managing development priorities. Administer and support the ongoing development of the Global Finance Datalake and Forecasting & Budgeting (FaB) tool, including user access, process configuration and governance. Work with Finance data stakeholders across the Group to resolve system … sets. Desirable: experience with TM1 Planning Analytics, Microsoft Dynamics 365 and/or Microsoft Fabric. Experience with enterprise reporting or data lake tools is preferred; prior exposure to a finance function would be beneficial. Salary will depend on experience and is expected ...