76 to 100 of 118 Data Lake Jobs in the UK

Cleared Technical Architect – Data Platforms Truenorth are currently working with a leading technology consultancy on a Technical Architect (Data Platforms) opportunity, supporting the design and evolution of large-scale, cloud-based data platforms across a range of high-impact programmes. This role is ideal … time). Proficiency in Infrastructure as Code (Terraform). Experience with GitHub-based workflows and CI/CD pipelines. Experience with data lake and lakehouse architectures. Strong understanding of: Data ingestion patterns Data transformation and curation layers Data access and productisation ...

companies globally – with offices in New York, London, Madrid and Singapore. We are at an early and exciting stage of embedding AI and data capabilities across the firm. This hire is central to that effort. The Role: We are looking for a commercially minded AI and data … into the business in a practical, considered way Data Infrastructure and Reporting Help maintain and extend our Snowflake-based data lake, supporting data quality and accessibility across the business Build and maintain Power BI dashboards and reports that drive commercial decision-making across ...

Cleared Technical Architect – Data Platforms Please note this role is based in either London or Manchester and you must have Active - or very recently lapsed - SC Clearance to be considered for this role. We are currently working with a leading technology consultancy on a Technical Architect (Data … time). Proficiency in Infrastructure as Code (Terraform). Experience with GitHub-based workflows and CI/CD pipelines. Experience with data lake and lakehouse architectures. Strong understanding of: Data ingestion patterns Data transformation and curation layers Data access and productisation ...

engineering best practice and guide delivery across cross-functional teams. Responsibilities Build and optimise Azure data platforms using ADF, Data Lake, Azure Functions and Databricks Deliver reliable, high-quality data pipelines Work with stakeholders to ensure solutions meet Lloyd's of London regulatory … Services and Databricks in enterprise environments. Proven delivery experience within the Lloyd's of London or London Market insurance sector Deep understanding of Delta Lake, Medallion architecture, Lakehouse patterns and data modelling. Strong Python, PySpark and Spark SQL capability Solid understanding of data governance Proven ...

Hybrid/Office based Number of positions: 2 Our client a major retail and commercial bank is currently looking for an Enterprise Cloud & Data Architect to be responsible for defining and delivering enterprise-wide cloud and data architecture strategies , ensuring alignment with business objectives, regulatory requirements … technology roadmaps. The role provides thought leadership in modernising the technology landscape, driving scalable, secure, and resilient cloud and data platforms Required Skills & Experience: Core Skills: Strong experience in Enterprise Architecture/Cloud Architecture/Data Architecture Proven ability to define architecture strategies and roadmaps Experience ...

Entry-level Data & AI Consultant role for individuals looking to build a career in data engineering and AI. You will work on real client projects, supporting the design and delivery of data pipelines, models, dashboards, and AI-driven solutions. This is not a passive … Support development of Power BI dashboards Assist in AI use cases (automation, simple models, insights) Work within Azure-based environments (Databricks, Data Lake, etc.) Test, validate, and document solutions Training Possible promotion within the organisation Moving onto a higher level apprenticeship Apprenticeship Standard Data technician ...

Agent technologies, Microsoft Fabric and Azure, enabling us to deliver connected, intelligent and responsible business solutions at scale. The Role: Microsoft Agentic Data Lead – Microsoft Business Solutions (MBS) The Microsoft Agentic Data Lead is a senior leadership role responsible for defining, leading and growing KPMG … Microsoft Agentic Data capability. This role sits at the intersection of Data, AI, Power Platform and Dynamics 365, with a clear mandate to help clients realise value from the Microsoft platform through modern data foundations and innovative agentic solutions. The successful candidate will ...

Principal Data Engineer Location: Remote Salary: Up to £95,000 Sponsorship: Not available VIQU have partnered with a nationally recognised organisation that has recently completed a full migration from on-premise infrastructure to Google Cloud Platform (GCP) and is now building a modern, domain-oriented Data … essential) Strong SQL and Python expertise Experience building cloud-native data platforms end-to-end Strong background in Data Lake/Warehouse architecture Proven experience implementing CI/CD and infrastructure as code Confidence to challenge stakeholders and influence technical direction Candidates without strong, proven ...

tasks and queries. Exposure to Java script technologies (preferably React) Exposure to Azure Databricks environment is desirable (PySpark, notebooks, integrate repos, job workflows, delta lake, unity catalog etc) Exposure to azure environment and various interconnected azure components (Functions, App Service, Containers etc.). Knowledge on Financial domain and mainly … PySpark Web frameworks: Django, Flask, or FastAPI. Frontend Technologies: ReactJS, Java Script Azure : Azure Databricks, Azure Synapse Analytics, Azure Functions, Azure Data Lake Storage Gen2, Azure Event Grid, Azure Event Hubs, Azure Service Bus, Azure Key Vault, Azure Monitor, Azure Log Analytics, Azure API Management (APIM), Azure ...

client are looking for a Contract Senior Software Developer to design, build, and maintain microservices-based applications and data engineering pipelines. This role requires strong hands-on development experience across Java services, backend systems, and data processing platforms, with a focus on building scalable, reliable … maintainable solutions. The role involves close collaboration with data engineers, QA, product, and platform teams to deliver high-quality services and data products across a complex enterprise environment. Technical Skills & Experience Core Skills Strong hands-on experience developing Java-based applications in a microservices architecture. Solid ...

client are looking for a Contract Senior Software Developer to design, build, and maintain microservices-based applications and data engineering pipelines. This role requires strong hands-on development experience across Java services, backend systems, and data processing platforms, with a focus on building scalable, reliable … maintainable solutions. The role involves close collaboration with data engineers, QA, product, and platform teams to deliver high-quality services and data products across a complex enterprise environment. Technical Skills & Experience Core Skills Strong hands-on experience developing Java-based applications in a microservices architecture. Solid ...

Senior AWS Data Engineer - SC Cleared Rate: Up to £475 per day IR35 Status: Inside IR35 - engagement via an umbrella company Duration: 6 months Location: Hybrid - occasional on-site workshops (typically a couple of days per month) in Telford or Hove Security Clearance: Active SC Clearance required Role … Overview We are seeking an experienced Senior AWS Data Engineer to support a large-scale central government data transformation programme . The role sits within a major data delivery area that provides data and analytics solutions aligned to critical business priorities, including ...

Senior ML/MLOps Engineer (MLflow) | Databricks | Azure) About Optima Partners We’re an advanced data & business consultancy helping major consumer brands transform through data-driven customer strategy, design, and engineering. Our clients include leading UK and global brands across financial services, retail, and more. Join … workflows Build scalable data & ML pipelines in Databricks (Delta, DLT, Jobs) Design and maintain Azure data architectures (Data Lake, Synapse, SQL DW) Create robust CI/CD pipelines for ML + data using Azure DevOps, Git, Jenkins Automate infrastructure with Terraform ...

Contract AI & Data/Jr Forward Deployed Engineer | Up to £500.00 Outside IR35 | 3 months (rolling) | Hybrid Monthly (UK) A fast-growing UK-based FinTech scale-up is looking for 2x Contract AI & Data Engineers to join their financial analytics platform team. Haven't held … PyTorch) Background in data engineering, analytics engineering, or similar Desirables: ETL/ELT pipeline experience Microsoft Fabric/Data Lake knowledge BI tools (e.g. Power BI, Tableau) Financial services or payments experience On Offer: £500.00 per day Outside IR35 3-month contract (rolling) Hybrid monthly ...

Monday to Friday 8am-5pm Pay: £17.58ph paid weekly PAYE Duration: 6 month contract with possibility for extension Duties 6-month fixed-term Data Migration Analyst to support the IFS Cloud integration programme. The role is responsible for validating, cleansing, and reconciling data received from … Senior Analyst. Person Specification Degree-level education preferred or equivalent analytical experience. Advanced Excel essential; SQL knowledge desirable. Technical knowledge of data lake along with data migration experience. ...

Azure Data Engineer – SC Cleared Contract – Inside IR35 6 Months (Likely Extension) We’re looking for a senior Azure Data Engineer with active SC Clearance to join a high-impact data programme. This role is strictly for hands-on engineers who can design, build … Ability to work independently without hand-holding Strong Microsoft/Azure background (true specialist) Exposure to Microsoft Fabric components (e.g. Synapse, Data Lake, related services) Not Suitable For Business Analysts or functional roles Managers/Leads not coding day-to-day Candidates who have only “touched” Azure ...

considered Diversity & Inclusion: Extremely important—encouraging a broad mix of people from all backgrounds Who We Are Hypercube Consulting is a rapidly growing data and AI startup dedicated to transforming the energy sector through cutting-edge technology. Specialising in advanced AI systems, including Agentic AI workflows and large … language models (LLMs), we help clients unlock profound value from their data assets. Join our expert team in shaping the future of AI-driven energy solutions. Role Purpose We are seeking an AI Engineer with hands-on experience in Agentic AI systems and Large Language Models to help ...

Data Engineer – Azure - Databricks/Fabric - Remote – up to £65,000 I’m currently supporting one of the UK's fastest-growing Microsoft data consultancies as they continue to scale their team. If you're a Data Engineer who wants to work on modern … this could be a great fit. What You’ll Be Doing In this role, you’ll be central to designing and delivering modern data solutions for a range of clients: Architect and deliver scalable data solutions using Databricks, Synapse, and Microsoft Fabric Build and optimise ...

DATA ANALYST UP TO £55,000 LONDON/HYBRID OVERVIEW This is a highly visible role sitting within the Group Finance team, where you'll act as the Power BI SME across the function while working closely with senior leadership. THE ROLE You'll be responsible for building … reporting cycles Partnering with senior finance stakeholders across the business Supporting major transformation projects including a new consolidation platform and central data lake SKILLS AND EXPERIENCE: The ideal candidate will have the following: Strong Power BI experience (essential) Advanced DAX & Power Query skills SQL knowledge Finance ...

leading organisation undergoing major investment in its data and engineering capabilities is looking for a Senior Automation QA Engineer to strengthen quality across complex, distributed systems. This role sits at the intersection of software engineering and data engineering, supporting the delivery of high quality services … reliable data products at scale. You ll work closely with cross functional teams, driving automation, improving test maturity, and ensuring the accuracy and resilience of data pipelines and backend services. This is a hands on role suited to someone who enjoys ownership, technical depth, and influencing ...

leading organisation undergoing major investment in its data and engineering capabilities is looking for a Senior Automation QA Engineer to strengthen quality across complex, distributed systems. This role sits at the intersection of software engineering and data engineering, supporting the delivery of high‑quality services … reliable data products at scale. You’ll work closely with cross‑functional teams, driving automation, improving test maturity, and ensuring the accuracy and resilience of data pipelines and backend services. This is a hands‑on role suited to someone who enjoys ownership, technical depth, and influencing ...

Title: Senior Engineering Lead – Azure Cloud Data Platform Work Location: Cardiff, UK (Hybrid - once a week working from office) Job Description: Key Responsibilities Provide strategic guidance and technical leadership to the Nucleus product team, ensuring alignment with business objectives and cloud best practices. Support, develop and evolve … Demonstrable expertise in Azure data services including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage. Familiarity with Azure SQL, Cosmos DB, and other Azure database technologies. Strong understanding of DevOps principles, infrastructure-as-code patterns (Terraform, Bicep ...

love making systems work brilliantly for the people who use them, this is your kind of role. As a Systems & Data Analyst, youll help our teams get the right information at the right time, support them in using our systems confidently, and champion improvements that make everyday tasks … easier and smarter. Youll be hands-on with everything from system configuration to data reporting, all while helping us build a stronger, more connected digital foundation for the future. Here's what Manager Jane has to say about why she thinks this is a great role ...

full remote working for the right SC-cleared lead. About Our Client A major technology delivery partner running complex, multi-workstream cloud and data programmes for secure UK clients in regulated and government-adjacent sectors. Established track record on Azure-led modernisation at national scale, with a mature … Lead Architect Active UK Security Clearance (SC or higher) - this is a hard requirement and non-negotiable. Expert-level Azure across Data Lake, Synapse, Databricks, Key Vault, DevOps and Networking, with strong experience orchestrating large-scale data processing. Proven track record leading multi-workstream technical ...

renewable energy sector, is seeking a Business Intelligence Analyst to join its expanding Business Intelligence team. This role focuses on delivering clear, insightful data visualisations through Power BI dashboards and reports to support informed decision-making. Working closely with the data team, this position emphasises collaboration … understanding of business services and resources to support the integration and consolidation of historical and current data into the data lake Performing additional analysis where needed (e.g. Excel uploads) during the integration process Designing and delivering tailored user interfaces for Operations teams, monthly BUR reporting ...