26 to 50 of 139 Data Lake Jobs in the UK

critical functions. Responsibilities: Design, build and deploy scalable, secure data solutions using Azure Databricks, Data Factory and Data Lake Storage. Develop and optimise advanced data pipelines with Python, SQL, Spark/PySpark and Delta Lake. Champion strong data quality … business teams to align engineering solutions with organisational needs. Minimum Criteria Extensive experience with Azure services including Azure Databricks, Azure Data Lake Storage, and Azure Data Factory. Advanced proficiency in SQL, Python, and Spark (PySpark), with a strong focus on performance optimization and distributed processing. ...

sources Design and manage Purview scans, collections, and data maps for structured platforms including Azure SQL, Synapse, and Azure Data Lake Configure classifications, sensitivity labels, business metadata, and lineage for structured datasets Support the definition and implementation of structured data governance operating models … data governance use cases Proven experience working with structured data platforms such as Azure SQL, Azure Synapse, Data Lake Gen2, or similar Solid understanding of structured data concepts including relational models, data warehouses, and analytics architectures Experience designing ...

operating from over 400 sites across the UK, Ireland and US. We are growing! At Breedon we have an opportunity to join our Data & Analytics Team with an exciting plan and long-term vision. We are seeking an experienced Data Engineer, with skills in Microsoft Azure … building, and maintaining end-to-end data pipelines using Azure-native technologies, including Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics and/or Databricks. Strong foundation in data modelling and data warehousing concepts (star/snowflake ...

Overview Our client is seeking a Senior Data Architect to join their growing consultancy team. This role involves working within multidisciplinary Agile teams to design and deliver user-centred digital solutions, ensuring data is accessible, secure, and optimised to support evidence-based decision-making. You will … Requirements • Proven experience designing and delivering data architectures for diverse stakeholders. • Strong knowledge of data warehousing and data lake architectures , with experience on platforms such as Snowflake or Databricks. • Experience with major cloud platforms (AWS, Azure, or Google Cloud Platform). • Strong understanding ...

seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London with hybrid working. Key Responsibilities Design and build robust data … Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using Azure Data Lake Storage Implement Databricks solutions using Delta Lake and medallion architecture (bronze, silver, gold) Optimise performance ...

Data Engineer (Azure & Databricks) - 6-month Contract We are seeking an experienced Senior Data Engineer with strong Databricks expertise to design, build, and maintain a scalable cloud-based data platform for a private equity firm. This is a 6-month contract based in London … Factory and Databricks Develop ETL/ELT processes to transform raw data into analytics-ready datasets Architect and maintain data lake solutions using Azure Data Lake Storage Implement Databricks solutions using Delta Lake and medallion architecture (bronze, silver, gold) Optimise performance ...

pipelines Develop and manage ETL processes across Azure data platforms Work with Azure Data Factory, Azure Data Lake, and Azure SQL Collaborate with stakeholders to integrate data from multiple sources Support data warehouse development and optimisation Implement best … Contribute to CI/CD pipelines and deployment processes Required Skills & Experience Strong experience with Azure Data Factory, Azure Data Lake, and Azure SQL Solid background in ETL development and data pipeline engineering Proficiency in Python and SQL Experience with Spark and Databricks ...

data pipelines and ETL/ELT workflows Develop scalable solutions across Azure Synapse, Data Factory, and Data Lake Support the ongoing evolution of the wider Azure data platform Enhance data models and reporting layers that underpin downstream BI solutions … strong engineers with solid experience across the Microsoft data stack, particularly: Azure Synapse Azure Data Factory Azure Data Lake SQL ETL/ELT pipeline development Power BI data modelling and reporting integration Experience with SSIS, SSRS, or legacy SQL environments (desirable ...

Contract Data Architect - Senior SME (Modern Data Platform) Contract Length: 12-18 months (strong potential to extend or move permanent) It will be Inside IR35 Day Rate: £600-£700 Location: UK-based, primarily remote Ad hoc travel to Stratford-upon-Avon & London for workshops and occasional … travel to Bucharest the main office is in Stratford. Overview We are seeking a Senior Data Architect to act as a subject matter expert for the design and build of a modern, enterprise-scale data platform . This is a high-impact contract role with full ...

Responsibilities Enterprise Data Modelling Standards Define and own a group‐wide data modelling standard, including Star Schema patterns, Snowflake object hierarchies, and modelling conventions that underpin all analytical and operational data products. Cross‐Cloud Data Orchestration Design and implement secure, high‐throughput … data build tool) or comparable transformation and orchestration frameworks. Cloud & AWS Integration Strong understanding of AWS IAM, S3‐based data lake architectures, and PrivateLink or equivalent patterns for secure cross‐cloud connectivity. AI & ML Enablement Practical experience designing data infrastructure to support ...

looking for a Data Engineer to join a fast-growing UK startup that’s reshaping how the hospitality industry manages staffing and operations through a data‐driven platform. You’ll play a key role in building the data foundations that power both internal decision … making and customer‐facing products. The role You’ll combine data engineering, analytics, visualisation and infrastructure to make high‐quality data accessible across the business. You will: Build and maintain scalable data pipelines feeding mobile and web apps, plus internal dashboards. Design and implement ...

Data Manager (Data Governance) Location: Manchester (Hybrid) Contract Duration: 6 Months Working Hours: 37.5 hours per week We are looking for a proactive Data Manager to join a global travel leader's Data Governance team. This role is pivotal in supporting … years of experience in Data Governance, MDM, or lifecycle management. Concepts: Strong understanding of Data Warehouse vs. Data Lake architectures and ETL workflows. Communication: Ability to translate technical data issues into actionable business insights for senior stakeholders. Randstad Technologies is acting ...

Join the Chief Data & Analytics Office at JPMorganChase and help accelerate our data and analytics journey. You will lead complex, multi-functional technology projects that impact clients, employees, and stakeholders firmwide. Bring your technical fluency and analytical reasoning to drive innovative solutions, manage resources, and foster … data platforms such as Databricks and Snowflake. Strong knowledge of AWS data analytics services, including Redshift, EMR, Glue, Athena, Kinesis, Lake Formation, MSK, and S3 data lake patterns. Preferred Qualifications, Capabilities, and Skills Experience navigating complex data governance, security ...

Data Solutions Architect Salary: £90K - £100K London (Hybrid) At Data Idols, we are working with a large-scale, data-driven organisation investing heavily in its data platform, analytics and AI capabilities. They are now looking for a Data Solutions Architect … data platforms Experience with Databricks or similar modern data platforms Good understanding of data warehouse, data lake or lakehouse architectures If you are looking for a new challenge and want to help shape data solutions across a large-scale ...

Data Pre-Sales Architect – Azure & Modern Data Location: UK/Remote Type: Permanent Salary: £110k + 20% bonus Cloud Decisions is partnering with one of Microsoft’s closest delivery partners and an Azure Expert MSP to hire a Data Pre-Sales Architect . This … What We’re Looking For 3+ years hands-on experience with Azure Data Services (Synapse, Data Factory, Data Lake, Databricks, Power BI, Cosmos DB) Strong understanding of data modernisation, migration, and analytics Knowledge of Azure governance, security, and best practices ...

Skills Proven experience with Databricks (including Spark-based data processing). Strong knowledge of Azure Data Platform (Data Lake, Synapse, etc.). Proficiency in Python and SQL for data engineering tasks. Understanding of data architecture and ETL processes. Ability … work independently in a remote environment. Nice-to-Have Experience with CI/CD pipelines for data solutions. Familiarity with Delta Lake and ML pipelines . Start Date: ASAP Contract Type: Outside IR35 Apply Now: If you're a skilled Data Engineer looking ...

founding in 2013, Quantiphi has tackled some of the world’s most complex business challenges by combining deep industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied AI research. Our work is rooted in delivering accelerated, quantifiable business value, not just technology for technology … expertise, including backup & recovery strategies, HA/DR design, database patching and upgrades, lifecycle management, capacity planning, performance monitoring, and security hardening. Experience with Lake Formation and data governance frameworks Familiarity with Data Mesh and cross-account data sharing architectures Experience with ...

client is a fast-growing e-commerce business, rapidly expanding. The role: Data Analyst Skillset: Must haves; Power BI report development (including DAX, Power Query, Parameters) Semantic model development Advanced Excel skills, including Data Connections, Power Query, and Power Pivot Intermediate or advanced T-SQL Debugging … beneficial, though transferable skills from similar systems are equally valued. Desirable; Microsoft Fabric or other cloud data services incorporating data lake, data warehouse, data pipelines, analytics & business intelligence Power BI calculation groups, bookmarks, semantic model incremental refresh Tabular Editor Excel dynamic ...

Role We`re looking for a new Data Engineer to join our Technology team based in Loudwater, Buckinghamshire. In this role, you will have a passion for uncovering insights and making data-driven decisions. Your expertise lies in working with a range of tools (SQL, Python … fast-paced retail/multi-site/FMCG space. Strong experience using modern data platforms and services (Fabric, Data Lake, Azure Data Factory, SQL (On-prem/Cloud) to build conformed and derived data models for the purpose of integrations, reporting ...

Data Engineer – Azure or AWS with Databricks - London (Hybrid) - £75,000 + benefits We’re partnering with a high-performing organisation that continues to invest heavily in its data capability. Over the last 24 months, the business has achieved 33% growth in its data … building end-to-end data pipelines using Databricks on Azure or AWS Developing modern lakehouse architectures using: Databricks (Spark, SQL, Delta Lake) Azure Data Lake Storage or Amazon S3 Writing high-quality PySpark, Python, and SQL for ingestion, transformation, and modelling Implementing Bronze/ ...

code agentic workflow platform — while simultaneously owning the data and model foundations that power them: the Sidetrade Data Lake, our ML model portfolio, and our LLM fine-tuning strategy. About Sidetrade: Sidetrade is an AI company, listed on Euronext Growth, on a mission to revolutionize … compose intelligent O2C workflows using agentic AI — without writing a line of code. Own the product strategy for the Sidetrade Data Lake — defining how data assets are structured, enriched, governed, and surfaced across all O2C domains, driving continuous improvement across Gold, Silver, and Bronze data ...

Title: Snowflake/Data Architect Salary: Paying up to £90,000 per annum Location: Wembley London - 5 days on-site Our client, a well-established and diversified multinational organisation, is seeking a Snowflake/Data Architect to join their team. Skills Solid experience in Data … experience with dbt (data build tool) or equivalent transformation frameworks. AWS Integration : Solid understanding of AWS IAM, S3 data lake patterns, and PrivateLink for cross-cloud data connectivity. AI Readiness : Practical experience architecting data infrastructure for AI/ML consumption - vector ...

founding in 2013, Quantiphi has tackled some of the world’s most complex business challenges by combining deep industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied AI research. Our work is rooted in delivering accelerated, quantifiable business value—not just technology for technology … expertise, including backup & recovery strategies, HA/DR design, database patching and upgrades, lifecycle management, capacity planning, performance monitoring, and security hardening. Experience with Lake Formation and data governance frameworks. Familiarity with Data Mesh and cross-account data sharing architectures. Experience with ...

Data Engineer - SC Cleared/SC Eligible Location: Newcastle upon Tyne About the Role We are working with a leading organisation who are building a brand-new engineering and data function in Newcastle. They are looking to hire multiple Data Engineers across Junior … modelling and warehousing concepts Cloud & Platforms: • AWS (S3, Redshift, Glue, EMR, Lambda) • Other cloud platforms (Azure/GCP considered) • Data lake and data warehouse architectures General: • Strong problem-solving skills • Experience working in agile environments • Good communication and stakeholder engagement • Understanding of secure ...

Data Engineer – London – Databricks – Azure – 75k + bonus + benefits I’m currently working with a company that continues to grow even after 60 years in operation. With more than 1,000 projects completed worldwide and a combined project value exceeding $150 billion, they’ve established themselves … forefront of your field. What You’ll Work With Azure Data Services: Data Factory, Data Lake, SQL Databricks: Spark, Delta Lake Power BI: Advanced dashboards ETL & Data Modelling: T-SQL, metadata-driven pipelines What you’ll do Design and implement ...