76 to 100 of 291 Data Lake Jobs in the UK

Data Engineer - Azure/Microsoft Fabric City of London - Hybrid Working Circa £55-65k + Bonus & Benefits Our client, a forward-thinking and globally connected staffing & consulting organization is seeking a skilled and driven Data Engineer to join their growing Data & Analytics team. Based in the City of London, this role presents a … a data engineering or similar technical role Hands-on experience with key Microsoft Azure services: Azure Data Factory Azure Synapse Analytics Azure Data Lake Storage Azure SQL Database Solid understanding of data modeling, ETL/ELT, and warehousing concepts Proficiency in SQL and one or more programming languages (e.g., Python, Scala … with software testing methodologies and development team collaboration Experience working with Power BI and DAX Strong documentation, communication, and stakeholder engagement skills Preferred Qualifications: Experience with Lakehouse architecture, Delta Lake, or Databricks Exposure to Agile/Scrum working practices Microsoft certifications (e.g., Azure Data Engineer Associate) Background in consulting or professional services Understanding of data More ❯

Principal Data Engineer - hyrbid (Leeds) - £70k-£80k Are you an experienced Azure Data Engineer looking to make an impact in an established financial insitution. We are seeking a hands-on professional to join a high-performing team tasked with building and enhancing a modern Azure data platform, with an expertise in Databricks. About the … architectural decisions, and support the migration of reporting services to Azure. Key Responsibilities: Design, build, and maintain ETL pipelines using Azure Data Factory , Azure Data Lake , Synapse , and Databricks . Design and build a greenfield Azure data platform to support business-critical data needs. Collaborate with stakeholders across the organization to … outputs. Opportunity to transition into a leadership role, supporting the development of junior team members. Key Skills & Experience: 5+ years of experience in Azure (ADF, Data Lake, Synapse). Strong SQL skills for data integration and reporting. Experience with Power BI for visualization and analytics. Familiarity with Python (preferred but not currently in use More ❯

a positive contribution to the world of banking and society. THE ROLE We are looking for a visionary and results-driven Head ofData & Analytics to lead our global data strategy, governance, andanalytics initiatives within the Corporate Global IT organization. This role iscritical in transforming data into actionable insights that drive businessperformance, innovation, and competitive advantage. You … into the core of our operations. Additionally, youwill oversee the ownership and evolution of enterprise budgeting andforecasting software, ensuring it supports strategic financial planning andintegrates seamlessly with broader data and analytics frameworks. OPPORTUNITIES You will Data Strategy & Leadership: Define and execute the enterprise-wide data and analytics strategy aligned with global business goals, offering … architecture, data warehousing, and modern analytics platforms (e.g., Snowflake, Power BI, Tableau, Databricks). Hands-on experience with Microsoft Data Factory, Azure Data Lake, and Microsoft Fabric. Strong knowledge of data governance, privacy regulations (e.g., GDPR), and data lifecycle management. Excellent communication and stakeholder management skills. Experience in change More ❯

As a Senior Data Engineer specializing in Natural Gas and Power, you will support the design, development, and optimization of advanced data infrastructure and products that support critical trading, risk, and market analytics functions. You will collaborate closely with traders, quantitative analysts, risk managers, and IT stakeholders to ensure data systems are scalable, secure … ETL/ELT frameworks and orchestration tools (e.g., Airflow, Azure Data Factory, Dagster). Proficient in cloud platforms (preferably Azure) and services such as Data Lake, Synapse, Event Hubs, and Functions. Authoring reports and dashboards with either open source or commercial products (e.g. PowerBI, Plot.ly, matplotlib) Programming OOP DevOps Web technologies HTTP/S REST … with time-series databases (e.g., InfluxDB, kdb+, TimescaleDB) and real-time data processing. Familiarity with distributed computing and data warehousing technologies (e.g., Spark, Snowflake, Delta Lake). Strong understanding of data governance, master data management, and data quality frameworks. Solid grasp of web technologies and APIs (REST, JSON, XML More ❯

Azure Data Engineer Up to £74,000 + Benefits International Law Firm – London (Hybrid) I’m working with a highly respected international law firm that’s looking for a skilled and proactive Azure Data Engineer to join their forward-thinking Data team. This role is a great fit for someone who thrives on solving … complex data challenges and wants to directly influence how a global legal business uses its data to make smarter decisions. As part of the Strategy, Transformation & Project Delivery function, you’ll be instrumental in designing, developing, and optimising the firm’s Azure-based data infrastructure, from building scalable data pipelines to ensuring … data integrity, security, and compliance. The Role Data Infrastructure Development – Build and maintain scalable Azure data pipelines (following Senior Data Architect designs) using tools such as Azure Data Factory and Tray.io. Implement and manage data lakes and warehouses (Azure Synapse, Azure Data Fabric, etc.). Integration More ❯

Are you a Data Engineer who would like to work with Microsoft Fabric supporting a companys digital transformation by … building robust and scalable data infrastructure? Our client will move from legacy to Microsoft Fabric with OneLake, Azure Data Factory and Azure Data Lake and you can be a key part of this move. THE OPPORTUNITY In this role of Data Engineer, youll ensure data is efficiently collected, transformed … and made available for analytics and decision-making across the business. To do this role, youll: Liaise with the business to understand data requirements and define data needs. Identify the data then design and maintain data pipelines using Microsoft Fabric (OneLake etc) and Azure Data Factory that integrate to other More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

Data Engineer Are you ready to shape the future of data engineering at a leading UK retailer? We're on the lookout for a talented Data Engineer to join a forward-thinking organisation as they embark on an exciting migration to Microsoft Fabric. This is your chance to be at the heart of a … major transformation, integrating multiple data systems into a scalable, unified platform and building a brand-new data warehouse to power smarter, faster reporting. With offices across the UK and a vibrant tech hub just outside Bristol, you'll collaborate closely with the Engineering Manager, fellow Engineers, and the wider IT team to unlock the full potential … PySpark Proven expertise in building data pipelines using Azure Data Factory or Fabric Pipelines Solid experience with Azure technologies like Lakehouse Architecture, Data Lake, Delta Lake, and Azure Synapse Strong command of SQL Excellent communication and collaboration skills What's in It for You: Up to £60,000 salary depending on experience More ❯

Data Architect (Lead and Principle) £90,000 to 130,000 GBP Bonus Onsite WORKING Location: Central London, Greater London - United Kingdom Type: Permanent Data Architect Location: UK-wide hybrid wit various levels of seniorirty Salary: £90,000 - £130,000 + bonus (DOE) Eligibility: Must have full UK right to work - no sponsorship offered Overview An exciting … opportunity for an experienced Data Architect to play a key role in shaping and delivering large-scale data platforms within public sector and public healthcare transformation programmes. This role blends hands-on data architecture, client-facing consultancy, and technical leadership within agile delivery teams. You'll lead on data strategy, data … in ambiguous or fast-changing environments. Desirable Experience Experience defining enterprise-level data architecture or operating at a solution/portfolio level. Knowledge of data lake ecosystems , information handling models, and capacity planning. Experience establishing or maturing data governance and stewardship frameworks. Familiarity with public cloud platforms (e.g. Azure, AWS, GCP) and data More ❯

Embark on a transformative journey with Barclays as a Data Security Lead to play a pivotal role in building and maintaining the secure systems that collect, store, process, and analyse data across our organisation. This includes safeguarding data pipelines, data warehouses, and data lakes-ensuring all information is accurate, accessible … and, above all, secure. As a Data Security Lead, you will collaborate with cross-functional teams to embed security by design into our data infrastructure, enabling advanced analytics and data science use cases-including AI and Machine Learning-without compromising on compliance or control. To be successful as a Data Security Lead … you should have experience with: Proven architecture and control design experience in a data security or cybersecurity context. Strong background as a Cloud technologist with hands-on experience in data science platforms and AI/ML use cases. Demonstrated expertise in implementing security by design principles and conducting threat modelling and translating this into designs mitigations More ❯

health. EIT fosters a culture of collaboration, innovation, and resilience, valuing diverse expertise to drive sustainable solutions to humanity's enduring challenges. We are looking for a Senior Data Engineer to join the EIT Pathogen Program and play a key role in designing, implementing, and supporting the cloud-based data platform that underpins our mission. This … role offers the opportunity to shape the future of pathogen monitoring and diagnostics by building scalable, secure, and high-performance data pipelines. You'll work closely with cross-functional teams, including data architects, platform engineers, and product teams, to deliver the data infrastructure that powers advanced analytics and AI-driven solutions for global health … impact. Key Responsibilities: Ensure data in the platform is acquired, processed, curated, and made accessible to scientists, digital analytics products, bioinformatics, and AI at a high standard of quality and availability Ensure data access adheres to FAIR principles (Findable, Accessible, Interoperable, and Re-usable) Ensure data is secured and compliant with regulatory, legal, and More ❯

is investing heavily in data as it digitises operations across its risk, product, and customer intelligence teams. They're building a modern Lakehouse architecture using Databricks, Delta Lake, and Azure Data Lake. You'll be part of a collaborative, forward-thinking team with a focus on best practices, automation, and end-to-end data … enabling analytics and machine learning at scale, using best-in-class tools across the Azure stack. Your responsibilities will include: Designing and deploying ETL pipelines using PySpark and Delta Lake on Databricks. Supporting the deployment and operationalisation of ML models with MLflow and Databricks Workflows. Building out reusable data products and feature stores for data … native tools. Collaborating with data scientists, analysts, and product teams to improve data usability and performance. KEY SKILLS AND REQUIREMENTS Advanced experience with Databricks , Delta Lake , and PySpark . Strong background in data engineering and distributed processing . Hands-on knowledge of Azure Data Lake , Data Factory , or More ❯

Data Architect – Azure/Enterprise Data Strategy We’re working with a prestigious international law and professional services firm, looking for an experienced Data Architect to take full ownership of their enterprise data strategy. This is a high-impact role, shaping the way data is governed, modelled, and leveraged across … a complex, global business. You’ll set the standards, patterns, and principles for all data-related initiatives, ensuring alignment with business goals while enabling advanced analytics, BI, and emerging technologies such as AI and machine learning. Working closely with IT, security, compliance, and business stakeholders, you’ll translate strategy into practical roadmaps and architect solutions that deliver real … Data Architect , ideally in a law firm or professional services Deep knowledge of Azure-native data services , including: Azure Synapse Analytics Azure Data Lake Gen2 Azure Data Factory (ETL/ELT) Azure Databricks Azure Purview (data governance) Microsoft Fabric Hands-on expertise in data modelling (conceptual, logical More ❯

Data Engineer (MS/Azure) - Near Edinburgh (Hybrid) Lorien's long-standing, successful (and growing) client, with offices very commutable from Central Edinburgh and the surrounding, is looking to recruit a Data Engineer to join their technical function in a brand-new role for the firm. In return, you'll join a supportive organisation well versed … You'll Be Doing: Design and develop Data Solutions, Pipelines and ETL Processes using tools such as Azure Data Factory/Azure Data Lake/Azure SQL/SSIS and other relevant offerings Build and tailor Data Models and Data Warehouses Work with other Data personnel such … background as a Data Engineer with skills across as many of the following Microsoft tooling as possible including Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse Analytics, SQL Server/SSIS/T-SQL Background programming with Python and/or R Strong skills across Data Modelling, Warehousing and More ❯

Data Engineer (MS/Azure) - Near Edinburgh (Hybrid) Lorien's long-standing, successful (and growing) client, with offices very commutable from Central Edinburgh and the surrounding, is looking to recruit a Data Engineer to join their technical function in a brand-new role for the firm. In return, you'll join a supportive organisation well versed … You'll Be Doing: Design and develop Data Solutions, Pipelines and ETL Processes using tools such as Azure Data Factory/Azure Data Lake/Azure SQL/SSIS and other relevant offerings Build and tailor Data Models and Data Warehouses Work with other Data personnel such … background as a Data Engineer with skills across as many of the following Microsoft tooling as possible including Azure Data Factory, Azure Data Lake, Azure SQL, Azure Synapse Analytics, SQL Server/SSIS/T-SQL Background programming with Python and/or R Strong skills across Data Modelling, Warehousing and More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester(Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies)About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment.About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone passionate … in an agile team.Experience working in a highly regulated industry and with highly sensitive data.Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks.Experience in data science using R, Stata, or Python.Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket.Understanding of clinical trials, GCP, and GxP.What We Offer More ❯

Senior Data Engineer, Databricks (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Knowledge of the finance sector or energy sector is an advantage. Expanding SaaS product company are looking for a … number of Data Engineers as they continue to grow. In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Databricks Data Engineer (Mid Level roles also available), £50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. … In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Senior Databricks Data Engineer (Mid Level roles also available), £ 50000 - 65000 + benefits. SQL Performance Tuning, Databricks. Home Based with one day a month at the office in Nottingham. Strong commercial knowledge of Databricks is required for this role. Expanding SaaS product company are looking for a number of Data Engineer as they continue to grow. … In these hands-on roles you will be part of the team responsible for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data … the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL (SQL Performance Tuning) and ETL Experience of data warehousing and data lake solutions. Experience working in an Agile environment. This is an excellent opportunity to join a company as it continues to grow and expand its data team. In More ❯

Principal Data Engineer - Data Platforms/Data Lakes/Cloud/Python - 6-Month Contract - £625 p/d Inside IR35 - London A global digital media organisation are looking for a Principal Software Engineer to join their Data Foundation & Product Analytics team on an initial 12-month contract. This role sits at … the forefront of enterprise data strategy, engineering, and platform governance - and will be instrumental in shaping the next generation of data infrastructure … within the business. This is a hybrid role (London-based) with flexibility in a fast-paced, multi-cloud, multiplatform environment. You will partner with the Enterprise Data Lake and Governance teams, architecting robust data pipelines and platforms across cloud and on-prem ecosystems, whilst establishing and enforcing standards for data modelling, ensuring consistency More ❯

Lead Data Engineer, £ 70000 - 80000 + benefits. SQL, ETL, Data Warehousing, Databricks etc. Home Based with one day a month at the office in Nottingham. Expanding SaaS product company are looking for a Lead Data Engineer as they continue to grow. In this hands-on role you will be part of the team responsible … for designing, creating, deploying and managing the companies data assets and you will guide and influence other members of the data engineering team with the ultimate goal of writing excellent quality, clean and high performant code. Responsibilities include - Work with the Data Architects to determine technical delivery and functionality. Design data solutions … technical solutions. Excellent knowledge of the SDLC, including testing and delivery in an agile environment. Excellent knowledge of SQL. Experience of data warehousing and data lake solutions. Good knowledge of ETL processes and tools. Knowledge of databricks. This is an excellent opportunity to join a company as it continues to grow and expand its data More ❯

Data Engineer - Leading Pharmaceutical Company - Manchester (Tech Stack: Data Engineer, Databricks, Python, Power BI, Azure, TSQL, ETL, Agile Methodologies) About the Role: We are seeking a talented and experienced Data Engineer on behalf of our client, a leading Software House. This is a fully remote position, offering the opportunity to work with cutting-edge … technologies and contribute to exciting projects in a collaborative environment. About the Role: Our client is seeking an experienced Data Engineer to join their team in Manchester. This hybrid position involves working within the pharmaceutical industry, focusing on the design, development, and maintenance of data pipelines, ETL processes, and databases. The role is ideal for someone … agile team. Experience working in a highly regulated industry and with highly sensitive data. Exposure to large data solutions like Snowflake, Trino, Synapse, Azure Data Lake, and Databricks. Experience in data science using R, Stata, or Python. Familiarity with Atlassian tools such as JIRA, Confluence, and BitBucket. Understanding of clinical trials, GCP, and More ❯

Our Principal Data Engineers are responsible for leading and delivering strategically significant, complex client engagements across our portfolio of clients. We believe that great delivery stems from a thorough understanding of our clients and their needs, strong discipline skills and subject matter expertise, excellent leadership and a clear vision of lasting and effective change in a public sector … environment. We expect our Principal Data Engineers to bring all of that and enthuse our delivery teams with the same passion. The successful candidate will lead the Data Engineering aspects of our client engagements while overseeing the wider delivery within the account (or industry) when appropriate. They will coach and develop team members on their engagements … capability or function Combining data science, analytics and engineering Strong understanding of various architectures including data warehouses, data lakes, data lake houses and data mesh Strong understanding of best practice DataOps and MLOps Up-to-date understanding of various data engineering technologies including Apache Spark, Databricks More ❯

Data Engineer (one day a week in the central London office) Sports Analytics This role is a unique opportunity for a Data Engineer to combine technical challenges with creativity in a collaborative, high-standard work environment. By joining this team, youll not only be part of a creative and open work culture focused on innovation and … it an ideal setting for those passionate about leveraging cutting-edge technology to make meaningful contributions in the world of sports analytics. Key responsibilities for the role of Data Engineer include: Design, construct, install, test, and maintain highly scalable data management systems. Ensure systems meet requirements and industry practices for data quality and integrity. … workflows with Composer or Vertex Pipelines. Data Architecture & Modelling: Ability to translate diverse business requirements into scalable data models and architect a data lake/lakehouse environment on GCP. Engineering Best Practices: Proficiency with Git, CI/CD for data systems, and robust testing methodologies. Highly desirable skills include: Domain Experience More ❯

About the Role We are seeking an enthusiastic and detail-oriented Data Analyst on a 12 month contract to join our energetic Data Team within a successful Financial Services business. This is a pivotal role in shaping the digital future of our organisation. You will work closely with business users and take ownership of mining, organising … and analysing data from both existing and new sources to support strategic planning and decision-making. Working closely with a small team of UK-based Data Analysts and IT experts (both in-house and from our central functions in Germany). Your work will directly influence business operations, customer experience, and innovation across departments. This role … Team in Germany to resolve cross-border data issues. Explore and apply new data sources and techniques to enhance our data lake and analytics capabilities. Promote the use of data-driven insights across departments. What we're looking for: Required: Education & Experience: Degree in Computer Science or equivalent professional More ❯