126 to 150 of 462 Data Lake Jobs in the UK

engineering, governance, and performance optimisation. Key Responsibilities Lead the architecture and design of a next-gen data platform using Databricks and Delta Lake Collaborate with stakeholders including data engineers, analysts, and business leads to define data requirements and architecture patterns Ensure the platform … Champion best practices in data quality, lineage, governance , and performance tuning Integrate with a wider Azure ecosystem (e.g. Azure Data Lake, Synapse, Power BI) Required Skills & Experience Proven experience as a Data Architect in enterprise environments Extensive hands-on experience with Databricks (including … SQL, PySpark, Delta Lake) Solid background in data warehousing , data lakes , and big data frameworks Strong knowledge of Azure cloud services , especially in data integration Experience working in regulated environments (e.g. financial services, insurance, banking) Excellent communication skills, capable of engaging More ❯

We are looking for a Data Engineer to join our growing data engineering team at Our Future Health. The Data Engineer will bring an in-depth knowledge of NHS data and data solutions to help solve some of the key … challenges around a programme of work at industrial scale with global significance. Our data engineers work with our participant data (including various health records from the NHS, genetic data, Our Future Health's own questionnaires) and build pipelines and systems to process it, control … quality and create data releases for researchers. You'll take a lead on developing specific pipelines related to questionnaire and physical measurements data. Our Future Health will be the UK's largest ever health research programme, bringing people together to develop new ways to detect, prevent, and treat More ❯

Were looking for a Data Architect to join our architecture chapter here at N Brown Group! What will you do as a Data Architect at N Brown? Designing solutions to meet customer needs. This will be end to end and take advantage of key frameworks that … and demonstrable data architecture experience, preferably in designing and implementing cloud-native analytics/data platforms (including data lake/warehouse) technology through all data lifecycle stages Excellent conceptual and logical data modelling and database design experience, including industry … workflows and data needs Appreciation of the modern cloud data stack, headless BI, analytics engineering, data meshes and lake-houses Knowledge of Data Governance Whats in it for you? Hybrid working 24 days holiday (+ 8 bank holidays) with the option More ❯

team within our Actuarial Public business unit, focused on the design and delivery of platforms and processes that enable the effective use of data by the wider consulting business. Our firm invests in the very latest technologies to facilitate the delivery of our ground-breaking business solutions. Our … disciplinary team where you will be able to showcase your abilities in software development as we tackle our ambition of building a modern data platform. You will play an influential role and contribute to the company's wider data strategy. Your initial focus will be on … Fabric or its related technologies: Azure Databricks Azure Synapse Analytics Azure DW Azure SQL DB Azure Data Factory Azure Data Lake Familiarity with continuous integration, continuous delivery, agile methodologies, and Azure DevOps. Familiarity with optimizing strategies, pipeline architectures, data sets, and ETL/ More ❯

Introduction to Azure Data Lake Storage (ADLS) Azure Data Lake Storage (ADLS) is a key component in the Azure ecosystem that provides scalable storage for big data analytics. Data Transformation & Modeling One essential aspect of working with data in ADLS is the transformation and modeling process. Companies can leverage Azure Data Factory or Databricks, using languages like PySpark and Scala , to create efficient data processing and transformation workflows. These workflows are designed to handle both batch and streaming data seamlessly. … Furthermore, organizations can develop robust data models within the ADLS environment to optimize their analytics and insights generation. More ❯

You will need to login before you can apply for a job. Senior Data Engineer, 3PX Private Pricing - Analytics & Insights Sector: Data Science Role: Senior Executive Contract Type: Permanent Hours: Full Time DESCRIPTION Amazon Web Services (AWS) is a dynamic and rapidly growing business within Amazon … Private Pricing Analytics and Insights (PPA&I) team owns building scalable analytical solutions that enable the GDSP organization with actionable insights to make data-driven decisions. This role will focus on Data Engineering, and Analytics related to the Private Pricing Program, requiring deep technical skills, strong … business acumen and a deep analytical background to provide actionable data-driven insights and decision support. As a Senior Data Engineer on this team, you will drive efficiency in data handling processes; build and maintain data pipelines and associated infrastructure; partner with More ❯

to maximise on the power of its data. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing and peer review of ETL … code in Oracle ODI Working with business users to design and configure self-serve data environments within our snowflake data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing … and business partners. This could be data transfer from third parties, ETL into the data warehouse or data lake, providing insights and metrics, or improving performance or processes. This is a dynamic team, with data engineers and analysts working closely alongside More ❯

Data Engineer – Contract | London (Hybrid) Daily Rate: £240 Location: London | Hybrid (2–3 days onsite) Initial Duration: 6 months (with potential for extension) Are you a data-driven professional with a passion for building scalable, high-impact data solutions? This is a fantastic opportunity … to join a global leader in financial education and play a key role in shaping data initiatives that support thousands of professionals around the world. About the Company Our client is a global leader in financial learning and professional development. Their solutions empower financial services professionals across areas … working knowledge of cloud-based data solutions Nice to Have: Experience with graph databases, Hadoop/Spark, or enterprise data lake environments What You’ll Bring Strong foundation in computer science principles (data structures, algorithms, etc.) Experience building enterprise-grade pipelines and data More ❯

Data Engineer – Contract | London (Hybrid) Daily Rate: £240 Location: London | Hybrid (2–3 days onsite) Initial Duration: 6 months (with potential for extension) Are you a data-driven professional with a passion for building scalable, high-impact data solutions? This is a fantastic opportunity … to join a global leader in financial education and play a key role in shaping data initiatives that support thousands of professionals around the world. About the Company Our client is a global leader in financial learning and professional development. Their solutions empower financial services professionals across areas … working knowledge of cloud-based data solutions Nice to Have: Experience with graph databases, Hadoop/Spark, or enterprise data lake environments What You’ll Bring Strong foundation in computer science principles (data structures, algorithms, etc.) Experience building enterprise-grade pipelines and data More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both … technical teams and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data … based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of a modern data platform for a leading specialty insurance firm in London. This role requires a strong technical background in integration and data architectures , as well as leadership experience managing both … technical teams and client relationships. You will be responsible for the design, governance, automation, and operation of the enterprise data platform , ensuring its capabilities align with business needs. The platform is built on Azure, Snowflake, Data Lakes, and Kafka , requiring expertise across security, data … based role , as regular on-site client engagement is required. The position will be hired by Marionete , a leader in delivering cutting-edge data and technology solutions. Key Responsibilities Architect and lead the design of an enterprise-grade data platform, ensuring scalability, security, and performance . More ❯

Information Security. The role: This role sits within the Group Enterprise Systems (GES) Technology team. The right candidate would be an experienced Microsoft data warehouse developer (SQL Server, SSIS, SSAS) who can work both independently and as a member of a team to deliver enterprise-class data … platforms. This role will primarily involve working on Actuarial Reserving systems change initiatives and Production support. What you'll be doing as a Data Warehouse Developer: Work closely with internal and external delivery teams, external vendors, infrastructure, and 3rd party application teams to uphold and evolve common standards. … of Agile principles. Demonstrable experience in mentoring or supporting the development of team members. Azure SQL DB, Data Factory, Data Lake, Logic apps, Data Bricks (Spark SQL) and/or Snowflake experience is advantageous. More ❯

Head of Data Management Our trusted partner is hiring a Head of Data Management to lead the data architectural strategy as our client moves from legacy on-premise data into a cloud-first data approach . To be considered, you … LTIP + Share Options to be based in Chatham or Wolverhampton on a hybrid basis. Role and Responsibilities: Define and maintain the target data architecture and road map (including the build-out of enterprise data platforms and increased use of cloud technologies) Work with senior stakeholders … historty in moving data from on prem to cloud within a regulated environemnt, handling multiple moving parts creating a data lake/lakehouse pattern is a must have. Recent exposure to modern data architectures using Azure Databricks, Synapse, ER studio etc, is a More ❯

Job Title: BI Developer Job Summary: We are seeking a talented and experienced BI Developer to join our growing data analytics team. In this role, you will be responsible for designing, developing, implementing, and maintaining robust Business Intelligence solutions using Microsoft Power BI. You will work closely with … business stakeholders, data engineers, and analysts to understand requirements, transform data, and create insightful reports and dashboards that empower data-driven decision-making across the organization. Key Responsibilities: Collaborate with business users and stakeholders to gather, analyse, and document reporting requirements. Connect to various … . Knowledge of Azure data services (e.g., Azure Data Factory, Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage). Microsoft Certification (e.g., PL-300: Microsoft Power BI Data Analyst). Experience with other BI tools (e.g., Tableau, Qlik). More ❯

understand business requirements and designing integration solutions to connect Dynamics 365 Finance and Operations with other systems such as ProjOps, Dataverse, Data Lake, Synapse, Enterprise Data Warehouse (EDW), or third-party applications. Development: Writing code and developing custom solutions using relevant programming languages and technologies … such as X++, C#, SQL, XML, JSON) to create seamless data flow and functionality between different systems. API Development: Utilizing APIs (Application Programming Interfaces) provided by Dynamics 365 Finance and Operations and other systems to facilitate data exchange and communication between them. Data Mapping … including solutions. T-SQL development skills Cloud Integration specialisms familiar with the range of Azure integration technologies Functions Logic App Azure Data Lake Azure Synapse Azure DevOps Experience in developing solutions within Power platform (Power Apps, Power automate), Dataverse Experience of integration work with payroll/HR More ❯

Our Commodities and Global Markets data analytics team within technology is building a leading data and analytics platform. We partner and build batch and real-time analytics solutions for traders, quants, desk analysts, and central data teams across the business. At Macquarie, our advantage … friendly and supportive team where everyone - no matter what role - contributes ideas and drives outcomes. What role will you play? As a Senior Data Engineer, you will work with traders, quants, desk analysts, and central data teams to provide data and analytics solutions across … data science workbench, visualisation tools, and real-time analytics. Your role will involve working with our public-cloud-based data lake, data pipelines for internal operational and external fundamental and alternative market data. What you offer Experience with AWS cloud. Experience programming, debugging More ❯

We are Dufrain, a pure-play data consultancy specialising in helping businesses unlock the true value of their data by providing market-leading data solutions and services which includes developing strategies for AI readiness, improving data literacy and culture, enhancing real-time … reporting, and managing data from mergers and acquisitions. At Dufrain, we pride ourselves on a creative and innovative approach, focusing on delivering exceptional outcomes for clients by leveraging data to drive growth and efficiency. Our mission is to inspire, shape and deliver the data capabilities of tomorrow. We have great opportunities for Data Engineers to play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy. Our Data Engineers Possess a broad range of data engineering skills More ❯

best self. Join our team and play a pivotal role in shaping the future of our betting trading technology landscape. The Team The Data Team is responsible for taking the wealth of data that Smarkets generates and using it to drive insights which improve the business. … Since Smarkets produces a huge amount of data - including sports event data, payments information, order flow and user analytics - there are many opportunities for the team to add real business value. The team's responsibilities currently span across three different areas: Data Engineering: development … understand and drive business direction. Data components can also be user facing e.g. sending notifications to users; Ensuring our data lake is kept in a healthy state, particularly our data warehouses: Redshift and Bigquery; Developing and maintaining Flask services and Postgres databases within More ❯

We're currently seeking a highly skilled and experienced Principal Data Engineer to join our team as a key technical authority and thought leader for our Data Platform and Engineering team. You'll be responsible for driving the improvement of technical delivery quality, guiding solution development … wide range of applications and technologies. You'll address complex and far-reaching technical issues within the domain. If you're passionate about data engineering and possess the expertise to make a significant impact, we'd love to hear from you. At AXA we work smart, empowering our … experience providing technical leadership in a product team or domain. Expert fundamentals in multiple technologies and frameworks required such as Azure Data Lake, Azure Data Factory, Event Hubs, Databricks, PowerBI, DevOps, GIT, SQL, Python and PySpark. Excellent knowledge of development lifecycles. Ability to lead and More ❯

Join IFS. Job Description Are you ready to make waves in the world of AI? We're on the hunt for a Principal Data Engineer to join our dynamic global R&D organization. We're looking for someone who brings the heat, fosters seamless collaboration, and is always … Field Service Management. Get ready to tackle high-stakes challenges like IIoT, predictive maintenance, forecasting, anomaly detection, optimization, and unleashing generative AI. Your data engineer wizardry will power our solutions, crafting efficient data pipelines, expanding our data platform capabilities, and pushing the envelope of … data-driven innovation across our product lineup. Your sharp critical thinking and knack for real-world business dilemmas will be instrumental in orchestrating end-to-end solutions. From spotting opportunities on the horizon to delivering high-performance, scalable data solutions, you'll play a pivotal role More ❯

Delivery Consultant - Data Analytics, Professional Services Global Competency Center The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS … equivalent experience Experience in cloud architecture for Data Analytics platform and implementation, with experience in hands-on implementation with Data lake and Data Warehouse. Experience in developing software code using one or more programming languages/frameworks such as Python, Spark, SQL, etc. … Experience leading large-scale full-cycle MPP enterprise Data Warehousing (EDW), Data Lake and Analytics projects PREFERRED QUALIFICATIONS AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation) AWS Professional level certifications (e.g., Solutions Architect More ❯

Delivery Consultant - Data Analytics, Professional Services Global Competency Center The Amazon Web Services Professional Services (ProServe) team is seeking a skilled Delivery Consultant to join our team at Amazon Web Services (AWS). In this role, you'll work closely with customers to design, implement, and manage AWS … Engineering, related field, or equivalent experience Experience with data analytics IT platform implementation with hands-on implementation experience with data lake and data warehouse. Hands-on experience developing software code in one or more programming languages/frameworks such as Python, Spark, SQL … etc. Hands-on experience leading large-scale full-cycle MPP enterprise data warehousing (EDW), data lake and analytics projects PREFERRED QUALIFICATIONS AWS experience preferred, with proficiency in a wide range of AWS services (e.g., EC2, S3, RDS, Lambda, IAM, VPC, CloudFormation) AWS Professional level certifications More ❯

Data Engineer (Databricks & Azure) - Clean Energy Location: South East England (Hybrid - 1 day onsite per week) Salary: £60k - £70k + benefits package 18 months. That’s all the time it took for the client’s Databricks platform to evolve into a key driver of innovative green technologies. Now … the Databricks platform that powers the client’s data services. You’ll work on building robust pipelines using Azure Data Lake and Python while collaborating closely with data scientists, simulation engineers, and the wider business. Reporting to the Head of Data … of Databricks experience , with a strong background in managing and maintaining data services on the platform. Expertise in Azure Data Lake , Python , and CI/CD pipelines using Azure DevOps. Practical experience in industries like manufacturing , product development , or automotive , with a focus on real More ❯

Data Insight Analyst - Consumer & Audience -London office hybrid - 3 days per week - Salary negotiable dep on experience up to £60,000 - J12932 Please note this client is unable to offer sponsorship so please ensure you have full UK working rights. Datatech are working exclusively with a boutique start … up in London, staffed across the UK, US and Canada, to grow their team. This leading consumer behavioural data organisation are servicing some of the largest brands and media companies worldwide and have been working for the last 6 + years adding value to their clients. This company … success. In this role, you will be responsible for data collection, analysis and interpretation of a vast and rich data lake of consumer behavioural data to provide actionable insights and recommendations regarding marketing campaigns, sales opportunities and brand perception. The role…. • Gather More ❯

Data Insight Analyst - Consumer & Audience -London office hybrid - 3 days per week - Salary negotiable dep on experience up to £60,000 - J12932 Please note this client is unable to offer sponsorship so please ensure you have full UK working rights. Datatech are working exclusively with a boutique start … up in London, staffed across the UK, US and Canada, to grow their team. This leading consumer behavioural data organisation are servicing some of the largest brands and media companies worldwide and have been working for the last 6 + years adding value to their clients. This company … success. In this role, you will be responsible for data collection, analysis and interpretation of a vast and rich data lake of consumer behavioural data to provide actionable insights and recommendations regarding marketing campaigns, sales opportunities and brand perception. The role…. • Gather More ❯