1 to 25 of 1,118 Data Lake Jobs in the UK

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating … data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating … data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments More ❯

Senior Data Engineer - London/Hertfordshire - Hybrid Are you a technically strong Azure Data Engineer looking to join a forward-thinking, innovative company? Here's your chance to work with a leading construction and infrastructure company who foster a culture of collaboration, support, and strong communication. You'll be responsible for ensuring seamless integration and optimization … of diverse business data streams - from CRM, finance, procurement to fleet and commercial data - enabling reliable, high-quality data for analytics and business insights. While this role won't be client-facing, strong communication and collaboration skills within their agile team are essential. Requirements: Experience orchestrating … data pipelines with Azure Data Factory (ADF) Proficiency managing API data ingestion and orchestration using Azure Databricks Working with Azure Data Lake (ADL) Storage, on-prem SQL, and Python Vast Azure data engineering experience Proficient in ADF, Databricks, ADL, SQL, Python Desirable: Exposure to D365 or similar CRM environments More ❯

ESG Data Manager Whitehall Resources require an ESG Data Manager to work with a key client on an initial 12 month contract. *This role will involve on site work in Cambridge 2 days per week. *Inside IR35. ESG Data Manager 1. Position Overview: Sustainability strategy and regulatory landscape requires high-quality ESG data. We … Collection & Tooling . Map ~100 existing ESG metrics and create scalable templates for new ones. . Shape and oversee the build of an ESG data lake, APIs and connectors into Workiva & Carbon platform. . Drive automation of manual data feeds (eg, HR, Supply-chain, Facilities). System Integration Roadmap . Produce and maintain … ERP, with costings and resourcing. . Governance & Control Framework - policies, RACIs and control testing scripts ready for external assurance. . Pilot "Single Source of Truth" ESG Data Lake - ingesting priority metrics (Scope 1, 2 GHG, DEI) with automated validations. . Regulatory Disclosure Pack - Workiva-generated report satisfying FY25 reporting cycle. 4. Skills & Experience Must-have . 6+ More ❯

AWS Data Engineer - IT Consultancy - Leeds - Hybrid Are you a data engineer with a passion for AWS and solving real-world business problems? I am working with a fast-growing IT consultancy based in Leeds that's delivering cutting-edge cloud and data solutions to clients across the UK. They're looking for their … next AWS Data Engineer to join the team. As an AWS Data Engineer, you'll be working on a variety of client projects, helping to design, build, and optimise scalable data pipelines and cloud-native architectures. You'll collaborate with cross-functional teams to deliver high-impact solutions that drive business value. Requirements: Experience … Python SQL & NoSQL databases CI/CD tools : GitHub Actions or CodePipeline Infrastructure as Code (Terraform is preferable) Experience building ETL/ELT pipelines Familiarity with data lake and data warehouse concepts Excellent communication and stakeholder engagement skills Benefits: Hybrid working (one day per week in Leeds office) Clear career progression in a growing consultancy More ❯

Delivery Consultant - Data Analytics, AWS Professional Services Are you a Data Analytics specialist? Do you have Real-time Data Analytics, Data Warehousing, Big Data, Modern Data Strategy, Data Lake and Data engineering experience? Do you like to solve the most complex and high scale (billions+ records) data challenges in the world today? Do you … learn and use services such as AWS Glue, Amazon S3, Amazon DynamoDB, Amazon Relational Database Service (RDS), Amazon Elastic Map Reduce (EMR), Amazon Kinesis, Amazon Redshift, Amazon Athena, AWS Lake Formation, Amazon DataZone, Amazon SageMaker and Amazon Quicksight. Solutions - Deliver technical engagements with partners and customers. This includes participating in pre-sales visits, understanding customer requirements, creating consulting proposals More ❯

We are seeking a Platform Technical Lead to spearhead the architecture, implementation, and evolution of amodern data platformfor a leadingspecialty insurance firmin London. This role requires astrong technical backgroundinintegration and data architectures, as well asleadership experiencemanaging both technical teams and client relationships. You will be responsible for thedesign, governance, automation, and operationof theenterprise data platform, ensuring its capabilities align with business needs. The platform is built onAzure, Snowflake, Data Lakes, and Kafka, requiring expertise acrosssecurity, data governance, integrations, observability, DevOps, and automation. This is a London-based role, as regular on-site client engagement is required. The position will behired by Marionete, a leader in delivering cutting-edge … data and technology solutions. Key Responsibilities Architect and leadthe design of an enterprise-grade data platform, ensuringscalability, security, and performance. Providetechnical leadershipacrossdata integration, data modeling, security, governance, and automation, covering all layers of a data platform (ingestion, storage, processing, and consumption). Drive the implementation ofmodern platform architecturessuch asLakehouse, Kappa, and Lambda More ❯

by partnering with AWS. You will educate customers on "art of the possible" success stories and AWS enablers including our data warehousing (Amazon Redshift), data lake (Amazon Lake Formation), BigData processing (Amazon EMR), search (Amazon Open Search Service), ETL (Amazon Glue), streaming (Amazon Kinesis and Amazon Managed Kafka), and Sagemaker Unified Studio brining these … key deals, supporting partners, as well as providing key insights and analysis for their analytics business all up to key stakeholders in EMEA and Corp. Our EU North Data and GenAI team are passionate about our customers, passionate about our domain and foster a supportive, work hard & play hard team culture, all with a big heart. BASIC QUALIFICATIONS … development, sales or alliances management experience PREFERRED QUALIFICATIONS PREFERRED QUALIFICATIONS - 5+ years of building profitable partner ecosystems experience - Experience developing detailed go to market plans - Experience across the Data and Analytics specialty Amazon is an equal opportunities employer. We believe passionately that employing a diverse workforce is central to our success. We make recruiting decisions based on your More ❯

Milan, Edinburgh and Madrid. With our focus on growth in the UK and Europe, now is the perfect time to join us on this high-speed journey. Introducing Data Engineering at Trainline At the heart of our Data Team, Data Engineers play a pivotal role by creating pipelines and tables that power impactful dashboards … enable self-service via SQL, and support innovative machine learning models and real-time data products. As a Data Engineer, you will be involved in engineering pipelines that will drive key decisions and give data science powerful datasets to enable and drive new business insights. Data Engineers work alongside Machine learning engineers … warehouses in the cloud) Work with Infrastructure as code (Terraform) and containerising applications (Docker) Work with AWS, S3, SQS, Iceberg, Parquet, Glue and EMR for our Data Lake Experience developing CI/CD pipelines More information: Enjoy fantastic perks like private healthcare & dental insurance, a generous work from abroad policy, 2-for-1 share purchase plans, an More ❯

Operations The Amazon ARTS (APEX-RoW Technology Solutions) team is looking for a Business Intelligence Engineer to optimize in one of the world's largest and most complex data warehouse environments. You are expected being passionate about working with huge database and someone who loves to bring datasets together to create dashboards and business reports. You are required … to have deep expertise in creation and management of datasets and optimization of database. You should be expert at implementing and operating stable, scalable data flow solutions from production systems into end-user facing applications/reports. You are required to have excellent business and communication skills to be able to work with business stakeholders to develop business … help business stakeholders to provide data pipeline solutions with Amazon/ARTS internal tech products and AWS services (e.g. Redshift, SageMaker, EMR, ETL tools, data lake); 3) develop scripts for maintenance automation; 4) execute the tech implementation with a clear milestone planning and lead it to smooth launch; 5) help business stakeholders ramp up with More ❯

Imagine being part of a team where your data analysis skills can impact millions of consumers worldwide. In Fulfillment by Amazon (FBA), you will help third-party businesses (our Selling Partners) leverage the robust data and analytics capabilities that Amazon has built over the last 25 years. FBA enables these sellers to offload the heavy lifting … to customers in 185 countries using FBA, generating over 3 billion units served in the EU last year alone. In this role, you will use your expertise in data engineering, business analytics, and problem-solving to provide critical insights that drive the success of the FBA program and our selling partners. Are you passionate about driving customer success … root causes of SX issues. Key job responsibilities In a typical day, as a Support Engineer, you will: • Trace Seller specific defects across upstream systems and data lake to detect, investigate, and fix the root causes (e.g., algorithmic bottlenecks, data quality issues, software flaws). • Develop the tools for the efficient Seller coaching. • Assess the More ❯

AI tools (e.g., Google Cloud, Azure). Familiarity with natural language processing or AI technologies (e.g., LLMs such as ChatGPT or BARD, Embeddings, Prompt Engineering). Experience with data pipelines and preferably processing of documents (e.g., using Google Cloud Fusion/Azure Data Factory). Demonstrated success in deploying AI solutions in real-world applications. Work … closely with product managers, data scientists, software engineers, and other stakeholders to integrate AI solutions into existing and new products. Stay abreast of the latest AI research, trends, and technologies, and apply this knowledge to drive continuous improvement and innovation within the team. Strong background in either Python/Typescript. Operational experience taking internal products and ensuring they … Obfuscation, etc. Knowledge of Azure Data Factory/GCP Cloud Data Fusion, Microsoft Azure Machine Learning or GCP Cloud ML Engine, Azure Data Lake, Azure Databricks or GCP Cloud Dataproc. Experience scaling an "API-Ecosystem", designing, and implementing "API-First" integration patterns. Experience working with authentication and authorization protocols/patterns. Experience with More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity More ❯

Data Solution Architect - Circa £110K - Hybrid working from London An established organisation is seeking a delivery-focused Data Solutions Architect to provide architectural leadership and guidance in the development of enterprise data solutions. The role involves contributing to strategic data initiatives such as enterprise data lakes, governance platforms, and asset … data programmes. The successful candidate will work closely with cross-functional teams including security, infrastructure, and enterprise architecture to ensure consistency and alignment across the data landscape. Key Responsibilities Data Design: Lead enterprise data design efforts. Support data modelling and recommend best practices and tools to meet business and technical … objectives. Establish standards for modelling methodologies. Solution Architecture: Provide architectural expertise for evaluating and recommending scalable data solutions. Ensure design patterns support both transactional performance and analytics needs. Support for Digital Programmes: Collaborate with stakeholders to define and document data requirements. Evaluate technology options for strategic fit and ensure successful implementation. Work closely with engineering teams More ❯

Summary of the Role's Main Purpose An established organisation is seeking a delivery-focused Data Solutions Architect to provide architectural leadership and guidance in the development of enterprise data solutions. The role involves contributing to strategic data initiatives such as enterprise data lakes, governance platforms, and asset data programmes. … The successful candidate will work closely with cross-functional teams including security, infrastructure, and enterprise architecture to ensure consistency and alignment across the data landscape. Key Responsibilities Data Design: Lead enterprise data design efforts. Support data modelling and recommend best practices and tools to meet business and technical objectives. Establish standards for … modelling methodologies. Solution Architecture: Provide architectural expertise for evaluating and recommending scalable data solutions. Ensure design patterns support both transactional performance and analytics needs. Support for Digital Programmes: Collaborate with stakeholders to define and document data requirements. Evaluate technology options for strategic fit and ensure successful implementation. Work closely with engineering teams to align on data More ❯

Data Engineer - Active SC + NPPV3 Clearance Up to £550 per day (Outside IR35) 3 months initially Primarily Remote (Must be UK-based) My client is a major International Consultancy who urgently require Senior Data Engineers with active (SC) Security and NPPV3 Clearance to work with an end client. Key Requirements: Commercial experience as a Senior … Data Engineer, with an active SC + NPPV3 Clearance Experience with Azure Data Factory for building and orchestrating data pipelines Experience with Databricks for Data transformation Experience with Azure Synapse Familiar with Azure Data Lake Active SC Clearance +NPPV3 Clearance Nice to have: Immediate availability Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of More ❯

Data Architect (18-Month Fixed Term Contract) Salary: £65,000 - £72,000 per annum + benefits Location: London/Hybrid Our client is underway with an exciting Transformation Programme and is looking to recruit an experienced Data Architect. The role is critical in helping to shape their future as a data-led organisation. The … Data Architect will be instrumental in building the foundational architecture, governance and strategy needed to bring that vision to life. Key Responsibilities Include Defining and owning the enterprise and commercial data strategy aligned with the digital transformation goals Establishing data governance policies, metadata standards, data stewardship roles, and classification models Designing scalable … strategy experience Expertise in data governance, data modelling, metadata management Strong understanding of Azure or Data Factory, Synapse & Data Lake Ability to translate complex data concepts into business-aligned strategies and actionable outcomes Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment More ❯

Operations is seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders … will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data Product Owner in Agile environments. Experience managing data products or platforms, ideally customer data platforms (CDPs), data warehouses (e.g. Snowflake, BigQuery), or data More ❯

expanding the existing mission critical ecosystem of Data and BI systems for analytics and decision making, using Primarily Data Warehouse/Mart, Data Lake, Self Service BI Tools and Data Science/ML platform using Oracle, Snowflake and AWS tech stack. Qualifications We are looking for a skilled Lead Data … pipeline/ELT development, including performance tuning Very good SQL skills Past experience and solid understanding of end to end Data Warehouse, Data Lake and BI design and delivery at scale (high level and detailed) and various architectural strategies Solid information architecture skills/experience: Data ingestions, and Data Warehouse and Date Lake modelling experience (Star Schema, Snowflake Schema, Data Vault etc.) Past hands-on development experience in at least one enterprise analytics database like Oracle/Terradata/SQL Server/Snowflake Understanding of AWS cloud and fundamental services like IAM, Lambda, S3 etc. Experience of liaising with both in-house and third More ❯

seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of Finance and data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between Finance business stakeholders, data scientists, analysts and engineers, you'll manage the Finance product backlog and ensure continuous delivery of capabilities that align with enterprise objectives. Acting as a liaison between stakeholders and the development team, you will … translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data Product Owner in Agile environments. Ideally experience managing Finance and data products or platforms, ideally data warehouses (e.g. Snowflake, BigQuery), or data lakes. Familiarity More ❯

Data Analyst- Active SC + NPPV3 Clearance 3 months initially £ Market rate (Outside IR35) Primarily Remote (Must be UK based) My client is a major International Consultancy who urgently require a Senior Data Analyst with an active SC and NPPV3 Clearance to work with an end client. Key Requirements: Commercial experience as a Senior Data … Factory for building and orchestrating data pipelines Experience with Databricks for Data transformation Experience with Azure Synapse Familiar with Azure Data Lake Active SC +NPPV3 Clearance Nice to have: Immediate availability What you need to do now If you're interested in this role, click 'apply now' to forward an up More ❯

DAY - IR35 TO BE DETERMINED - HYBRID ROLE IN CARDIFF SKILLS - Strong understanding of Azure Cloud. - Extensive experience in SQL and Python. - Desirable: Azure Databricks, Azure Synapse and Azure Data Factory. RESPONSIBILITIES - Strong API development understanding. - Hands-on experience with ETL tools and creating data pipelines. - Previous experience of connecting new systems to Data Lake. More ❯

build and maintain scalable infrastructure in Microsoft Azure. This role is focused on automating infrastructure provisioning, deploying containerized applications, and building a secure and efficient cloud data lake environment to support large-scale data ingestion, storage, and processing. Key Responsibilities: Design, implement, and maintain CI/CD pipelines using Azure DevOps. Manage and provision cloud … as Code). Deploy and manage Kubernetes clusters (AKS) and containerized workloads. Work with data engineering teams to design and implement a cloud-based data lake architecture on Azure. Automate data pipeline deployments and integrations using Azure services (e.g., Data Factory, Synapse, Databricks). Ensure high availability, scalability, and security across … Cloud Engineering roles. Strong proficiency with Terraform and managing IaC deployments. Experience managing Kubernetes (AKS preferred) in production environments. Experience designing or supporting a cloud-based data lake (Azure Data Lake Gen2, Blob Storage, etc.). Proficient in scripting languages such as PowerShell , Bash , or Python . Experience with CI/CD tools, especially More ❯

Operations is seeking an experienced Product Owner to become an integral part of our Agile development team. In this role, you'll drive the evolution and implementation of data products, ensuring high-quality, accessible, and trusted data that fuels analytics, machine learning, and personalised experiences. You will work cross-functionally to create data products … that empower teams across the business, from marketing to operations, and enable insight-driven decisions. Acting as the bridge between business stakeholders, data scientists, analysts, engineers, and governance teams, you'll manage the data product backlog and ensure continuous delivery of data capabilities that align with enterprise objectives. Acting as a liaison between stakeholders … will translate the product vision into a prioritised & actionable backlog that maximizes business value while ensuring to addresses customer needs. Qualifications Strong experience as a Product Owner or Data Product Owner in Agile environments. Experience managing data products or platforms, ideally customer data platforms (CDPs), data warehouses (e.g. Snowflake, BigQuery), or data More ❯

Hays are supporting a business based in Newport to recruit for a permanent Data Specialist to support a large-scale data transformation journey. The salary on offer is c£60k and the business offers flexible hybrid working, typically one day per week on site. The role will be a mix of hands-on engineering as well … as managing stakeholders, suppliers and strategic leadership. You'll support the centralisation and moderation of data infrastructure by working with a third party to deliver high-profile projects. You'll need good experience in a similar data engineer with some exposure to data governance & stakeholder management. Experience with Azure Synapse analytics and Azure Databricks … Data lakes is essential. Exposure with Python and SQL/PySpark is also important. In return you'll work on interesting projects and receive a competitive salary of c£60k depending on experience. You'll have the opportunity to work in flexible hybrid pattern going on site typically once or twice per week. What you need to do More ❯