226 to 250 of 326 Data Lake Jobs in the UK

Data Services Team offers a variety of data product with strong focus on engineering including data science, and data analytics to help our business users mainly trading teams to make data-driven decisions and improve their business operations. At Macquarie, our advantage is bringing together diverse people and empowering them … team where everyone - no matter what role - contributes ideas and drives outcomes. What role will you play? Press space or enter keys to toggle section visibility As a Data Platform Engineer, you will join our dynamic Engineering team developing cutting-edge data product solutions. You will build and maintain applications ranging from cloud infrastructure automation AWS … toggle section visibility A dynamic individual with a strong DevOps and Engineering background who loves to solve problems and build automation and CI/CD Pipelines in the data space and cloud infrastructure Proficient in writing infrastructure as code for public cloud Experience with Python coding/testing or any Cloud-based technology (AWS preferred) Good understanding of More ❯

authorized consultant, before you provide any personal details or other non-public information. If in doubt, please write to to seek clarification or report any abuse. Lead Architect - Data Engineering/Azure Apply locations: London Type: Full time Posted on: Posted Yesterday End Date: August 30, 2025 (30+ days left to apply) Job Requisition ID: SR-32098 Join … solve complex business problems with creative solutions, we want to hear from you. As a Lead Architect (Azure), you will work within our Technology team, delivering large-scale Data Engineering solutions to Fortune clients worldwide. Your role will involve innovating, building, and maintaining technology services. Responsibilities: Participate in large-scale client business development and delivery engagements. Develop software … PySpark) and frameworks. Expertise in relational and dimensional modeling, including big data technologies. Proficiency in Microsoft Azure components like Azure Data Factory, Data Lake, SQL, DataBricks, HD Insights, ML Service. Good knowledge of Python and Spark. Experience in ETL & ELT processes. Understanding of cloud analytics and ML Ops. Azure Infrastructure and Azure DevOps More ❯

s biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. You … ll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while … using AI itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill More ❯

s biggest credit management service and have begun the next phase in our growth - expansion into 17 European markets over the next two years. The Role - AI Automation & Data Engineer We're seeking a proactive, execution-focusedAI Automation & Data Engineer to join our fast-paced team focused on transforming manual processes into intelligent automation solutions. You … ll work at the intersection of data engineering and AI automation, building robust pipelines and systems that power our company-wide automation initiatives at scale, for a large enterprise operating across 17 markets. This isn't a traditional data engineering role - you'll be building the data foundation for cutting-edge AI automations while … using AI itself to code faster and smarter. You'll have the freedom to identify automation opportunities across the business and build the data infrastructure to support them. In this role, you'll get to: Design and build data pipelines that feed our AI automation systems Create end-to-end automation solutions using Python and Windmill More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and … or Master’s degree in Computer Science, Engineering, or related field. • 10+ years of experience in data engineering. • Strong hands-on experience with AWS services: S3, Glue, Lake Formation, Athena, Redshift, Lambda, IAM, CloudWatch. • Proficiency in PySpark, Python, DBT, Airflow, Docker and SQL. • Deep understanding of data modeling techniques and best practices. • Experience with CI More ❯

Here at Halton Housing, we are looking for an experienced Data Developer to work across our vibrant organisation. What You'll Do: Coding DAX Measures and Dimensional Models Developing & delivering visually compelling … Power BI Dashboards & Reports to specification Developing and maintaining SSRS reports Developing & maintaining ETL pipeline solutions in Azure Data Factory and SSIS, utilising Azure Data Lake & Dev Ops Providing second & third line support for Data Team and own allocated support tickets Monitoring the Data Warehouse load and performance Providing high quality … documentation on Data Engineering solutions & Insight Datasets What You'll Need: Demonstrable SQL experience (T-SQL, SSMS) with a good understanding of Data Warehousing concepts Degree/professional qualification in a relevant business discipline and/or demonstrable experience in delivery in this area Ability to follow defined processes and procedures in an accurate and consistent More ❯

to technology, delivering bespoke software solutions and expert advice. Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models. These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be … or solving tough engineering challenges. You'd also be expected to spend some time on-site with clients in the London area on an ad-hoc basis. Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We're technology agnostic, and we're open minded when it More ❯

like you belong, and where you are empowered to succeed. We look forward to having you join our journey - and seeing how far we can go, together! Position Data Services Engineer at Conferma is responsible for: Enhancing and maintaining the Conferma Data Platforms As a data specialist you will support in the maintenance and … deployment of Conferma application & services at a data layer.This includes a combination of Microsoft SQL databases, batch file data & Microsoft Fabric data lakes. You will possess excellent troubleshooting skills and demonstrate the ability to make key technical decisions to ensure confidentiality, integrity & security of all platform data sets. Systems Analyst responsibilities: Providing … internal and external technical support for Conferma data platforms, working closely with L1-3 support teams. Working inside the Conferma SQL release pipeline to ensure consistency & reliability of product enhancements through non-production & production environments, including undertaking code reviews and approvals prior to release. Collaborating alongside the DBA function to assess proposed changes to platform data More ❯

About Monte Carlo As businesses increasingly rely on data + AI for competitive advantage, reliability has become a non-negotiable. Named a CBInsights AI100 company and described by Forbes as the "New Relic for data", Monte Carlo supports some of the world's most prestigious companies, including Fox, Roche, Honeywell, and CreditKarma to deliver trustworthy data + AI at scale. Backed by Accel, Redpoint Ventures, Notable Capital, ICONIQ Growth, and Salesforce Ventures, Monte Carlo is powering the future of reliable data + AI. About the role: We're looking for an experienced customer-facing Solutions Architect who loves helping people, solving problems, and wants to be a major factor in the success … scope based on the customer's needs and requirements, guide clear outcomes, and communicate technical and value propositions. Deliver implementations of Monte Carlo, including on complicated data lake environments. Define "best practice" approaches for achieving a desired technical capability through Monte Carlo. Deliver training and enablement on advanced technical concepts to technical customers. Create collateral, documentation, and More ❯

Work Location London State/Region/Province London Country United Kingdom Domain Delivery Interest Group Company ITL UK Requisition ID 137810BR Role - Senior Technology Architect Technology - Azure Data Factory, ADLS, Snowflake, Kafka, Power BI, Confluent Cloud, MS Fabric, Python/Pyspark, MSBI(SSIS) Location - London Business Unit - DNA Compensation - Competitive (including bonus) Job Description We are looking … for a Lead Data Architect who has experience in solution planning and system architecture design,in leading DW/BI initiatives on Azure and/or Snowflake platforms. The ideal candidate will have extensive experience in designing and implementing scalable data warehouse and business intelligence solutions, with a strong emphasis on statistical and advanced analytics . … The role involves close collaboration with cross-functional teams to gather data requirements and ensure data integrity and consistency across systems. Insurance domain expertise is mandatory in Commercial/Speciality Insurance Roles & Responsibilities Lead engagements across all phases-from problem definition and diagnosis to solution design, development, and deployment. Create detailed design and architecture, and process More ❯

We're hiring a Senior Data Engineer (Genetics) to join us on 12 months FTC to support Maternity Cover. This role will be working within our Bioinformatics Team working on genetic data and building pipelines to process, control and create data releasees for Researchers. Our Future Health is the UK's largest ever health … new discoveries about human health and diseases. So future generations can live in good health for longer. What You'll Be Doing: Support the build of production-level data pipelines from data providers to our primary data store and Trusted Research Environment. Work closely with the Lead Data Engineer on key designs … and features. Build and maintain pipelines which meets the requirements for our end users and builds well curated, accessible and quality controlled data for analysis. Keep abreast of best practice in data engineering across industry, research and Government and facilitating the adoption of standards. Work to promote the adoption of best practises across the squad (unit More ❯

SAP Finance Data & Analytics Specialist ( Interim State Management) Luton - 12 months - outside IR35 - £580 per day The SAP Finance Data & Analytics Specialist ( Interim State Management) will be responsible for keeping the lights on for all the critical Finance global & local reporting solutions. Apply data, analytics, process, and object expertise to support interim state and … S/4 design, acting as an integral part of the Data and Analytics design team, considering both business process and analytics requirements. SAP Finance Data & Analytics Specialist ( Interim State Management) will be managing 7 non-SAP analytics applications and responding to changes driven by the ongoing S4 Transformation' Essential Skills 15 + years of experience …/4HANA and ECC in the FI/CO module functionalities. Experience and knowledge of Analytics tools and Data Warehouses like PowerBI, Qlik, Azure Data Lake, Snowflake, SAP B4H, SAP Analytics Cloud etc. SAP Finance Data & Analytics Specialist ( Interim State Management) Osirian Consulting is committed to working with our clients to promote equality More ❯

SAP Finance Data & Analytics Specialist ( Interim State Management) Luton - 12 months - outside IR35 - £580 per day The SAP Finance Data & Analytics Specialist ( Interim State Management) will be responsible for ‘keeping the lights on’ for all the critical Finance global & local reporting solutions. Apply data, analytics, process, and object expertise to support interim state and … S/4 design, acting as an integral part of the Data and Analytics design team, considering both business process and analytics requirements. SAP Finance Data & Analytics Specialist ( Interim State Management) will be managing 7 non-SAP analytics applications and responding to changes driven by the ongoing S4 Transformation' Essential Skills – 15 + years of experience …/4HANA and ECC in the FI/CO module functionalities. Experience and knowledge of Analytics tools and Data Warehouses like PowerBI, Qlik, Azure Data Lake, Snowflake, SAP B4H, SAP Analytics Cloud etc. SAP Finance Data & Analytics Specialist ( Interim State Management) Osirian Consulting is committed to working with our clients to promote equality More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. Were working with a biotech start-up thats tackling one of modern medicines biggest challenges. Theyve built a next … their own DNA sequencing tech in play, theyre solving incredibly complex problems at the intersection of science and software. What youll be doing: Coming in as the Senior Data Engineer, youll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform. Youll be leading on the … design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. You'll be collaborating closely with engineers and scientists, helping to bridge the gap between their experiments and actionable data. That might mean streaming data off More ❯

Azure Cognitive Services to address specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI, machine learning, and Azure services … s AI strategy and innovation efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. Ensure that operational issues are identified, recorded, monitored and resolved. Align all … with Azure AI solutions, including Azure OpenAI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience with Azure Data More ❯

Azure Cognitive Services to address specific business challenges. Implement and maintain scalable and efficient AI systems, ensuring they meet business requirements and performance benchmarks. Collaborate with business analysts, data scientists, and IT teams to integrate AI solutions into existing systems and workflows, enhancing their capabilities and impact. Stay abreast of advancements in AI, machine learning, and Azure services … s AI strategy and innovation efforts. Conduct data analysis and feature engineering to prepare data for use in AI models, utilizing Azure Data Lake Develop robust testing and validation processes to ensure the accuracy and reliability of AI models and solutions. Ensure that operational issues are identified, recorded, monitored and resolved. Align all … with Azure AI solutions, including Azure OpenAI Service, Azure Cognitive Services, and Azure Machine Learning. Familiarity with Azure Databricks is a plus. Solid background in machine learning algorithms, data pre-processing, feature engineering, and model evaluation. Experience with deep learning frameworks like TensorFlow or PyTorch is desirable. Proficiency in handling large datasets, experience with Azure Data More ❯

Next-gen diagnostics start-up Take ownership of data strategy and architecture from the ground up. Flexible, remote-first working with visits to a high-impact biotech lab. Cutting-edge work combining AI, genomics, and diagnostics to save lives. We’re working with a biotech start-up that’s tackling one of modern medicine’s biggest challenges. They … DNA sequencing tech in play, they’re solving incredibly complex problems at the intersection of science and software. What you’ll be doing: Coming in as the Senior Data Engineer, you’ll take the reins on all things data - shaping the architecture, strategy, and pipeline design that supports a life-saving platform.You’ll be leading on … the design and implementation of scalable, secure data pipelines - getting experimental and genomic data into formats that data scientists and machine learning engineers can easily work with. You'll be collaborating closely with engineers and scientists, helping to bridge the gap between their experiments and actionable data. That might mean streaming data More ❯

will be initially 6 months but likely to extend paying £525 per day In order to be considered for this role you will need to have - Experience with data … management and data architectures (SQL/NoSQL), database systems, modern data warehouse platforms (Snowflake, Databricks, BigQuery), ETL/ELT pipeline development, and data lake/warehouse implementations for integrating structured and unstructured laboratory and sequencing data sources. Master Full-Stack technologies, such as Python, JavaScript/TypeScript, Cloud(preferably AWS), SQL More ❯

will be initially 6 months but likely to extend paying £525 per day In order to be considered for this role you will need to have - • Experience with data … management and data architectures (SQL/NoSQL), database systems, modern data warehouse platforms (Snowflake, Databricks, BigQuery), ETL/ELT pipeline development, and data lake/warehouse implementations for integrating structured and unstructured laboratory and sequencing data sources. • Master Full-Stack technologies, such as Python, JavaScript/TypeScript, Cloud (preferably AWS), SQL More ❯

This forward-looking company are applying data science to deliver positive results for people with a view to the low carbon future. With an abundance of data collected, and technology in place, they are seeking a lead engineer with the analytical capabilities of a data scientist and the technical grounding of a data engineer. Initially you will take the lead on delivering answers to vital data-driven questions posed by stakeholders, using your own capability along with mastering and refining their data platform. As time progresses, you will take responsibility for hiring and career development for a team you will lead. Autonomy and responsibility will be key … as you drive the technical development of their services. You will have: Data science experience, including use of Python, databases, data cleaning, statistical methods and potentially machine learning techniques, along with the likes of PowerBI, Tableau and data visualisation tools in general. Experience creating and managing data pipelines, working with and developing More ❯

Salary: Competitive Salary + Bonus + Excellent Benefits CRM Data and Insight Manager Warwick Hybrid working So, who are we? We are Wolseley Group - a leading specialist trade merchant across the UK and Ireland. We pride ourselves in putting our people and customers at the heart of everything we do and best of all, provide opportunities to develop … more! As a CRM Data and Insight Manager based in Warwick, youll be responsible for: Leading data strategy and management across Wolseleys data lake ODS and Salesforce platforms, ensuring insights are leveraged to support CRM campaigns. Developing and maintaining customer data models, including segmentation and RFV/churn analysis, in partnership … with internal teams and external data specialists. Overseeing analytical outputs, building models and dashboards that support CRM performance and wider business reporting. Coordinating cross-functional collaboration, working closely with CRM, IT, and data teams to align on roadmap, reporting, and platform enhancements. And heres what wed like you to have: Strong leadership and a results-driven More ❯