301 to 325 of 599 Data Lake Jobs in the UK

architecture of AI solutions, in addition to building and running an AI platform to deliver business-specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business-specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

Integration Platform.From an MSB perspective the role will require the design, development, support and deployment of the AeroConnect Platform to provide connectivity and data analytic solutions for the manufacturing environments. This will focus on the integration of the latest manufacturing technologies both at the production sites and research … analysis.• Implement and manage data lakes, data warehouses, and other data storage solutions, including SQL and Cloud Lake solutions.Data Security & Compliance• Implement and enforce best architectural practices for data security, ensuring compliance with relevant data regulations and standardsPerformance Optimization ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business‐specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands‐on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business-specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

architecture of AI solutions, in addition to building and running an AI platform to deliver business-specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

Senior Data Engineer Microsoft Fabric London | Hybrid currently typically 2 days per month in London or Birmingham £65,000£75,000 + 10% bonus + 7% pension + benefits If your Microsoft Fabric experience goes beyond building the initial solution and youve actually had to support, improve … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

Description Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development ...

Data Architect -AI London, hybrid 3 days per week in office Up to £100k + bonus & benefits Im currently recruiting for a Data Architect to join an organisation investing heavily in AI and developing a portfolio of proprietary AI products. Responsibilities Design and evolve data and technical architecture across AI products Define how applications, data, APIs, models and enterprise systems connect Design data models, pipelines, storage and governance frameworks Build reusable data capabilities, services and technical components Set standards across APIs, integration, deployment and observability Work closely ...

technology, process, and structure to make a lasting impact.At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies.Based out of any of our UK offices, this ...

opportunity and deliver enduring results, enabling you to build a lasting career.Isn’t it time you joined us Job DescriptionAs a Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop … data-driven solutions for our clients.You will typically lead a team or the solution delivery effort, demonstrating technical excellence through leading by example. You could be providing technical support, leading an engineering team or working across multiple teams as a subject matter expert who is critical ...

DATA ENGINEERING What We Do Our mission is to provide a world-class platform that empowers the business to leverage data that will enhance, monitor, and support our products. We are responsible for data ingestion systems, processing pipelines, and various data stores … with distributed event streaming systems like Apache Kafka. Familiarity with OLAP databases such as Apache Pinot or ClickHouse Proficient in modern data lake and warehouse tools such as S3, Databricks, or Snowflake Strong foundation in the .NET ecosystem, container orchestration with Kubernetes, and cloud platforms, especially ...

fraud losses that the operation's leadership runs on. Take a central role in the bank's new Microsoft Fabric data lake programme - designing and building the fraud analytics layer on it over the coming months. Mentor and upskill the bank's own analyst team - knowledge transfer … sits alongside it. Experience with cloud data platforms (Azure, Fabric, Databricks or similar) is a strong plus given the data lake programme ahead. Clear English and the credibility to present analysis and recommendations to senior stakeholders. Confirmed availability for an immediate start and genuine willingness ...

seeking an AI Data Engineer to support with building next‐generation analytics and AI‐ready data platforms on KDB+ that directly power trading, research, and risk use cases across Markets. To be successful in this role you will: Be a motivated engineer with foundational experience with … data pipelines, and emerging AI techniques Hold previous experience contributing to AI‐related use cases or pilots, and show a clear interest in how technology is evolving across front‐office trading environments Bring a learning mindset and an understanding of the challenges involved in applying AI responsibly within ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid – you'll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You'll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You'll take ownership of data reliability end-to-end, designing ...

London, United Kingdom | Posted on 01/09/2026 Contract Role: Senior Data Engineer Contract Location: London 4-5 days onsite each week Contract Start: Starting ASAP (inside IR35) Contract duration: End of 2026 The Senior Data Engineer is the one who designs andbuilds data … Refinery maintenance, Crude supply & demand andGasoline supply and demand amongst others. The core Cloudera platform deployment willensure we create a Data Lake and not a Data Swamp and will improve decisionmaking & trading bias via insights from data An Asset Capacity & Maintenance deployment willgive ...

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them … Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong experience using Azure Data Lake, Azure Data FactoryDeliver the automation data pipelines and building of a scalable data architecture. ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

Tata Consultancy Services in the United Kingdom is seeking a Data … Engineer to design, develop and maintain Azure-based data pipelines, leveraging Azure Data Factory, Databricks, Synapse and Data Lake to support data integration, migration and analytics. You will collaborate with stakeholders to translate business needs into reliable, scalable data ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineerto join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want an exciting … Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into structured meta-data through the use of tools such ...

Santander is seeking a Senior AWS Cloud Engineer to lead the data lake platform in Milton Keynes. You will design, build, and run secure cloud data infrastructure, enabling data products and analytics across the organisation. The role focuses on hands-on engineering rather ...

Data Engineer/Permanent/London Hybrid - 3 days onsite/up to £45,000 This is a fantastic opportunity to join a leading global organisation with a strong international presence, dedicated to delivering customer-centric services while investing in innovation, technology, and growth. The role offers … support your progression. What you'll do: Build and optimise Azure data pipelines (ADF, Databricks) Support migration into Azure Data Lake Drive data quality, governance, and performance Collaborate with global teams in an agile environment What you'll bring: Strong SQL + ...

deliver enduring results, enabling you to build a lasting career. Isn't it time you joined us? Job DescriptionAs a Principal GCP Data Engineer, you'll be a true subject matter expert in using the data processing and management capabilities of Google Cloud to develop data … software development lifecycle in line with modern best practices. As part of your responsibilities, you will be expected to: Develop robust data processing jobs using tools such as Google Cloud Dataflow, Dataproc and BigQueryDesign and deliver automated data pipelines that use orchestration tools such as Cloud ...

Principal Data Engineer (Azure) We're looking for an experienced Principal Data Engineer to lead the technical direction of a modern Azure-based data platform. This is a hands-on leadership role where you'll shape data engineering standards, design scalable lakehouse … technical authority for data engineering best practice. Key Skills: Extensive Azure Data Engineering experience Microsoft Fabric, Azure Data Lake & Databricks Python, SQL and modern data pipeline development Azure DevOps & CI/CD Data governance, security and quality assurance Strong ...

Salesforce Data Cloud & Agent force Senior Consultant Location: London or Manchester (Hybrid) About the Job We are looking for an enthusiastic and aspiring Salesforce Data Cloud and Agent force Senior Consultant to join a dynamic team. This role is ideal for someone eager to develop their … technical expertise in Salesforce Data Cloud, alongside Sales, Service, and Commerce Clouds. The successful candidate will have a foundational understanding of data analysis and a passion for learning how to translate insights into practical solutions. We seek a proactive and curious individual who is keen ...