301 to 325 of 594 Data Lake Jobs

architecture of AI solutions, in addition to building and running an AI platform to deliver business-specific Use Case solutions. Collaborating with the Data Platform to team in ingesting and transforming data from multiple systems, modeling data, and engineering data marts … models for enterprise deployment. Data Engineering & Cloud Computing: Strong proficiency in designing optimized ELT/ETL pipelines and managing data lake/data warehouse architectures. Hands-on experience with Google Cloud Platform (GCP) services including Vertex AI, BigQuery, Cloud SQL, and Google Cloud ...

Data Architect 6 months Hybrid working with 2 to 3 days per week on site in either London or Corsham. Active … clearance required £860 per day inside IR35 Role purpose The Data Architect will specify the target design for the data lake, data ingestion, integration, transformation, governance and security architecture click apply for full job details ...

Description Purpose of the role To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure. Accountabilities Build … maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data. Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures. Development ...

Data Architect -AI London, hybrid 3 days per week in office Up to £100k + bonus & benefits Im currently recruiting for a Data Architect to join an organisation investing heavily in AI and developing a portfolio of proprietary AI products. Responsibilities Design and evolve data and technical architecture across AI products Define how applications, data, APIs, models and enterprise systems connect Design data models, pipelines, storage and governance frameworks Build reusable data capabilities, services and technical components Set standards across APIs, integration, deployment and observability Work closely ...

DATA ENGINEERING What We Do Our mission is to provide a world-class platform that empowers the business to leverage data that will enhance, monitor, and support our products. We are responsible for data ingestion systems, processing pipelines, and various data stores … with distributed event streaming systems like Apache Kafka. Familiarity with OLAP databases such as Apache Pinot or ClickHouse Proficient in modern data lake and warehouse tools such as S3, Databricks, or Snowflake Strong foundation in the .NET ecosystem, container orchestration with Kubernetes, and cloud platforms, especially ...

fraud losses that the operation's leadership runs on. Take a central role in the bank's new Microsoft Fabric data lake programme - designing and building the fraud analytics layer on it over the coming months. Mentor and upskill the bank's own analyst team - knowledge transfer … sits alongside it. Experience with cloud data platforms (Azure, Fabric, Databricks or similar) is a strong plus given the data lake programme ahead. Clear English and the credibility to present analysis and recommendations to senior stakeholders. Confirmed availability for an immediate start and genuine willingness ...

seeking an AI Data Engineer to support with building next‐generation analytics and AI‐ready data platforms on KDB+ that directly power trading, research, and risk use cases across Markets. To be successful in this role you will: Be a motivated engineer with foundational experience with … data pipelines, and emerging AI techniques Hold previous experience contributing to AI‐related use cases or pilots, and show a clear interest in how technology is evolving across front‐office trading environments Bring a learning mindset and an understanding of the challenges involved in applying AI responsibly within ...

Senior Data Engineer Microsoft Fabric Leeds | Hybrid | £65,000£75,000 + 10% bonus + 7% pension + benefits If youre already working hands-on with Microsoft Fabric and want greater ownership of the solutions you build, this role gives you the chance to do that without moving … Lakehouse, Warehouse and OneLake Data pipelines and ETL/ELT Power BI SQL and data modelling Azure Data Lake Internal and third-party API integrations Azure DevOps, Git and CI/CD Production deployment and support Existing Azure Synapse solutions during the transition ...

successful multinational technology business is looking for a Data Reliability Engineer to join its growing data team in Central London. This role is hybrid – you'll be able to work from home 2 days per week. This is a high-impact role focused on improving data quality, reducing incidents, and building scalable observability across a modern enterprise data platform. You'll help ensure data across the organisation is accurate, reliable, and trusted for critical business decision-making. You'll take ownership of data reliability end-to-end, designing ...

London, United Kingdom | Posted on 01/09/2026 Contract Role: Senior Data Engineer Contract Location: London 4-5 days onsite each week Contract Start: Starting ASAP (inside IR35) Contract duration: End of 2026 The Senior Data Engineer is the one who designs andbuilds data … Refinery maintenance, Crude supply & demand andGasoline supply and demand amongst others. The core Cloudera platform deployment willensure we create a Data Lake and not a Data Swamp and will improve decisionmaking & trading bias via insights from data An Asset Capacity & Maintenance deployment willgive ...

About the roleA Payments FinTech are currently seeking a Data Engineering Lead (Python, Hadoop & SQL) to lead and mentor a talented team of data engineers and scientists as they look to simplify the bank through developing innovative data driven solutions, allowing them … Power BI (or alternative)A strong understanding of architecting data platforms, BI, MI, or analytics solutionsStrong experience using Azure Data Lake, Azure Data FactoryDeliver the automation data pipelines and building of a scalable data architecture. ...

Tata Consultancy Services in the United Kingdom is seeking a Data … Engineer to design, develop and maintain Azure-based data pipelines, leveraging Azure Data Factory, Databricks, Synapse and Data Lake to support data integration, migration and analytics. You will collaborate with stakeholders to translate business needs into reliable, scalable data ...

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineerto join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want an exciting … Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into structured meta-data through the use of tools such ...

Santander is seeking a Senior AWS Cloud Engineer to lead the data lake platform in Milton Keynes. You will design, build, and run secure cloud data infrastructure, enabling data products and analytics across the organisation. The role focuses on hands-on engineering rather ...

Data Engineer/Permanent/London Hybrid - 3 days onsite/up to £45,000 This is a fantastic opportunity to join a leading global organisation with a strong international presence, dedicated to delivering customer-centric services while investing in innovation, technology, and growth. The role offers … support your progression. What you'll do: Build and optimise Azure data pipelines (ADF, Databricks) Support migration into Azure Data Lake Drive data quality, governance, and performance Collaborate with global teams in an agile environment What you'll bring: Strong SQL + ...

remote, with monthly travel to Leeds/Bradford Type: Permanent | Full-time The Opportunity A forward-thinking organisation undergoing significant investment in its data and technology capabilities is seeking an experienced Data Engineer to join its growing team. This is an excellent opportunity to play … role in the evolution of a modern Azure-based data platform, supporting reporting, analytics, business intelligence, and emerging AI initiatives. You'll work closely with analysts, architects, engineers, and business stakeholders to deliver scalable, secure, and high-quality data solutions. Key Responsibilities Design, develop and maintain ...

Principal Data Engineer (Azure) We're looking for an experienced Principal Data Engineer to lead the technical direction of a modern Azure-based data platform. This is a hands-on leadership role where you'll shape data engineering standards, design scalable lakehouse … technical authority for data engineering best practice. Key Skills: Extensive Azure Data Engineering experience Microsoft Fabric, Azure Data Lake & Databricks Python, SQL and modern data pipeline development Azure DevOps & CI/CD Data governance, security and quality assurance Strong ...

Salesforce Data Cloud & Agent force Senior Consultant Location: London or Manchester (Hybrid) About the Job We are looking for an enthusiastic and aspiring Salesforce Data Cloud and Agent force Senior Consultant to join a dynamic team. This role is ideal for someone eager to develop their … technical expertise in Salesforce Data Cloud, alongside Sales, Service, and Commerce Clouds. The successful candidate will have a foundational understanding of data analysis and a passion for learning how to translate insights into practical solutions. We seek a proactive and curious individual who is keen ...

solutions that provide trusted management information and actionable insights. This is a hands‐on role requiring strong technical expertise in Microsoft Power BI, data modelling and analytics, alongside the ability to engage effectively with both technical and non-technical stakeholders. The role will contribute to improving how data … making and supporting strategic, operational and regulatory outcomes. Key Responsibilities The successful candidate will: Design, develop and maintain Power BI reports, dashboards and data visualisations that support organisational decision‐making. Work with stakeholders to gather, analyse and document reporting requirements. Translate business needs into practical and user‐centred ...

seeking a Java Technical Software Engineering Lead – Vice President to lead data acquisition within the AI Labs/Data Lake platform. The role blends hands-on software engineering with architectural leadership in Wholesale Data Technology, London (Hybrid). The candidate will shape architecture … implement scalable data solutions, and mentor junior engineers, ensuring data quality and secure, reliable ingestion for global markets operations. #J-18808-Ljbffr ...

Principal Security Architect - Applications & Data Principal Security Architect - Applications and Data £80,000 to £90,000 plus great benefits including private healthcare and a company car or car allowance (Work Level 4) Manchester city centre - in this role you'll split your time between home … engineering practices Experience securing enterprise applications such as SAP, Salesforce, or Dynamics, and large-scale data platforms such as Data Lake, S3, or Databricks Knowledge of data loss prevention, data lifecycle management, and relevant regulations such as GDPR The ability ...

LocationNorthampton, Glasgow, United Kingdom# Data/Solution Architect at N Consulting LtdLocationNorthampton, Glasgow, United KingdomSalary£400 - £450/dayJob TypeContractDate PostedMarch 3rd, 2026Apply Now**Job title: Data/Solution Architect****Location: Glasgow and Northampton****Job type: Contract- 2 days onsite****Minimum 8+ years of experience working … Data Architect for AWS Cloud Dataware house****Data Architecture & Engineering Deliverables****Understand Data Requirements & Authoritative Data Source Assessment**: Engage early to capture business and technical data needs.**Create and Maintain Architecture Artifacts**:o **Data Flow Diagrams ...

After that comes ownership. The platform, its roadmap and the team around it are yours, and the group's wider Microsoft estate (Azure data platform, Power BI, a CRM decision on the horizon) grows around them. Team and governance The role reports to the Group Head of Finance … prem BC) to BC SaaS migration. Familiarity with the wider Microsoft data estate: Azure Data Factory, Synapse, data lake patterns and Fabric. Sector exposure to job-costed or project-based businesses (removals, logistics, construction, field services). Jobs, projects or costing module experience. ...

DATA is seeking a highly experienced Data Solutions Architect (Modern Big Data) to lead design and delivery of scalable data platforms in the Data & AI practice. You will steer cloud-native architectures, guide streaming data, data lakes, lakehouses, and analytics, and partner with executives and technical teams to drive data modernization for clients in the UK. You will champion best practices, data governance, and security while shaping the data strategy and ensuring measurable business #J-18808-Ljbffr ...

accelerating chemical discovery to improve quality of life and extend the reach of humanity. The Role Everything Chemify does runs on the Unified Data Platform. When a molecule is designed, registered, sourced, synthesised by a robot, tested, and shipped, the platform is what carries it, one canonical identity … cases, and the abstractions you choose will outlive the code. Data pipelines and orchestration. Dagster pipelines feeding a versioned data lake and a warehouse serving multiple use cases, with the reproducibility and governance that scientific data demands. Reconciling sources that disagree. External datasets ...