101 to 125 of 201 Data Lake Jobs in London

Summary Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based Data Engineerto join our AI team. This position will work on a team to accomplish tasks and projects that are instrumental to the company’s success. If you want an exciting … Large Language Models (LLMs) in the Extract, Transform, and Load (ETL) of large corpus of data into a data lake; Participate in the Natural Language Processing (NLP) extract of unstructured data into structured meta-data through the use of tools such ...

DATA is seeking a highly experienced Data Solutions Architect (Modern Big Data) to lead design and delivery of scalable data platforms in the Data & AI practice. You will steer cloud-native architectures, guide streaming data, data lakes, lakehouses, and analytics, and partner with executives and technical teams to drive data modernization for clients in the UK. You will champion best practices, data governance, and security while shaping the data strategy and ensuring measurable business #J-18808-Ljbffr ...

Arrive is seeking a Data Product Manager in the Transport … Business Unit to drive data-centric product strategy. You will own the vision, backlog and delivery of BI dashboards, data lake integration and governance across the Group Data Lake and B2G offerings. You will collaborate with Engineering, QA, UX/ ...

influential company. Among top performers, you can make a direct and meaningful impact. As a Lead Engineer at JPMorgan Chase within our Market Data Services team you will play a pivotal role in designing, delivering and maintaining critical data distribution systems within the firm. These systems … skills Formal training or certification on infrastructure engineering concepts and advanced applied experience in Cloud technologies including Kubernetes, Terraform and AWS Data Lake technologies (e.g. Snowflake, Databricks, AWS Glue/Athena, Lake Formation) Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support ...

maximise on the power of its data. The successful candidate would be: Working in an agile scrum team to design and build data feeds and related applications Writing, testing and peer review of ETL code in Oracle ODI, dbt, Snowflake and AWS. … Working with business users to design and configure self-serve data environments within our data warehouse and data lake Analysing, developing, delivering, and managing BI reports Assisting in the design of the data processes, including data quality, reconciliation, testing ...

Data Architect Competitive Salary + 20% Bonus + Car Allowance Central London - Hybrid, 3 days per week in the office 35-hour Working Week - Flexible Hours We are representing a large European transport business, employing around 35,000 people across the UK and Europe … governance frameworks, metadata management, and regulatory complianc It would be a bonus if you have: Familiarity with emerging technologies such as Apache Iceberg, Delta Lake, real-time/streaming architectures, or data observability tooling Experience leading architecture workshops with both technical and non-technical stakeholders A background ...

Principal Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active eDV clearance for this role. About us At Raytheon UK, we take immense pride in being a leader … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

inforcer is seeking a Data Engineer to design, build, and maintain the infrastructure powering internal automation and AI platforms. … will develop scalable data pipelines, integrate data from multiple systems and build foundations for a modern data lake architecture. You will ensure data is accessible, reliable, and ready to support analytics, reporting, automation, and AI initiatives, while solving complex data ...

other non-disability related questions, please reach out to our Talent Partners. Role We’re looking for a Staff Backend Engineer – Data Platform to be a key technical leader within the teams responsible for Depop’s data platform. … drive the technical vision and implementation for our foundational data platform — from experimentation, event ingestion pipelines to our data lake, governance frameworks, and data observability and real-time analytics capabilities. You will work closely with data scientists, machine learning engineers, backend ...

Data Engineer – Consultant/Sr. Consultant Our talented Data Engineering team is made up of globally recognised experts – and there’s room for more analytical, innovative, client‐driven data professionals. If you’re passionate about helping clients make better data‐driven decisions … large‐scale projects Experience in working with the latest Azure technologies, such as Databricks, Microsoft Fabric, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, AzureML, AIFoundry, Kubernetes Understanding of software engineering tools and concepts including experience in Python, Scala or PySpark, database ...

Experis - ManpowerGroup is seeking a Data Architect for a 6-month hybrid role, with 2–3 days on site in London … Corsham. Active DV clearance is required, and the daily rate is £860 inside IR35. You will specify target designs for the data lake, ingestion, governance and security architecture, acting as the design authority to ensure secure, scalable, auditable solutions across classified environments. The position requires extensive experience ...

Data Engineering Lead required by our client an international educational establishment to provide the technical engine for the Value Management Office automating the visibility of portfolio performance and benefit realization across the organization. It is responsible for building and maintaining the "Value Dashboard," ensuring that data … integrated to provide a real-time view of strategic ROI. The role holder defines technical standards for value-tracking tools and creates automated data objects that link project outputs to the organisations strategic objectives. Role specific skills Full-Stack Analytics Engineering: Mastery of the lifecycle from data ...

during a peak in workload. We are specifically looking for someone with specialist knowledge of The Access Group's Children's Services Mosaic data models and experience using them for data and analytics development for reporting purposes. This expertise is not currently available within the team … will need sufficient experience to work confidently and independently. You will lead the analysis, specification, development, testing, implementation and support of corporate data storage solutions and internal database developments. You will also implement, maintain and support business analytics and intelligence systems that help deliver effective council services. Working ...

Expedia Group is seeking a Senior Software Engineer to join the Data Lake and Catalog team in London. You will design, build, and operate scalable data lake services, focusing on reliability, observability, and end-to-end platform quality. You will mentor engineers, partner with ...

in a scripting language Our tech stack Python as our main programming language DBT for data modelling Databricks as our datalake platform Kubernetes for data services Orchestra for task orchestration Terraform for infrastructure Lightdash for data applications Airflow and Astronomer … scheduling and tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data processing SparkSQL for analytics Why else you'll love it here Wondering what the salary for this role is Just ...

process, and structure to make a lasting impact. At Credera, you will work on diverse client projects, such as building modern, AI-enabled data platforms on AWS using DevOps and MLOps practices, including large, distributed workloads, batch and streaming pipelines, and the data foundations that power … Large Language Model solutions. Working with architects, technology consultants and public sector client stakeholders, you will help customers make use of the data available to them while gaining exposure to regulated environments, networks and the latest AI technologies. Based out of any of our UK offices, this ...

## Lead Azure Data Engineering Architect – Lloyds MarketplaceApplylocations: Londontime type: Full timeposted on: Posted Yesterdaytime left to apply: End Date: October 31, 2026 (30+ days left to apply)job requisition id: SR-44500It's fun to work in a company where people truly BELIEVE in what they … .* Good understanding of tools and platforms used across the **Lloyd’s insurance ecosystem**.* Proficiency in Azure ecosystem: Blob Storage, Data Lake, Synapse Analytics, Databricks, Functions, and Monitor.* Demonstrated expertise in **analytics consulting**, **data analysis**, and **data analytics**.* Strong business acumen ...

looking for a deeply technical Enterprise Architect who will own the delivery of AI projects end to end from the silicon and data center design that underpins AI workloads, through the software and MLOps stack, to the governance frameworks that make AI trustworthy and defensible at scale. This … QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code ...

Stress Testing Technology Engineering & Delivery Lead to join the EMEA Risk Technology team and lead strategic stress testing capabilities across Risk, Finance, Treasury, Data and Technology. The role spans Credit Risk, Counterparty Credit Risk, Market Risk, Liquidity Risk and IRRBB, Operational Risk, Model Risk, Climate and Sustainability Risk … concentration risk and other material enterprise risks. It requires deep engineering and solution architecture expertise, strong risk-domain understanding, hands‐on technical leadership, data and integration expertise, and the ability to orchestrate scenario management, calculation engines, workflow, controls, aggregation, analytics and regulatory reporting. The successful candidate will lead ...

Date Posted: 2026-09-24 Country: United Kingdom Location: London, London, City of Position Role Type: Onsite Principal Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

Date Posted: 2026-09-24 Country: United Kingdom Location: London, London, City of Position Role Type: Onsite Senior Data Engineer Location: London Permanent Onsite Due to the interesting work we do and the sector this team is working in, we require all candidates to hold an active … Messaging/Streaming (Kafka, AWS SQS, Other Cloud Queuing Native services) SQL and NoSQL Storage (HDFS, Iceberg, Elastic, S3, Data Lake) Containerisation and orchestration (Docker/Kubernetes/Openshift) Testing frameworks and best practices Use of Code repositories, familiarity with branching strategies, pull requests and merge processes ...

years hands-on with Azure Databricks in production environments Proven experience designing and implementing medallion architecture (Bronze/Silver/Gold) using Delta Lake on Azure Databricks Strong hands-on experience with Unity Catalog — metastore setup, catalog and schema design, access controls, and governance policies Experience configuring Azure Data Lake Storage Gen2 — containers, access control lists, lifecycle policies, and integration with Databricks Hands-on experience with Microsoft Fabric — specifically Mirrored Azure Databricks Unity Catalog and Power BI connectivity to Databricks SQL Warehouses Experience with enterprise data source integration — MS SQL Server (on-premises ...

Summary Our talented Microsoft Fabric team is made up of globally recognised experts and there’s room for more analytical, innovative, client driven data professionals. If you’re passionate about helping clients make better, data driven decisions to tackle their most complex business challenges … including large‐scale projects Experience working with modern Microsoft Fabric and Azure technologies, such as Synapse, Data Factory, Azure Data Lake Storage (Gen2), Purview, Cosmos DB, OpenAI, Azure ML, and AI Foundry Solid understanding of software engineering concepts, with hands‐on experience using Python, Scala ...

team has grown extremely quickly as a result. With this rapid growth, we are looking for Platform Engineers to join our team. The data platform team works across the whole customer domain, handling everything from natural language understanding of our customer communications to processing billions of smart meter … application deployments Airflow purely for job scheduling and tracking CircleCI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Postgres/Aurora for our relational databases Spark for data processing dbt for data modelling SparkSQL for analytics Streamlit ...

thrive in it. Loyalty – We stand by each other and our mission. Job Summary About the Role Movar is seeking a Senior Data Engineer who thrives on building scalable, cloud-first data systems. You will design and manage data pipelines that support analytics … engineers to deliver robust and reusable data products. Manage data lakes and warehouses using formats such as Delta Lake and Parquet. Implement best practices for data governance, performance, and security. Continuously evaluate and adopt new technologies to evolve Movar's data ...