151 to 175 of 256 Data Lake Jobs in London

it. DRW is a place of high expectations, integrity, innovation and a willingness to challenge consensus.About the TeamThe DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers … based, concurrent, high-throughput, low-latency software systemsExperience with pipeline orchestration frameworks (e.g. Airflow, Dagster)Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databasesHave a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering, or equivalent ...

About the roleA fantastic opportunity to join as Data Analytics Lead for a growing Payments FinTech backed by one of the largest banks in the UK. As Data Analytics Lead you will drive value for the customer through sourcing and data transformation. … still being hands on in terms of analysisEnsuring that relevant insight and analysis is provided to drive growthExperience of Synapse, Azure Data Lake, Azure Data Factory, highly desirableWorking closely with other senior stakeholders on the overall business strategyProficient understanding of cloud data solutions ...

other non-disability related questions, please reach out to our Talent Partners. Role We’re looking for a Staff Backend Engineer – Data Platform to be a key technical leader within the teams responsible for Depop’s data platform. … drive the technical vision and implementation for our foundational data platform — from experimentation, event ingestion pipelines to our data lake, governance frameworks, and data observability and real-time analytics capabilities. You will work closely with data scientists, machine learning engineers, backend ...

just to execute a function, but to help redefine the future of how work gets done. Solution Engineer: Accelerate the AI Data Cloud We are looking for a Solution Engineer who is accustomed to solving customer’s most complex problems and closing large deals. In this role … experience within Data platforms, analytics, and cloud technologies, including deep knowledge of data warehousing, data lakes, and lake house architectures. Proven ability to discuss and demonstrate the value of Generative AI and Machine Learning (ML) use cases for enterprises. Hands-on experience with ...

place of high expectations, integrity, innovation and a willingness to challenge consensus. About the Team The DRW C/FICCO Data Engineering team is essential to developing valuable datasets and scalable data infrastructure critical to our trading operations. We work closely with traders, researchers, and other … concurrent, high‐throughput, low‐latency software systems Experience with pipeline orchestration frameworks (e.g. Airflow, Dagster) Experience with streaming platforms (e.g. Kafka), data lake platforms (e.g. Delta Lake, Apache Iceberg), and relational databases Have a Bachelors or advanced degree in Computer Science, Mathematics, Statistics, Physics, Engineering ...

Senior Data Engineer Rate: To £650 p/d Inside IR35 Duration: 6 months Work Arrangements: Hybrid - 3 days in Central London office Public facing, household name, critical national infrastructure organisation are seeking an experienced Data Engineer with a strong background in modern data … robust data pipelines using modern data engineering best practices Hands-on development with ETL/ELT processes, data lake architectures, and ideally Medallion architecture principles Strong experience AWS data services (S3, Glue, and Athena) Proficient in Git for source control ...

expertise to lead the design and implementation of enterprise-scale technology solutions. The ideal candidate should possess strong architecture skills across cloud, integration, data, and application domains while having a deep understanding of retail banking, commercial banking, payments, lending, trade finance, treasury, risk, and regulatory requirements. The Solution … Containerization (Docker) Kubernetes/OpenShift Data Technologies SQL & NoSQL Databases Data Warehousing Big Data Platforms Data Lake Architecture DevOps & Automation CI/CD Pipelines GitHub Jenkins Terraform Infrastructure as Code Banking Domain Knowledge Required Must Have Experience In Core Banking Systems ...

Senior Data ArchitectLocation: London (Hybrid) | Practice Area: Data & Analytics | Type: PermanentDesign the blueprint. Architect the future. Empower data transformation.The RoleCapco is seeking a Senior Data Architect to lead and deliver complex data architecture initiatives across our Financial Services clients. … this senior consulting role, you'll guide clients through their data transformation journeys—defining strategy, designing architecture and building scalable, cloud-based platforms. You'll help organisations create modern data foundations that enable advanced analytics, AI and future digital capabilities, while championing AI-enabled ways ...

expansion of AI and automation, the future of work has never been more challenging for organizations. Beamery’s unique jobs, skills and tasks data platform helps organizations navigate these challenges and make more informed decisions across Talent Lifecycle Management. Our solutions power recruitment, mobility, upskilling, diversity, work architecture … worked hard to create; built on trust, empathy & honesty ensuring our workforce is able to bring their full selves to work.About the opportunityOur data platform powers Beamery’s reporting and underpins our AI strategy. We’re hiring a Staff Data Engineer to set its technical direction.This ...

system across finance and operations; one entity's financials are already live on Business Central SaaS in its own tenant, with an Azure Data Factory and Power BI estate around it. The programme consolidates the group onto one BC platform in two phases. Phase one delivers the group … prem BC) to BC SaaS migration. Familiarity with the wider Microsoft data estate: Azure Data Factory and data lake patterns. Sector exposure to job-costed or project-based businesses (removals, logistics, construction, field services). Why this role This is an end-user ...

About Us:LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across … alerting tools like Datadog, Splunk etc.Nice to HaveDevelopment experience with streaming data architectures and event-driven systemsFamiliarity with data lake/Lakehouse based big data systems and architecturesExperience in high-throughput, low-latency environmentsCareer Stage:Senior AssociateLondon Stock Exchange Group (LSEG) Information:Join ...

## Lead Azure Data Engineering Architect – Lloyds MarketplaceApplylocations: Londontime type: Full timeposted on: Posted Yesterdaytime left to apply: End Date: October 31, 2026 (30+ days left to apply)job requisition id: SR-44500It's fun to work in a company where people truly BELIEVE in what they … .* Good understanding of tools and platforms used across the **Lloyd’s insurance ecosystem**.* Proficiency in Azure ecosystem: Blob Storage, Data Lake, Synapse Analytics, Databricks, Functions, and Monitor.* Demonstrated expertise in **analytics consulting**, **data analysis**, and **data analytics**.* Strong business acumen ...

in a scripting language Our tech stack Python as our main programming language DBT for data modelling Databricks as our datalake platform Kubernetes for data services Orchestra for task orchestration Terraform for infrastructure Lightdash for data applications Airflow and Astronomer … scheduling and tracking Circle CI for continuous deployment Parquet and Delta file formats on S3 for data lake storage Spark for data processing SparkSQL for analytics Why else you'll love it here Wondering what the salary for this role is Just ...

Great Yellow we’re looking for a Senior Data Platform Engineer to join our team. About Great Yellow Great Yellow is building the operating system for a regenerative economy. Our mission is to make regenerative land-use investable and scalable, helping businesses, investors, and land managers move from … experience (e.g. with tools such as dbt or similar). Architectural judgement. You can reason about operational vs analytical layers, data lake/warehouse patterns, versioning and lineage, and right-sizing infrastructure for a variety-first (not volume-first) problem. Software-engineering fundamentals. You’re a genuine ...

looking for a deeply technical Enterprise Architect who will own the delivery of AI projects end to end from the silicon and data center design that underpins AI workloads, through the software and MLOps stack, to the governance frameworks that make AI trustworthy and defensible at scale. This … QLoRA), RAG architecture design, vector databases (Pinecone, Milvus, Weaviate), and agentic frameworks (LangChain, LangGraph, Semantic Kernel). Data pipelines: data lake/lakehouse architectures, ETL/ELT, and data quality/lineage tooling that feed AI systems. Automation, Orchestration & Observability Infrastructure-as-code ...

lead a team, manage senior stakeholders across multiple functions and markets, and oversee major change activity including ERP upgrades, AI, data lake and broader finance transformation initiatives.What you'll do:Develop the finance transformation strategy & roadmaps for Sky: to meet business priorities and in the broader organisation … transform finance operations, decision-making and colleague experience.Projects: deliver strategic change and transformation initiatives successfully, including ERP upgrades, AI and data lake initiatives. Lead complex business change programmes, ensuring successful adoption of new processes, technologies and ways of working across multiple markets and functions.Activate resources: defining, leading ...

train, evaluate, and deploy models at scale - forming the foundation of Hollywood's AI transformation.Our team sits at the intersection of large-scale data systems, machine learning, and high-performance computing. We own the full stack, from data ingestion and curation through distributed training and production … data processing pipelines.Familiarity with modern data storage and analytics technologies, including columnar data formats and data lake architectures.Strong debugging, problem-solving, and systems design skills.Experience collaborating effectively with cross-functional teams.Additional Expectations for Staff EngineersDemonstrated technical leadership across significant infrastructure initiatives.Experience ...

Join a team of Google Cloud experts, using your knowledge of data to thrive in a fast paced and innovative environment. You’d drive out the cloud transformation, taking a lead on all things data related in a Google Premier Partner. You will actively engage with … robust ETL processes - thus ensuring the integrity of the data. Your role will be instrumental in the creation of a new data lake/warehouse/hub built in GCP. You are confident using the full suite of Google data products, IAC, CI/ ...

creating a smarter, more connected ecosystem where users and businesses thrive together. Role Overview As a key member of the Tencent Cloud Big Data team, you will be responsible for technical consulting and solution implementation for key overseas accounts. This role requires a blend of deep technical expertise … deep understanding of components like Spark, Flink, Elasticsearch, Doris, ClickHouse, and Trino., Strong knowledge of big data architecture, including Data Lake (Iceberg, Hudi) and Serverless data concepts. Familiarity with mainstream global cloud products such as AWS EMR/Redshift, Google BigQuery, Snowflake ...

Technical Lead is a key role at UCL which ensures the continual build of sustainable internal capability, which delivers high quality enterprise-scale data services. This role also directly enables UCL's Data Strategy, democratisation of data, AI innovation, and compliance with regulatory requirements … HESA, UKVI, TEF, OfS and financial reporting.You will be required to provide advanced technical leadership for architecting, building and scaling UCL’s enterprise data platform. This includes modern data engineering, cloud data lakehouse development, distributed compute, data modelling, metadata/lineage services ...

midst of an ambitious enterprise-wide modernisation programme. This is a brand-new role within the business, reporting into the Group Data Director. As Data Architect, you will be responsible for defining and delivering the group data architecture strategy that underpins BI and self … governance frameworks, metadata management, and regulatory compliancIt would be a bonus if you have:Familiarity with emerging technologies such as Apache Iceberg, Delta Lake, real-time/streaming architectures, or data observability toolingExperience leading architecture workshops with both technical and non-technical stakeholdersA background providing technical ...

entirely new network for the world's money.For everyone, everywhere.More about our mission and what we offer.Job DescriptionWe’re looking for a Lead Data Scientist to join our growing CRM Team in London. This role will give you the opportunity to have a direct impact on how millions … modelling and conditional average treatment effects for personalisation. You are familiar with dbt, Snowflake, AWS (S3, SageMaker), Airflow, and Trino/data lake stacks.You have prior CRM/marketing/e-commerce ML experience — customer lifecycle segmentation, campaign attribution, contact strategy optimisation.Office: London, UKSalary range: GBP 90.5K ...

EngineerWe’re looking for an Analytics Engineer to join our client’s high-performing Business Intelligence team, helping to build scalable, high-quality data solutions that power reporting, dashboards and self-service analytics across the business.Working closely with BI Developers and business stakeholders, you’ll design and optimise …/ELT pipelines, develop curated data models, and translate business requirements into reliable backend data solutions. This is a fantastic opportunity for someone who enjoys solving complex data challenges and wants to work with modern cloud technologies in a collaborative, forward-thinking environment.What ...

seeking an experienced Senior Databricks Engineer to join a high-profile client project. This is an excellent opportunity for a skilled data engineering professional with strong expertise in Azure technologies and Microsoft Fabric to design and deliver modern cloud-based data platforms. Working as part … using Azure Data Factory and Microsoft Fabric. Develop high-performance data processing solutions using Python, PySpark, and SQL. Implement Delta Lake and Lakehouse architectures following industry best practices. Work with Azure Data Lake Storage (ADLS Gen2) to manage large-scale datasets. Optimise ...

Opportunity | £400/day (Outside IR35) | Hybrid London (2-3 days onsite) We're working with a leading insurance organisation seeking an experienced Data Architecture Lead to support the evolution of its enterprise data platforms and drive key transformation initiatives. Key Requirements: Proven experience in Data … Insurance domain knowledge covering areas such as policy, claims, underwriting, billing, broker, customer, risk, or reinsurance data Knowledge of data lake, lakehouse, or modern analytics platforms such as Snowflake, Databricks, Redshift, Synapse, or Fabric. London Market insurance experience essential ...