326 to 350 of 1,422 Data Pipeline Jobs in London

Data Engineer I - QuantumBlack, AI by McKinsey

Hiring Organisation
McKinsey & Company
Location
London, UK
Employment Type
Full-time
QUALIFICATIONSDegree in Computer Science, Engineering, Mathematics, or equivalent experienceUpto 2 years' experience building data pipelines in a professional setting (e.g., internship) is a plusAbility to write clean, maintainable, scalable, and robust code in PythonFamiliarity with analytics libraries (e.g., pandas, numpy, matplotlib), distributed computing frameworks (e.g., Spark, Dask … using the right tech for the right task, we often leverage: Python, PySpark, the PyData stack, SQL, Airflow, Databricks, Kedro (our open-source data pipelining framework), Dask/RAPIDS, Docker, Kubernetes, and cloud solutions such as AWS, GCP, and AzureExperience with Generative AI (GenAI) and agentic systems would ...

Senior Data Engineer

Location
City of Westminster, England, United Kingdom
client is looking for an experienced Senior Data Engineer to join them on a contract basis , taking end‐to‐end ownership of business‐critical data products on their Azure Databricks‐based data platform . This is a hands‐on role embedded directly within … product team, working closely with product managers and lead engineers to raise engineering quality and shape how modern data products are built for analytics and AI. The Role As a Senior Data Engineer, you will: Design scalable data products within a cross‐functional product ...

Manager, Analytics & AI, EY-Parthenon

Location
Greater London, England, United Kingdom
Analytics & AI, EY-Parthenon EY-Parthenon is seeking a motivated Manager to join its Analytics & AI practice, supporting clients to unlock value from data through analytics, reporting, AI and data-driven insights. This role is ideal for an individual with a strong commercial and technical mindset … enjoys solving business problems using data and is looking to develop both consulting and technical expertise. Managers work across a variety of strategic engagements across the deal lifecycle helping clients make informed business decisions by transforming complex data into actionable insights. Working alongside experienced consultants, managers ...

Lead Product Data Scientist

Location
Greater London, England, United Kingdom
Talk to customers and align on success criteria and measurement Use raw, real-world data to form clear, actionable insights Optimise agent performance for each onboarded customer Own the optimisation flow from identifying opportunities through testing hypotheses, running experiments, delivering improvements, and demonstrating value Analyse data … approach. Highest-signal resume keywords Data Science Experience SQL Fluency Python Proficiency Statistical Methods Understanding Product Mindset Hard Skills Data Pipeline Development Statistical Analysis Data Analysis Hypothesis Testing Experimentation Data Optimization SQL Querying AI Utilization Soft Skills Expert Communication Problem Solving ...

Data Architect / Engineering Lead

Location
Greater London, England, United Kingdom
background on Rotageek Rotageek helps businesses optimise staff scheduling through data-driven technology. By combining machine learning and advanced algorithms, we help organisations forecast demand, improve workforce management and give employees greater control over their schedules. Our solutions drive operational efficiency, improve customer experiences and help reduce staff … make defects, risks, coverage and quality decisions clear, actionable and respectful. Why this role is so important Our customers and teams need data they can trust. As Data Architect/Engineering Lead, you’ll help turn a growing analytics estate into a clear, governed and scalable ...

Senior Data Engineer (ML)

Location
Greater London, England, United Kingdom
Handle data migration/integration between Databricks and AWS: storage, permissions, IAM alignment Work within CI/CD and IaC patterns for pipeline deployment; document runbooks and hand over to Evoke teams Collaborate daily with Evoke ML engineering, the CF team, and AWS ProServe counterparts Skills & experience … Must-have Python/PySpark - Expert. Production data pipeline development, not analysis-only AWS data/ML stack - Advanced. S3, Glue and/or EMR, IAM basics; AWS ML stack SageMaker (Pipelines, Feature Store, Endpoints) SQL — Advanced strongly preferred. ML pipeline experience. Pipelines feeding ...

Data Analyst

Hiring Organisation
Impellam Group
Location
London Area, United Kingdom
Data Analyst (Customer Borrowing) Hybrid Working – Local Site – 2 days a week on site. Financial Services Lorien's leading banking client is looking for a Data Analyst to join them. This role will primarily focus on supporting the team to deliver analytics insights for the Customer … platform development and optimization. GitLab source control, CI/CD, and code management. AWS Quick sight and/or Excel. Data pipeline development and support. Data modelling and analytics delivery. Working collaboratively with business and technical stakeholders in an agile environment. Customer Borrowing experience. ...

Head of Technology

Location
Greater London, England, United Kingdom
Head of Technology PE-Backed Financial Data & Intelligence Business Hybrid - London | £130,000 + 20% bonus Maxwell Bond has been exclusively retained to find a Head of Technology for a well-established, market-leading financial data and intelligence business. Recently backed by private equity and growing … internationally, the business is investing seriously in its technology and data capabilities as it enters its next phase of growth. Reporting to the Chief Product Officer, you'll initially be hands-on: understanding the current technology and data estate, identifying opportunities and risks, standing up prototypes ...

Data Engineer

Hiring Organisation
Consortia
Location
London, UK
Employment Type
Full-time
Data EngineerLondon | Hybrid | Full-timeAre you a skilled Data Engineer eager to work with high-volume datasets and cutting-edge technologies? We're looking for a data-driven professional to develop and optimise a scalable data platform that supports advanced analytics … frameworks (Ray, Dask, or Apache Arrow).Strong analytical skills, with the ability to handle large-scale, high-frequency data. Solid understanding of ETL pipelines, data modelling, and database optimisation. Experience working with real-time streaming technologiesThis is a fantastic opportunity to be part of a fast-moving, data ...

Principal Data Engineer - AWS

Hiring Organisation
Capco
Location
London, UK
Employment Type
Full-time
Principal Data Engineer – AWSLocation: London (Hybrid) | Practice Area: Technology & Engineering | Type: PermanentEngineer future-ready data platforms that power financial transformation. The RoleWe're looking for a Principal Data Engineer with AWS to join our growing team of engineering experts driving next-generation transformation … Tier 1 financial services clients. You'll play a pivotal role in designing, building, and deploying cloud-based data pipelines that enable trusted, scalable data platforms. Working across greenfield initiatives and enterprise-scale programmes, your work will directly influence how data is ingested, transformed ...

Technology Product Manager, Finance Technology (AI/ML & Data Strategy)

Location
City of Westminster, England, United Kingdom
This role will be responsible for leading business process redesign, map existing and to-be processes for operational optimization, digital transformation initiatives. With Data at the heart of everything we do, this role will require strong data analytical skills, tracing lineage of data, and developing conceptual and logical data models. The role is expected to drive cross-functional collaboration and effective communication with business and technology partners, to guide, influence and convince others and lay the direction for Product development. Ownership of the Product backlog and roadmap, strategy, outlining ...

“Techno-Functional” Analyst– Capital Markets Data Transformation

Location
Greater London, England, United Kingdom
Role Description The Techno-Functional Business Analyst will support a data transformation and controls remediation program for a top-tier banking client, aligned to an ECB Remediation approach. Support the stand-up and operating model of the remediation (pods structure, intake process, tooling, delivery routines). Drive delivery … closure tracking across stakeholders. Contribute to and maintain the controls gap assessment, supporting prioritization and ensuring closure plans are realistic and tracked. Identify data sourcing gaps, coordinate root-cause discussions, and support agreement of closure plans with business and technology teams. Support delivery of manual controls automation waves ...

Senior Data Engineer

Hiring Organisation
McKesson
Location
London, UK
Employment Type
Full-time
Role OverviewThe Senior Data Engineer is the technical owner of the ClarusONE data platform. This is a hands-on engineering role with real ownership: alongside building and delivering data pipelines, you will raise the engineering standard of the platform — improving its reliability, scalability, security … lens to infrastructure, deployment practices, and architecture, and act as a trusted technical voice within the team. You will operate within the ClarusONE data governance framework, ensuring sensitive data is properly protected and that data can be traced end to end through its lifecycle. ...

Senior Data Engineer – Databricks & DLT

Location
City Of London, England, United Kingdom
Senior Data Engineer – Databricks & DLT (Delta Live Tables) Certain Advantage are recruiting on behalf of our trading client for a Senior Data Engineerwith strong analytical capabilities and hands‐on experience in building scalable data solutions using a programming language like Python or Scala … well as experience in Databricks and Delta Live Tables - This experience is essential. Suitable candidates will have expertise inDatabricks,streaming architectures, data ingestion frameworks, anddashboarding, along with experience working withSAP data sources. You will be responsible for designing and implementing scalable data pipelines ...

Global Risk Manager

Location
Greater London, England, United Kingdom
three core areas of responsibility: CRR Framework Ownership — serving as the end-to-end owner of the Case Risk Rating (CRR) methodology, data requirements, scoring logic and documentation Portfolio Risk Reporting & Performance Analysis — tracking how the CRR framework performs across the case portfolio, identifying trends, and translating data … ensuring alignment between functional requirements and product development priorities Work closely with the CRR product team to stay informed on data pipeline health, input completeness, and any system-side issues that may affect the quality or reliability of risk scores Support adoption and understanding ...

Compute Infrastructure Platforms Lead Data Engineer

Hiring Organisation
JP Morgan Chase
Location
London, UK
Employment Type
Full-time
skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference. As a Lead Data Engineer at JPMorganChase within the [insert LOB or sub LOB], you are an integral part of an agile team that works to enhance, build … database back-up, recovery, and archiving strategyPreferred qualifications, capabilities, and skillsProven experience working in SRE or Infrastructure Deployment roles,Mid level data pipeline or analytical product creationProven Data Quality issue root cause analysisJ.P. Morgan is a global leader in financial services, providing strategic advice ...

Machine Learning Research Engineer (Foundational Research)

Hiring Organisation
Thomson Reuters
Location
London, UK
Employment Type
Full-time
Engineers with the skills and drive to build and conduct experiments with advanced AI systems in an academic environment rich with high-quality data from real-world problems. Foundational Research is the dedicated core Machine Learning research division of Thomson Reuters. We are focused on research and development … techniques for planning, reasoning & complex workflows (e.g., reasoning models, LLMs + knowledge graphs, test time compute, CoT pipelines, tool use & API calling, etc.)Data-centric Machine Learning (Synthetic data, curriculum learning, learned data mixtures, etc.)Evaluation (Benchmarking best practices, humans/LLMs ...

Professional / E - Data, BI & Analytics Generalists & Leadership

Location
Greater London, England, United Kingdom
delivering, and whether what we build is working. You will inherit a strong foundation—a working FTE allocation report, a data pipeline in active development, and a clear roadmap of what comes next. The challenge is to complete that pipeline, extend it into new reporting domains … throughput), establish baseline measurements, and make delivery performance visible to engineering and product leadership Work alongside data engineers to bring the automated pipeline into production—replacing manual refresh processes with scheduled, monitored, production-grade solutions, owning SQL logic, column/grain definitions, and QA Connect engineering effort ...

SAP Data & Analytics Lead

Location
Greater London, England, United Kingdom
LocationLondon, England, United Kingdom# SAP Data & Analytics Lead at N Consulting LtdLocationLondon, England, United KingdomSalary£80 - £90/yearJob TypeFull-timeDate PostedApril 1st, 2026Apply Now**Role:**SAP Data & Analytics Lead**Experience:**12years**Location:**London**Work mode:** Hybrid**Responsibilities:*** Lead the design, architecture, and implementation of enterprise … level data models and analytics solutions using SAP Datasphere and SAC.* Build, optimize, and maintain data pipelines, ODS models, and data integration(In/out) in Datasphere for various Finance and cross-functional domains.* Collaborate closely with Finance stakeholders to understand requirements and translate ...

Data Engineer

Location
Greater London, England, United Kingdom
JD.com is seeking a Data Engineer to design, build, and maintain scalable data pipelines and platforms that power our analytics and machine learning systems. You will work closely with product managers, data scientists, and business stakeholders to ensure data availability, quality … data scientists and product teams to deliver reliable, well-structured datasets for experimentation and decision-making. Implement monitoring and automation to improve pipeline efficiency and minimize downtime. Contribute to the development of the overall data infrastructure roadmap for JD.com’s global operations. Qualifications Bachelor ...

Senior Data Engineer

Location
City Of London, England, United Kingdom
support flexible working - click here for more information on flexible working options Flexible Working Options Hybrid Working JOB TITLE Senior Data Engineer SALARY £76,760 - £95,950 LOCATION London HOURS Full-Time WORKING PATTERN Our work style is hybrid, which involves spending at least two days per week … adjustments including hybrid working expectations in line with our Flexibility Works policy. What you’ll be doing... We’re looking for a Senior Data Engineer to join our Data Platform team and help build the foundations that power Curve’s data-driven culture. Working ...

Senior Data Engineer

Hiring Organisation
FBI &TMT
Location
Kingston Upon Thames, Surrey, South East, United Kingdom
Employment Type
Permanent
Salary
£65,000
Senior Data Engineer (Databricks) Salary £65,000 Type Full time, permanent Hours 37.5 per week Location Remote or Hybrid UK, with occasional Richmond office attendance (a couple of times per month) Overview We are looking for a Senior Data Engineer to join the Retail Insight Data … Understanding of data modelling, ETL and ELT patterns, distributed processing * Experience implementing data quality checks and pipeline monitoring * Strong communication and stakeholder management Desirable * Databricks certification * Unity Catalog and Databricks Asset Bundles * Terraform or Bicep * dbt or similar transformation frameworks * Retail or CPG data ...

ETL Data Engineer - Fintech

Hiring Organisation
Quant Capital
Location
London, UK
Employment Type
Full-time
Data Engineer – Fintech To 75,000 West LondonQuant Capital is urgently looking for an ETL Data Engineer to join our high profile client. Quant Capital is urgently looking for an ETL Data Engineer to join or well known Fintech50 client who produces software disrupting … wealth management market. Currently they stand at 300 in the UK with almost 3000 clients. Day to Day the Data Engineer will: Design, build, monitor and manage large scale batch and streaming data pipelines in AWS cloud environment Data Analysis Data modelling ...

Site Reliability Engineer - Service Assurance Systems

Location
Greater London, England, United Kingdom
Global Operations, develop and maintain many software systems and applications which support the operation of Viasat services. The team collects assurance and operational data from a wide range of systems across the Viasat estate. This data is shared between internal platforms and distributed through Google Cloud … need Familiarity with both Windows and Linux operating systems, including command-line administration and troubleshooting. Solid experience with SQL or data pipeline technologies, Experience with data processing frameworks such as Apache Airflow, Apache Flink or Google Dataflow, with a practical understanding of ETL pipeline ...

Data Scientist

Location
Greater London, England, United Kingdom
makes you unique is welcome; join us and let's build what's next - together! About The Role We are seeking a versatile Data Scientist to join the Functional Analytics team. The core mission of our team is to design and develop new functional analytic capabilities or "engines … grade Python code: High proficiency in Python, Pandas, and modern software practices (testing, clean code, code review, CI/CD). Data & Pipeline Expertise: Hands-on experience optimizing data models and access patterns for modern data warehouses (Snowflake, Databricks) utilizing SQL and transformation ...