26 to 50 of 79 Data Pipeline Jobs in the City of London

We are partnered with an elite systematic investment fund in the UAE seeking Data Scientists and Data Researchers with a strong interest in AI and Finance to join their growing team. This role sits at the intersection of quantitative research and data science, with a focus on advancing systematic investing through innovative data solutions. Key Responsibilities: Data Ingestion & Cleansing: Develop pipelines to integrate and clean large, complex datasets (commodities, equities, alternative data). Data Analysis: Apply statistical and machine learning techniques to uncover actionable insights for investment strategies. Data Infrastructure: Maintain and optimise automated systems for data collection, storage, and retrieval … the financial accuracy and relevance of AI-driven outputs. Key Requirements: Bachelor’s degree in Finance, Computer Science, or a related discipline 2+ years of experience in finance, data science, or a closely related field Strong understanding of macroeconomics, financial markets, and investment principles Proficiency in Python, with experience in data manipulation libraries such as pandas More ❯

Data Consultant – Aviation Industry Specialist - £800 - £1000 Our client is seeking a data-focused consultant with deep aviation expertise (ideally within airlines, low-cost carriers, or airports). The consultant will work directly with business units and senior leadership to identify and deliver measurable operational and commercial improvements through data-driven initiatives . This … opportunity is ideal for a professional who can blend strong aviation domain knowledge with modern data engineering and analytics experience , while confidently engaging stakeholders at all levels of the organisation. Candidate Profile Industry Expertise Proven aviation experience (airlines, LCCs, airports; adjacent industries considered). Strong track record of delivering successful data products and projects. Evidence of … generating tangible value (£ millions in opportunities or savings). Understanding of flight operations, ground handling, network planning, revenue management, or MRO. Data & Technology Knowledge (~10% focus) Familiarity with Data Mesh principles and decentralised data governance. Experience with Databricks for data pipelines, analytics, and ML environments. Knowledge of data as a More ❯

Data Consultant – Aviation Industry Specialist - £800 - £1000 Our client is seeking a data-focused consultant with deep aviation expertise (ideally within airlines, low-cost carriers, or airports). The consultant will work directly with business units and senior leadership to identify and deliver measurable operational and commercial improvements through data-driven initiatives . This … opportunity is ideal for a professional who can blend strong aviation domain knowledge with modern data engineering and analytics experience , while confidently engaging stakeholders at all levels of the organisation. Candidate Profile Industry Expertise Proven aviation experience (airlines, LCCs, airports; adjacent industries considered). Strong track record of delivering successful data products and projects. Evidence of … generating tangible value (£ millions in opportunities or savings). Understanding of flight operations, ground handling, network planning, revenue management, or MRO. Data & Technology Knowledge (~10% focus) Familiarity with Data Mesh principles and decentralised data governance. Experience with Databricks for data pipelines, analytics, and ML environments. Knowledge of data as a More ❯

BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental … data into actionable insight. What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align More ❯

BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental … data into actionable insight. What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align More ❯

My Financial Services client is seeking to recruit an Oracle Data Warehouse Architect on an initial 6 month contract for a Financial Services client based in London. It is hybrid and will require 3x days onsite per week. You will design, optimize, and maintain Oracle-based data warehouse solutions to ensure high performance, scalability, and alignment … with business intelligence and analytics needs. This role requires the individual to design and optimize Oracle-based data warehouse systems, ensuring they are scalable, high-performing, and aligned with business analytics needs. They will collaborate closely with the head of the data team and .NET developers, applying advanced data modelling, performance tuning, and problem … insights into clear, actionable recommendations for both technical and non-technical stakeholders. Skills Required: Strong experience in designing and developing efficient ETL processes to support enterprise-scale Oracle Data Warehouse environments. Proven ability to optimize and tune complex SQL and PL/SQL scripts for performance, while guiding development teams on best practices for data modelling More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Data Platform Engineer London - Hybrid £80,000-£90,0000 + 38 Days Holiday + Private Healthcare + Life Assurance + Flexible Working + Pension + Package Excellent opportunity for a Data-focused Site Reliability Engineer or a Data Platform Engineer with some DevOps principals to join a forward-thinking and high-growth Fintech company … further progression! This company are a bleeding-edge technology business driving innovation across the global financial services sector. Their platform processes vast amounts of real-time and batch data, supporting business critical reporting and analytics. With a strong culture rooted in integrity, creativity, and technical excellence, they've become a trusted partner across a wide range of businesses. … of large-scale date pipelines built on AWS, Apache Flink, Kafka, and Python. You'll play a key role in diagnosing incidents, optimising system behaviour, and ensuring reporting data is delivered on time and without failure. The ideal candidate will have a strong experience working with streaming and batch data systems, a solid understanding of monitoring More ❯

Senior Data Engineer – £80,000pa – Hybrid (2 Days Central London) We’re working with a leading software company developing an innovative Health & Wellbeing app that helps users track their nutrition, fitness, and personal health stats . We’re now looking for a Senior Data Engineer to join the team and help build and scale the data infrastructure that powers this mission-driven platform. 🔹 The Role As a Senior Data Engineer, you’ll: Design, build, and maintain robust data pipelines Work with large-scale datasets to enable meaningful insights Collaborate with product and engineering teams to support new features Optimise data workflows for performance and scalability Contribute to the … overall data strategy and architecture 🔹 Tech Stack You’ll be working with: Programming: Python, SQL, Scala/Java Big Data: Spark, Hadoop, Databricks Pipelines: Airflow, Kafka, ETL tools Cloud: AWS, GCP, or Azure (Glue, Redshift, BigQuery, Snowflake) Data Modelling & Warehousing 🔹 What’s on Offer 💷 £80,000pa (Permanent role) 📍 Hybrid – 2 days per week in More ❯

Senior Data Engineer – £80,000pa – Hybrid (2 Days Central London) We’re working with a leading software company developing an innovative Health & Wellbeing app that helps users track their nutrition, fitness, and personal health stats . We’re now looking for a Senior Data Engineer to join the team and help build and scale the data infrastructure that powers this mission-driven platform. 🔹 The Role As a Senior Data Engineer, you’ll: Design, build, and maintain robust data pipelines Work with large-scale datasets to enable meaningful insights Collaborate with product and engineering teams to support new features Optimise data workflows for performance and scalability Contribute to the … overall data strategy and architecture 🔹 Tech Stack You’ll be working with: Programming: Python, SQL, Scala/Java Big Data: Spark, Hadoop, Databricks Pipelines: Airflow, Kafka, ETL tools Cloud: AWS, GCP, or Azure (Glue, Redshift, BigQuery, Snowflake) Data Modelling & Warehousing 🔹 What’s on Offer 💷 £80,000pa (Permanent role) 📍 Hybrid – 2 days per week in More ❯

Senior Data Analyst £65,000 - £75,000 Liverpool Street, London (1/2 days per week) A PE-backed client of ours are looking for a Senior Data Analyst to join their growing data function. They're looking for a Power BI SME who has a real passion for driving analytics and insights. They … have a stack of Snowflake, dbt, Python & Power BI. They're looking for someone who has end-to-end analytics experience and a genuine drive for data analytics and the impact it has on business performance. In this role you'll work cross-functionally across the entire c.1500 employee organisation. Expirience working in operations would also be favourable. … analytical with a business mindset to improve business performance. Have excellent communication skills with a consultative approach and a strong interest in influencing stakeholders. Tool experience required: Strong data visualisation using Power BI and coding ability using either normalisation, SQL, or Python). Desirable: Experience working in a Data warehouse, or lake environments e.g. Snowflake, Redshift More ❯

Senior Data Analyst £65,000 - £75,000 Liverpool Street, London (1/2 days per week) A PE-backed client of ours are looking for a Senior Data Analyst to join their growing data function. They're looking for a Power BI SME who has a real passion for driving analytics and insights. They … have a stack of Snowflake, dbt, Python & Power BI. They're looking for someone who has end-to-end analytics experience and a genuine drive for data analytics and the impact it has on business performance. In this role you'll work cross-functionally across the entire c.1500 employee organisation. Expirience working in operations would also be favourable. … analytical with a business mindset to improve business performance. Have excellent communication skills with a consultative approach and a strong interest in influencing stakeholders. Tool experience required: Strong data visualisation using Power BI and coding ability using either normalisation, SQL, or Python). Desirable: Experience working in a Data warehouse, or lake environments e.g. Snowflake, Redshift More ❯

Data Scientist (PropTech) London - Hybrid (3 days in office) Up to £70,000 About the Role An established data-led business is looking for a commercially-minded Data Scientist to join their growing London team. You’ll collaborate with cross-functional teams to design, build, and implement data science solutions that directly … into core product offerings. This is an exciting opportunity to apply ML and statistical techniques to real-world problems, while also developing in areas such as software engineering, data pipelines, and ethical product delivery. Key Responsibilities Collaborate with product teams to identify opportunities for ML and data science integration Build and maintain data pipelines … learning models in production environments Present insights and results to technical and non-technical stakeholders Apply statistical methods and model validation techniques to reach accurate conclusions Work with data engineers to ensure clean, usable datasets Contribute to ethical, privacy-aware, and user-centric data products Stay curious, research new methods, and continually build your technical capability More ❯

CRM DATA ANALYST HYBRID – LONDON – 2 DAYS A WEEK SALARY UP TO £46,000 Please note, this company is unable to offer sponsorship, and you must be a UK resident to apply THE COMPANY This global premium lifestyle brand is renowned for its iconic fashion, homeware, and fragrance collections. With a long-standing reputation for timeless style and … quality craftsmanship, the business continues to innovate across retail, e-commerce, and digital engagement. Data sits at the heart of its customer strategy, and the CRM team plays a pivotal role in driving customer acquisition, retention, and engagement. THE ROLE As a CRM Data Analyst, you’ll join the Customer Experience (CX) team and support the … CRM and analytics function. You’ll be responsible for pulling, analysing, and presenting customer data to influence decision-making and drive more effective campaigns. With a focus on storytelling through data, you’ll help shape the CRM strategy, improve customer segmentation, and support the growth of acquisition and engagement initiatives. Your responsibilities will include: Supporting the More ❯

CRM DATA ANALYST HYBRID – LONDON – 2 DAYS A WEEK SALARY UP TO £46,000 Please note, this company is unable to offer sponsorship, and you must be a UK resident to apply THE COMPANY This global premium lifestyle brand is renowned for its iconic fashion, homeware, and fragrance collections. With a long-standing reputation for timeless style and … quality craftsmanship, the business continues to innovate across retail, e-commerce, and digital engagement. Data sits at the heart of its customer strategy, and the CRM team plays a pivotal role in driving customer acquisition, retention, and engagement. THE ROLE As a CRM Data Analyst, you’ll join the Customer Experience (CX) team and support the … CRM and analytics function. You’ll be responsible for pulling, analysing, and presenting customer data to influence decision-making and drive more effective campaigns. With a focus on storytelling through data, you’ll help shape the CRM strategy, improve customer segmentation, and support the growth of acquisition and engagement initiatives. Your responsibilities will include: Supporting the More ❯

Data Engineer - Award-Winning AI SaaS platform We're partnered with a pioneering SaaS company that's transforming their industry through cutting-edge AI and data technology. With a multi-award-winning platform and a client base that includes global household names, this is a rare opportunity to join a high-growth tech business that blends … startup agility with enterprise stability. We're looking for a passionate Data Engineer who is experienced with AI tooling - including building Gen AI agents in-product - to join their growing Data Engineering ream. Why You'll Love This Role: Tech at Scale : Work with hundreds of millions of data points daily, using distributed systems … office if you prefer Exceptional Benefits : From unlimited holiday and private healthcare to stock options and paid parental leave. What You'll Be Doing: Build and maintain scalable data pipelines using Spark with Scala and Java, and support tooling in Python Design low-latency APIs and asynchronous processes for high-volume data. Collaborate with Data Science More ❯

Data Engineer I am working with a leading, AI driven organisation that supports its clients' marketing campaigns, expanding its data engineering capabilities and looking for a Data Engineer to join their team. This is a fantastic opportunity to join an award-winning tech business where you will have the opportunity to work at the … forefront of data architecture, building distributed systems and leveraging Gen AI tools to accelerate development and improve quality. You will be encouraged to explore new ways to utilise modern technologies and will be positioned to help mentor other members of the technical team whilst leading innovative technical projects. As part of this role, you will be responsible for … some of the following areas: Design and build distributed data pipelines using languages such as Spark, Scala, and Java Collaborate with cross-functional teams to deliver user-centric solutions Lead on the design and development of relational and non-relational databases Apply Gen AI tools to boost development speed and code quality Maintain and optimise large-scale data More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

CRM & Data Strategy Analyst London – Hybrid Up to £46,000 + benefits The Company A leading name in the luxury retail space is growing its Customer Experience team and investing in data-driven decision-making. This role sits within a collaborative CRM and data strategy function, driving customer acquisition, retention, and engagement through analytics … and segmentation. The Role As a CRM & Data Strategy Analyst, you’ll work closely with senior analysts and CRM stakeholders to optimise campaigns and deliver actionable insights. You’ll be responsible for analysing customer data, shaping segmentation strategies, and reporting on CRM performance to improve engagement across multiple channels. Key responsibilities include: Analysing and presenting customer … data to inform CRM strategy and campaign optimisation. Building and maintaining customer segmentation for targeted campaigns. Owning reporting across CRM activity, including campaign performance and database health. Supporting data pipelines and automation to streamline CRM processes. Collaborating with senior stakeholders to influence customer engagement strategy. Your Skills and Experience Strong SQL skills (essential). Hands-on More ❯

CRM & Data Strategy Analyst London – Hybrid Up to £46,000 + benefits The Company A leading name in the luxury retail space is growing its Customer Experience team and investing in data-driven decision-making. This role sits within a collaborative CRM and data strategy function, driving customer acquisition, retention, and engagement through analytics … and segmentation. The Role As a CRM & Data Strategy Analyst, you’ll work closely with senior analysts and CRM stakeholders to optimise campaigns and deliver actionable insights. You’ll be responsible for analysing customer data, shaping segmentation strategies, and reporting on CRM performance to improve engagement across multiple channels. Key responsibilities include: Analysing and presenting customer … data to inform CRM strategy and campaign optimisation. Building and maintaining customer segmentation for targeted campaigns. Owning reporting across CRM activity, including campaign performance and database health. Supporting data pipelines and automation to streamline CRM processes. Collaborating with senior stakeholders to influence customer engagement strategy. Your Skills and Experience Strong SQL skills (essential). Hands-on More ❯

Role: Business Analyst – Retention Data (EMEA) 📍 Location: Hybrid – London (3 days office/2 days remote) ⏳ Contract Length: 12 months minimum 💰 Day Rate: £260/day (Inside IR35) I’m hiring for a Business Analyst – Retention Data to join a leading global tech company known for empowering businesses with cutting-edge financial tools and services. This … more than just a reporting role, it’s an opportunity to use your skills in SQL, Python, and BI tools (e.g., Tableau/Qlik) to influence strategy, close data gaps, and directly impact customer outcomes. Key Responsibilities: Build and automate scalable reporting solutions focused on customer retention Create and present dashboards combining internal and external data for senior stakeholders Identify and close gaps in behavioural data capture strategies Deliver actionable insights that improve retention performance across products Partner with cross-functional teams to meet data needs now and in the future What We're Looking For: ✅ Experience as a BI Analyst/Data Analyst , ideally with a retention More ❯

Role: Business Analyst – Retention Data (EMEA) 📍 Location: Hybrid – London (3 days office/2 days remote) ⏳ Contract Length: 12 months minimum 💰 Day Rate: £260/day (Inside IR35) I’m hiring for a Business Analyst – Retention Data to join a leading global tech company known for empowering businesses with cutting-edge financial tools and services. This … more than just a reporting role, it’s an opportunity to use your skills in SQL, Python, and BI tools (e.g., Tableau/Qlik) to influence strategy, close data gaps, and directly impact customer outcomes. Key Responsibilities: Build and automate scalable reporting solutions focused on customer retention Create and present dashboards combining internal and external data for senior stakeholders Identify and close gaps in behavioural data capture strategies Deliver actionable insights that improve retention performance across products Partner with cross-functional teams to meet data needs now and in the future What We're Looking For: ✅ Experience as a BI Analyst/Data Analyst , ideally with a retention More ❯

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. The ideal candidate will have a strong foundation in both developing … causal inference systems Create probabilistic models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into technical specifications Required Skills & Experience … Great experience combining data science with software engineering Strong expertise in machine learning, with focus on causal ML and probabilistic modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices More ❯