26 to 50 of 80 Data Pipeline Jobs in Central London

We are partnered with an elite systematic investment fund in the UAE seeking Data Scientists and Data Researchers with a strong interest in AI and Finance to join their growing team. This role sits at the intersection of quantitative research and data science, with a focus on advancing systematic investing through innovative data solutions. Key Responsibilities: Data Ingestion & Cleansing: Develop pipelines to integrate and clean large, complex datasets (commodities, equities, alternative data). Data Analysis: Apply statistical and machine learning techniques to uncover actionable insights for investment strategies. Data Infrastructure: Maintain and optimise automated systems for data collection, storage, and retrieval … the financial accuracy and relevance of AI-driven outputs. Key Requirements: Bachelor’s degree in Finance, Computer Science, or a related discipline 2+ years of experience in finance, data science, or a closely related field Strong understanding of macroeconomics, financial markets, and investment principles Proficiency in Python, with experience in data manipulation libraries such as pandas More ❯

We are partnered with an elite systematic investment fund in the UAE seeking Data Scientists and Data Researchers with a strong interest in AI and Finance to join their growing team. This role sits at the intersection of quantitative research and data science, with a focus on advancing systematic investing through innovative data solutions. Key Responsibilities: Data Ingestion & Cleansing: Develop pipelines to integrate and clean large, complex datasets (commodities, equities, alternative data). Data Analysis: Apply statistical and machine learning techniques to uncover actionable insights for investment strategies. Data Infrastructure: Maintain and optimise automated systems for data collection, storage, and retrieval … the financial accuracy and relevance of AI-driven outputs. Key Requirements: Bachelor’s degree in Finance, Computer Science, or a related discipline 2+ years of experience in finance, data science, or a closely related field Strong understanding of macroeconomics, financial markets, and investment principles Proficiency in Python, with experience in data manipulation libraries such as pandas More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper … access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data More ❯

CPG, and Public Services. Consolidated revenues as of 12 months ending December 2024 totaled $13.8 billion. Job Summary: We are seeking a highly skilled and experienced AWS Lead Data Engineer, who will build, and lead the development of scalable data pipelines and platforms on AWS. The ideal candidate will have deep expertise in PySpark, Glue, Athena … AWS LakeFormation, data modelling, DBT, Airflow, Docker and will be responsible for driving best practices in data engineering, governance, and DevOps. Key Responsibilities: • Lead the design and implementation of scalable, secure, and high-performance data pipelines using PySpark and AWS Glue. • Architect and manage data lakes using AWS Lake Formation, ensuring proper … access control and data governance. • Develop and optimize data models (dimensional and normalized) to support analytics and reporting. • Collaborate with analysts and business stakeholders to understand data requirements and deliver robust solutions. • Implement and maintain CI/CD pipelines for data workflows using tools like AWS CodePipeline, Git, GitHub Actions. • Ensure data More ❯

Data Consultant – Aviation Industry Specialist - £800 - £1000 Our client is seeking a data-focused consultant with deep aviation expertise (ideally within airlines, low-cost carriers, or airports). The consultant will work directly with business units and senior leadership to identify and deliver measurable operational and commercial improvements through data-driven initiatives . This … opportunity is ideal for a professional who can blend strong aviation domain knowledge with modern data engineering and analytics experience , while confidently engaging stakeholders at all levels of the organisation. Candidate Profile Industry Expertise Proven aviation experience (airlines, LCCs, airports; adjacent industries considered). Strong track record of delivering successful data products and projects. Evidence of … generating tangible value (£ millions in opportunities or savings). Understanding of flight operations, ground handling, network planning, revenue management, or MRO. Data & Technology Knowledge (~10% focus) Familiarity with Data Mesh principles and decentralised data governance. Experience with Databricks for data pipelines, analytics, and ML environments. Knowledge of data as a More ❯

Data Consultant – Aviation Industry Specialist - £800 - £1000 Our client is seeking a data-focused consultant with deep aviation expertise (ideally within airlines, low-cost carriers, or airports). The consultant will work directly with business units and senior leadership to identify and deliver measurable operational and commercial improvements through data-driven initiatives . This … opportunity is ideal for a professional who can blend strong aviation domain knowledge with modern data engineering and analytics experience , while confidently engaging stakeholders at all levels of the organisation. Candidate Profile Industry Expertise Proven aviation experience (airlines, LCCs, airports; adjacent industries considered). Strong track record of delivering successful data products and projects. Evidence of … generating tangible value (£ millions in opportunities or savings). Understanding of flight operations, ground handling, network planning, revenue management, or MRO. Data & Technology Knowledge (~10% focus) Familiarity with Data Mesh principles and decentralised data governance. Experience with Databricks for data pipelines, analytics, and ML environments. Knowledge of data as a More ❯

BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental … data into actionable insight. What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align More ❯

BI – SC Cleared We’re standing up a brand-new enterprise reporting solution within a large-scale government programme and we need a hands-on Technical Lead (Lead Data Engineer) to shape the technical design from day one. This role goes beyond standard dashboarding. You’ll define the end-to-end data architecture (sourcing, ETL, orchestration … data modelling) that underpins critical KPIs for monitoring performance across multiple services. Your design will directly inform how senior leaders track and improve delivery at scale. You’ll be working closely with architects, product teams, and business analysts leading a small, focused team (BA, Power BI Analyst, Delivery Manager) to turn complex, cross-departmental … data into actionable insight. What you’ll be doing Define the high-level technical design for a new KPI reporting solution. Architect the full data pipeline: sourcing, ETL/ELT, database layer, orchestration, and models. Guide the Power BI build and integration, ensuring performance and governance are baked in. Partner with senior stakeholders to align More ❯

My Financial Services client is seeking to recruit an Oracle Data Warehouse Architect on an initial 6 month contract for a Financial Services client based in London. It is hybrid and will require 3x days onsite per week. You will design, optimize, and maintain Oracle-based data warehouse solutions to ensure high performance, scalability, and alignment … with business intelligence and analytics needs. This role requires the individual to design and optimize Oracle-based data warehouse systems, ensuring they are scalable, high-performing, and aligned with business analytics needs. They will collaborate closely with the head of the data team and .NET developers, applying advanced data modelling, performance tuning, and problem … insights into clear, actionable recommendations for both technical and non-technical stakeholders. Skills Required: Strong experience in designing and developing efficient ETL processes to support enterprise-scale Oracle Data Warehouse environments. Proven ability to optimize and tune complex SQL and PL/SQL scripts for performance, while guiding development teams on best practices for data modelling More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Senior Data Engineer – AI & Neuroscience Location: London (Hybrid, Kings Cross) or San Francisco (Onsite/Hybrid) Employment: Full-time About the Company We are partnered with a pioneering biotech building the world’s first brain foundation models — large-scale AI systems designed to deeply understand, protect, and enhance the human brain. By generating our own data … direct influence on the technical systems that will underpin scientific and clinical breakthroughs. The work is ambitious, interdisciplinary, and sits at the cutting edge of AI, biology, and data engineering. The Role We are seeking a Senior Data Engineer to lead the design and scaling of the company’s core data infrastructure. You will … work will provide the backbone for training next-generation AI models, enabling researchers to extract real-world insights from raw biological data. Key Responsibilities Design and implement distributed data pipelines for multi-omic, neuroscience, and clinical datasets Build a unified feature store to serve ML training and downstream biological analysis Develop scalable storage, ingestion, and validation systems with More ❯

Laundering (AML), Know Your Customer (KYC), Fraud Detection, Regulatory Reporting, and Transaction Monitoring. Advisory Services: Offer consulting on compliance scalability, operating models, regulatory guardrails, compliance governance, and integrated data management. Technology Integration: Leverage cutting-edge platforms, including AI and machine learning models, to deliver state-of-the-art compliance solutions. Thought Leadership: Represent Capgemini as a thought leader … architectures using cloud data platforms (AWS, Azure, GCP) and integrating with financial systems. Demonstrated knowledge in compliance model training, fine-tuning, and deployment, including data pipeline integration. Proficiency in designing compliance systems capable of autonomous decision-making and task execution, especially in financial contexts. Experience with compliance governance, ethical considerations, and ensuring adherence to financial … build, mentor, and lead onshore and offshore compliance teams. Client Engagement: Excellent client interaction, problem-solving, and communication skills, with experience working with C-level stakeholders. Educational Background: Data science or STEM degree preferred, with a solid foundation in compliance, AI, ML, and advanced analytics. Innovation and Thought Leadership: Passionate about cutting-edge compliance advancements and delivering innovative More ❯

Laundering (AML), Know Your Customer (KYC), Fraud Detection, Regulatory Reporting, and Transaction Monitoring. Advisory Services: Offer consulting on compliance scalability, operating models, regulatory guardrails, compliance governance, and integrated data management. Technology Integration: Leverage cutting-edge platforms, including AI and machine learning models, to deliver state-of-the-art compliance solutions. Thought Leadership: Represent Capgemini as a thought leader … architectures using cloud data platforms (AWS, Azure, GCP) and integrating with financial systems. Demonstrated knowledge in compliance model training, fine-tuning, and deployment, including data pipeline integration. Proficiency in designing compliance systems capable of autonomous decision-making and task execution, especially in financial contexts. Experience with compliance governance, ethical considerations, and ensuring adherence to financial … build, mentor, and lead onshore and offshore compliance teams. Client Engagement: Excellent client interaction, problem-solving, and communication skills, with experience working with C-level stakeholders. Educational Background: Data science or STEM degree preferred, with a solid foundation in compliance, AI, ML, and advanced analytics. Innovation and Thought Leadership: Passionate about cutting-edge compliance advancements and delivering innovative More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key … drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

Senior Data Engineer is required to join a forward-thinking data team within a thriving city-based insurance group. This role will see you playing a critical role in delivering reliable, scalable and business-focused data solutions. With a strong focus on Microsoft technologies and cloud-based tools, you’ll work directly with key … drive performance and decision-making through data. The ideal candidate here will have a strong background in MI or reporting—experience within insurance is essential. Key Responsibilities Deliver data solutions and changes that support evolving business requirements. Build and maintain robust, scalable data pipelines using SQL and ETL best practices. Collaborate with stakeholders to analyse, define … and implement solutions to complex data challenges. Proactively assess the impact of changes on the broader data model and ensure integrity is maintained. Work alongside the MI/reporting team to ensure data is accurately reflected in dashboards and reporting tools. Consult with business analysts, system owners and architects to align technical delivery with More ❯

Data Platform Engineer London - Hybrid £80,000-£90,0000 + 38 Days Holiday + Private Healthcare + Life Assurance + Flexible Working + Pension + Package Excellent opportunity for a Data-focused Site Reliability Engineer or a Data Platform Engineer with some DevOps principals to join a forward-thinking and high-growth Fintech company … further progression! This company are a bleeding-edge technology business driving innovation across the global financial services sector. Their platform processes vast amounts of real-time and batch data, supporting business critical reporting and analytics. With a strong culture rooted in integrity, creativity, and technical excellence, they've become a trusted partner across a wide range of businesses. … of large-scale date pipelines built on AWS, Apache Flink, Kafka, and Python. You'll play a key role in diagnosing incidents, optimising system behaviour, and ensuring reporting data is delivered on time and without failure. The ideal candidate will have a strong experience working with streaming and batch data systems, a solid understanding of monitoring More ❯

Senior Data Engineer – £80,000pa – Hybrid (2 Days Central London) We’re working with a leading software company developing an innovative Health & Wellbeing app that helps users track their nutrition, fitness, and personal health stats . We’re now looking for a Senior Data Engineer to join the team and help build and scale the data infrastructure that powers this mission-driven platform. 🔹 The Role As a Senior Data Engineer, you’ll: Design, build, and maintain robust data pipelines Work with large-scale datasets to enable meaningful insights Collaborate with product and engineering teams to support new features Optimise data workflows for performance and scalability Contribute to the … overall data strategy and architecture 🔹 Tech Stack You’ll be working with: Programming: Python, SQL, Scala/Java Big Data: Spark, Hadoop, Databricks Pipelines: Airflow, Kafka, ETL tools Cloud: AWS, GCP, or Azure (Glue, Redshift, BigQuery, Snowflake) Data Modelling & Warehousing 🔹 What’s on Offer 💷 £80,000pa (Permanent role) 📍 Hybrid – 2 days per week in More ❯

Senior Data Engineer – £80,000pa – Hybrid (2 Days Central London) We’re working with a leading software company developing an innovative Health & Wellbeing app that helps users track their nutrition, fitness, and personal health stats . We’re now looking for a Senior Data Engineer to join the team and help build and scale the data infrastructure that powers this mission-driven platform. 🔹 The Role As a Senior Data Engineer, you’ll: Design, build, and maintain robust data pipelines Work with large-scale datasets to enable meaningful insights Collaborate with product and engineering teams to support new features Optimise data workflows for performance and scalability Contribute to the … overall data strategy and architecture 🔹 Tech Stack You’ll be working with: Programming: Python, SQL, Scala/Java Big Data: Spark, Hadoop, Databricks Pipelines: Airflow, Kafka, ETL tools Cloud: AWS, GCP, or Azure (Glue, Redshift, BigQuery, Snowflake) Data Modelling & Warehousing 🔹 What’s on Offer 💷 £80,000pa (Permanent role) 📍 Hybrid – 2 days per week in More ❯

Senior Data Analyst £65,000 - £75,000 Liverpool Street, London (1/2 days per week) A PE-backed client of ours are looking for a Senior Data Analyst to join their growing data function. They're looking for a Power BI SME who has a real passion for driving analytics and insights. They … have a stack of Snowflake, dbt, Python & Power BI. They're looking for someone who has end-to-end analytics experience and a genuine drive for data analytics and the impact it has on business performance. In this role you'll work cross-functionally across the entire c.1500 employee organisation. Expirience working in operations would also be favourable. … analytical with a business mindset to improve business performance. Have excellent communication skills with a consultative approach and a strong interest in influencing stakeholders. Tool experience required: Strong data visualisation using Power BI and coding ability using either normalisation, SQL, or Python). Desirable: Experience working in a Data warehouse, or lake environments e.g. Snowflake, Redshift More ❯

Senior Data Analyst £65,000 - £75,000 Liverpool Street, London (1/2 days per week) A PE-backed client of ours are looking for a Senior Data Analyst to join their growing data function. They're looking for a Power BI SME who has a real passion for driving analytics and insights. They … have a stack of Snowflake, dbt, Python & Power BI. They're looking for someone who has end-to-end analytics experience and a genuine drive for data analytics and the impact it has on business performance. In this role you'll work cross-functionally across the entire c.1500 employee organisation. Expirience working in operations would also be favourable. … analytical with a business mindset to improve business performance. Have excellent communication skills with a consultative approach and a strong interest in influencing stakeholders. Tool experience required: Strong data visualisation using Power BI and coding ability using either normalisation, SQL, or Python). Desirable: Experience working in a Data warehouse, or lake environments e.g. Snowflake, Redshift More ❯

Data Scientist (PropTech) London - Hybrid (3 days in office) Up to £70,000 About the Role An established data-led business is looking for a commercially-minded Data Scientist to join their growing London team. You’ll collaborate with cross-functional teams to design, build, and implement data science solutions that directly … into core product offerings. This is an exciting opportunity to apply ML and statistical techniques to real-world problems, while also developing in areas such as software engineering, data pipelines, and ethical product delivery. Key Responsibilities Collaborate with product teams to identify opportunities for ML and data science integration Build and maintain data pipelines … learning models in production environments Present insights and results to technical and non-technical stakeholders Apply statistical methods and model validation techniques to reach accurate conclusions Work with data engineers to ensure clean, usable datasets Contribute to ethical, privacy-aware, and user-centric data products Stay curious, research new methods, and continually build your technical capability More ❯

CRM DATA ANALYST HYBRID – LONDON – 2 DAYS A WEEK SALARY UP TO £46,000 Please note, this company is unable to offer sponsorship, and you must be a UK resident to apply THE COMPANY This global premium lifestyle brand is renowned for its iconic fashion, homeware, and fragrance collections. With a long-standing reputation for timeless style and … quality craftsmanship, the business continues to innovate across retail, e-commerce, and digital engagement. Data sits at the heart of its customer strategy, and the CRM team plays a pivotal role in driving customer acquisition, retention, and engagement. THE ROLE As a CRM Data Analyst, you’ll join the Customer Experience (CX) team and support the … CRM and analytics function. You’ll be responsible for pulling, analysing, and presenting customer data to influence decision-making and drive more effective campaigns. With a focus on storytelling through data, you’ll help shape the CRM strategy, improve customer segmentation, and support the growth of acquisition and engagement initiatives. Your responsibilities will include: Supporting the More ❯

CRM DATA ANALYST HYBRID – LONDON – 2 DAYS A WEEK SALARY UP TO £46,000 Please note, this company is unable to offer sponsorship, and you must be a UK resident to apply THE COMPANY This global premium lifestyle brand is renowned for its iconic fashion, homeware, and fragrance collections. With a long-standing reputation for timeless style and … quality craftsmanship, the business continues to innovate across retail, e-commerce, and digital engagement. Data sits at the heart of its customer strategy, and the CRM team plays a pivotal role in driving customer acquisition, retention, and engagement. THE ROLE As a CRM Data Analyst, you’ll join the Customer Experience (CX) team and support the … CRM and analytics function. You’ll be responsible for pulling, analysing, and presenting customer data to influence decision-making and drive more effective campaigns. With a focus on storytelling through data, you’ll help shape the CRM strategy, improve customer segmentation, and support the growth of acquisition and engagement initiatives. Your responsibilities will include: Supporting the More ❯

Data Engineer - Award-Winning AI SaaS platform We're partnered with a pioneering SaaS company that's transforming their industry through cutting-edge AI and data technology. With a multi-award-winning platform and a client base that includes global household names, this is a rare opportunity to join a high-growth tech business that blends … startup agility with enterprise stability. We're looking for a passionate Data Engineer who is experienced with AI tooling - including building Gen AI agents in-product - to join their growing Data Engineering ream. Why You'll Love This Role: Tech at Scale : Work with hundreds of millions of data points daily, using distributed systems … office if you prefer Exceptional Benefits : From unlimited holiday and private healthcare to stock options and paid parental leave. What You'll Be Doing: Build and maintain scalable data pipelines using Spark with Scala and Java, and support tooling in Python Design low-latency APIs and asynchronous processes for high-volume data. Collaborate with Data Science More ❯

Data Engineer I am working with a leading, AI driven organisation that supports its clients' marketing campaigns, expanding its data engineering capabilities and looking for a Data Engineer to join their team. This is a fantastic opportunity to join an award-winning tech business where you will have the opportunity to work at the … forefront of data architecture, building distributed systems and leveraging Gen AI tools to accelerate development and improve quality. You will be encouraged to explore new ways to utilise modern technologies and will be positioned to help mentor other members of the technical team whilst leading innovative technical projects. As part of this role, you will be responsible for … some of the following areas: Design and build distributed data pipelines using languages such as Spark, Scala, and Java Collaborate with cross-functional teams to deliver user-centric solutions Lead on the design and development of relational and non-relational databases Apply Gen AI tools to boost development speed and code quality Maintain and optimise large-scale data More ❯