176 to 200 of 284 Data Pipeline Jobs in London

to automated hedging strategies-to improve Remitly's overall risk management and liquidity planning. This role is based in London reporting to the Head of Treasury Analytics and Data Science, and involves collaboration across global teams, requiring strong communication and coordination skills. You Will: Develop, deploy, and monitor ML models that forecast FX exposure, optimise hedging, and improve … senior leadership. You Have: Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field. 6+ years of experience in ML Engineering or Data Science (finance, fintech, or treasury a plus). Proficiency in Python-including pandas, scikit learn, TensorFlow/PyTorch, LightGBM/XGBoost-and experience with SQL. Hands on experience with … Familiarity with FX markets, risk management concepts, or financial forecasting. Excellent problem solving skills and ability to explain technical ideas to non technical audiences. Experience with real time data pipelines, event driven architectures (Kafka/Kinesis), or modern data warehouses (Snowflake, Redshift, BigQuery) is a plus. Our Benefits: Paid Vacation Days Health insurance Commuter benefit Employee More ❯

Robert Half has partners with a Financial Services Organisation in London and they are looking for a Data Engineer to join their IT team. This role is a great opportunity for someone who is in the early stages of their career looking to gain lots of experience and lots of progression. This will give you the ability to … gain experience in Data Engineering and Data Science. Role: They are looking to hire a Data Engineer with 1+ years experience inc: Data Pipelines Implementing solutions to engineering issues Python SQL Power BI Role: Data Engineer Salary: £35,000 - £50,000 plus bonus and benefits Location: London (3 days a … are dependent upon your experience, qualifications and training. If you wish to apply, please read our Privacy Notice describing how we may process, disclose and store your personal data: gb/en/privacy-notice. More ❯

Principal Data Engineer (Contract) Hybrid (London-based) | £450-£650/day A leading scientific and cultural institution is seeking a Principal Data Engineer to design and scale cloud-native data infrastructure powering biodiversity research, digitisation, and AI workflows. Key Responsibilities Architect and build scalable data pipelines for ingestion, transformation, enrichment, and publication. … Integrate AI/ML workflows, including training data pipelines and inference outputs. Lead AWS-based data engineering using services like S3, Lambda, Glue, and Athena. Ensure interoperability with global research infrastructures (e.g. DiSSCo UK, RECODE, DToL). Define best practices in data quality, metadata, and reproducibility. Collaborate with cross-functional teams (science, software, product … . Mentor engineers and contribute to institutional data strategy and standards. Tech Requirements Strong Python skills; experience with Airflow, Luigi, or Spark. Proven track record building robust, scalable ETL/ELT systems. Experience with scientific, semi-structured, or biodiversity data. Familiarity with semantic web standards (e.g. Darwin Core, JSON-LD, Linked Data). Knowledge of NoSQL More ❯

Data Engineer - Award-Winning AI SaaS platform We're partnered with a pioneering SaaS company that's transforming their industry through cutting-edge AI and data technology. With a multi-award-winning platform and a client base that includes global household names, this is a rare opportunity to join a high-growth tech business that blends … startup agility with enterprise stability. We're looking for a passionate Data Engineer who is experienced with AI tooling - including building Gen AI agents in-product - to join their growing Data Engineering ream. Why You'll Love This Role: Tech at Scale : Work with hundreds of millions of data points daily, using distributed systems … office if you prefer Exceptional Benefits : From unlimited holiday and private healthcare to stock options and paid parental leave. What You'll Be Doing: Build and maintain scalable data pipelines using Spark with Scala and Java, and support tooling in Python Design low-latency APIs and asynchronous processes for high-volume data. Collaborate with Data Science More ❯

Your first role will be determinded by which team you apply to: - Trading Analytics - Performing fundamental market analysis for your commodity that includes using proprietary and third-party data in order to develop actionable market insights of where you see the market evolving and the opportunities for physical and derivative market positions to support commercial decision making by … team enhances decision-making across our energy trading desks, including the front and middle office team such as Market Risk, by delivering rapid prototyping and expert support in data engineering, software development, and data science and visualization. You will learn how an agile software development team works, code data pipelines and solve big data More ❯

Analytics Engineer (VC Eco-System) Salary: £75K - £90K Location: London - Hybrid (3 days in Farringdon office, 2 days remote) Data Idols are working with a leading UK-based venture capital firm to find an Analytics Engineer who will play a pivotal role in advancing their data origination platform. This platform ingests data from multiple … and helps the investment team identify the most promising early-stage B2B technology businesses. The Opportunity As an Analytics Engineer, you will take ownership of the platform's data pipelines, models, and reporting layers, delivering high-impact insights that directly influence investment decisions. You'll work autonomously to execute a defined roadmap, but also contribute to the longer … thrives in environments where shipping products quickly is valued over building infrastructure for infrastructure's sake. This is an opportunity to shape the future of a high-impact data platform in the VC ecosystem and work directly with decision-makers in a fast-paced, data-driven investment environment. What You'll Be Doing Designing and building More ❯

flow within distributed systems. * Experience integrating ELK with packet capture/analysis tools to enhance observability of real-time systems. * Hands-on expertise in data pipeline creation, ingestion strategies, and performance tuning of Logstash and Beats for scalable telemetry. * Knowledge of Corvil and/or Pico tools is highly beneficial but not essential, particularly for … Python and/or PowerShell to automate ELK deployment, monitoring, and alerting pipelines. * Experience designing and working with APIs (REST/JSON/XML) and integrating third-party data sources into the ELK stack. * Exposure to Solace, 29West, Tibco, or other low latency messaging platforms is advantageous for understanding event-driven architectures in financial systems. * Familiarity with trading … infrastructures and protocols (FIX, Market Data, Order Entry, etc.), with a deep understanding of the demands of high-frequency and algorithmic trading environments. * Working knowledge of security best practices, including RBAC, TLS, and audit logging in Elasticsearch. * Experience with observability platforms such as ITRS Geneos and their integration with ELK is a strong plus. * Comfortable with multi-site More ❯

Data Engineer I am working with a leading, AI driven organisation that supports its clients' marketing campaigns, expanding its data engineering capabilities and looking for a Data Engineer to join their team. This is a fantastic opportunity to join an award-winning tech business where you will have the opportunity to work at the … forefront of data architecture, building distributed systems and leveraging Gen AI tools to accelerate development and improve quality. You will be encouraged to explore new ways to utilise modern technologies and will be positioned to help mentor other members of the technical team whilst leading innovative technical projects. As part of this role, you will be responsible for … some of the following areas: Design and build distributed data pipelines using languages such as Spark, Scala, and Java Collaborate with cross-functional teams to deliver user-centric solutions Lead on the design and development of relational and non-relational databases Apply Gen AI tools to boost development speed and code quality Maintain and optimise large-scale data More ❯

Data Engineer I am working with a leading, AI driven organisation that supports its clients' marketing campaigns, expanding its data engineering capabilities and looking for a Data Engineer to join their team. This is a fantastic opportunity to join an award-winning tech business where you will have the opportunity to work at the … forefront of data architecture, building distributed systems and leveraging Gen AI tools to accelerate development and improve quality. You will be encouraged to explore new ways to utilise modern technologies and will be positioned to help mentor other members of the technical team whilst leading innovative technical projects. As part of this role, you will be responsible for … some of the following areas: Design and build distributed data pipelines using languages such as Spark, Scala, and Java Collaborate with cross-functional teams to deliver user-centric solutions Lead on the design and development of relational and non-relational databases Apply Gen AI tools to boost development speed and code quality Maintain and optimise large-scale data More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

will bring with you a proven track record of selling and leading large-scale, high-impact programmes, preferably in the life sciences sector, along with significant experience in data analytics, business intelligence, quantitative research, and automation solutions. This role will be pivotal in managing and expanding DT’s book of business. The successful candidate will be responsible for … our team and our purpose to enable healthcare organisations to be future ready. About You As a Senior Principal, you are passionate about leading and delivering high-impact, data-driven solutions for life science clients. You thrive on orchestrating multidisciplinary teams, fostering collaboration across business units, and inspiring a culture of innovation and excellence. You are accountable for … development of DT’s capabilities and reputation in the market. You will thrive in this role if you are passionate about strategic growth, possess deep domain expertise in data and analytics for life sciences, and are energised by leading teams to deliver measurable, sustainable impact in a dynamic, client-focused environment. Key Responsibilities Client Delivery & Excellence Lead delivery More ❯

CRM & Data Strategy Analyst London – Hybrid Up to £46,000 + benefits The Company A leading name in the luxury retail space is growing its Customer Experience team and investing in data-driven decision-making. This role sits within a collaborative CRM and data strategy function, driving customer acquisition, retention, and engagement through analytics … and segmentation. The Role As a CRM & Data Strategy Analyst, you’ll work closely with senior analysts and CRM stakeholders to optimise campaigns and deliver actionable insights. You’ll be responsible for analysing customer data, shaping segmentation strategies, and reporting on CRM performance to improve engagement across multiple channels. Key responsibilities include: Analysing and presenting customer … data to inform CRM strategy and campaign optimisation. Building and maintaining customer segmentation for targeted campaigns. Owning reporting across CRM activity, including campaign performance and database health. Supporting data pipelines and automation to streamline CRM processes. Collaborating with senior stakeholders to influence customer engagement strategy. Your Skills and Experience Strong SQL skills (essential). Hands-on More ❯

CRM & Data Strategy Analyst London – Hybrid Up to £46,000 + benefits The Company A leading name in the luxury retail space is growing its Customer Experience team and investing in data-driven decision-making. This role sits within a collaborative CRM and data strategy function, driving customer acquisition, retention, and engagement through analytics … and segmentation. The Role As a CRM & Data Strategy Analyst, you’ll work closely with senior analysts and CRM stakeholders to optimise campaigns and deliver actionable insights. You’ll be responsible for analysing customer data, shaping segmentation strategies, and reporting on CRM performance to improve engagement across multiple channels. Key responsibilities include: Analysing and presenting customer … data to inform CRM strategy and campaign optimisation. Building and maintaining customer segmentation for targeted campaigns. Owning reporting across CRM activity, including campaign performance and database health. Supporting data pipelines and automation to streamline CRM processes. Collaborating with senior stakeholders to influence customer engagement strategy. Your Skills and Experience Strong SQL skills (essential). Hands-on More ❯

CRM & Data Strategy Analyst London – Hybrid Up to £46,000 + benefits The Company A leading name in the luxury retail space is growing its Customer Experience team and investing in data-driven decision-making. This role sits within a collaborative CRM and data strategy function, driving customer acquisition, retention, and engagement through analytics … and segmentation. The Role As a CRM & Data Strategy Analyst, you’ll work closely with senior analysts and CRM stakeholders to optimise campaigns and deliver actionable insights. You’ll be responsible for analysing customer data, shaping segmentation strategies, and reporting on CRM performance to improve engagement across multiple channels. Key responsibilities include: Analysing and presenting customer … data to inform CRM strategy and campaign optimisation. Building and maintaining customer segmentation for targeted campaigns. Owning reporting across CRM activity, including campaign performance and database health. Supporting data pipelines and automation to streamline CRM processes. Collaborating with senior stakeholders to influence customer engagement strategy. Your Skills and Experience Strong SQL skills (essential). Hands-on More ❯

CRM & Data Strategy Analyst London – Hybrid Up to £46,000 + benefits The Company A leading name in the luxury retail space is growing its Customer Experience team and investing in data-driven decision-making. This role sits within a collaborative CRM and data strategy function, driving customer acquisition, retention, and engagement through analytics … and segmentation. The Role As a CRM & Data Strategy Analyst, you’ll work closely with senior analysts and CRM stakeholders to optimise campaigns and deliver actionable insights. You’ll be responsible for analysing customer data, shaping segmentation strategies, and reporting on CRM performance to improve engagement across multiple channels. Key responsibilities include: Analysing and presenting customer … data to inform CRM strategy and campaign optimisation. Building and maintaining customer segmentation for targeted campaigns. Owning reporting across CRM activity, including campaign performance and database health. Supporting data pipelines and automation to streamline CRM processes. Collaborating with senior stakeholders to influence customer engagement strategy. Your Skills and Experience Strong SQL skills (essential). Hands-on More ❯

FX, commodities also considered) Prior experience building or supporting trading systems in a banking environment Nice to have: Familiarity with Sophis (Legacy tool) Understanding of pricing models, market data pipelines, and risk measures Academic background in maths, physics, or engineering Candidates must be UK citizens or hold ILR to be considered. If this sounds relevant, feel free to More ❯

problem that you're solving, and you will have the opportunity to shape the direction of the product. You will evaluate your own work, leveraging our data pipeline and frameworks that we have established to understand the impact your features have on our commercial objectives and pivoting where necessary. You will consider the long-term direction of More ❯

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. The ideal candidate will have a strong foundation in both developing … causal inference systems Create probabilistic models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into technical specifications Required Skills & Experience … Great experience combining data science with software engineering Strong expertise in machine learning, with focus on causal ML and probabilistic modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices More ❯

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. The ideal candidate will have a strong foundation in both developing … causal inference systems Create probabilistic models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into technical specifications Required Skills & Experience … Great experience combining data science with software engineering Strong expertise in machine learning, with focus on causal ML and probabilistic modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices More ❯

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. The ideal candidate will have a strong foundation in both developing … causal inference systems Create probabilistic models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into technical specifications Required Skills & Experience … Great experience combining data science with software engineering Strong expertise in machine learning, with focus on causal ML and probabilistic modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices More ❯

Full Stack Data Scientist - AI & Knowledge Systems About the Role We are seeking an exceptional Full Stack Data Scientist to join our clients innovation team. This role combines traditional data science expertise with software engineering capabilities to build end-to-end AI solutions. The ideal candidate will have a strong foundation in both developing … causal inference systems Create probabilistic models to address complex business problems Scale AI solutions from proof-of-concept to MVP and full production Collaborate with backend engineers on data pipelines and infrastructure Work within solution architecture frameworks to ensure AI integration Contribute to solution design and technical decision-making Translate business requirements into technical specifications Required Skills & Experience … Great experience combining data science with software engineering Strong expertise in machine learning, with focus on causal ML and probabilistic modelling Experience developing and implementing knowledge graphs Proficiency in scaling AI solutions from concept to production Working knowledge of backend systems, data pipelines, and ETL processes Familiarity with cloud platforms, particularly Microsoft Azure Understanding of microservices More ❯

Senior Software Engineer - Data & Backend - Up to £600.day outside IR35 LegalTech | Remote (UK) | Python | GCP | Data Pipelines | Event-Based Solutions Were helping a seed-funded LegalTech startup build their MVP. They need a Data-Focused Senior Software Engineer with a passion for building data pipelines and backend engineering using Python. If you … then look no further! Location: Remote (UK Only) Outside IR35 Up to £600.day 3 months (possible extension) As the Software Engineer on this project, youll design and build data pipelines in Python and GCP, deliver high-performance backend systems, and implement IaC to ensure everything scales. What youll do: Build backend services and data pipelines from … scratch Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build & optimise Python code for robust backend systems Integrate APIs, enrich data, and deliver data pipelines that work at scale Implement modern IaC practices for deployment & automation What youll bring: Expertise in Python, GCP, and building complex data pipelines Strong understanding More ❯

Key Responsibilities: Design, build, and deploy AI/ML models for real-world business use cases. Work with NLP, computer vision, and generative AI frameworks where applicable. Develop data pipelines and integrate models into production systems. Collaborate with data scientists, engineers, and product teams to define AI solutions. Ensure scalability, performance, and ethical AI practices. Required … Skills & Experience: Strong experience in Python, TensorFlow, PyTorch, Scikit-learn or similar frameworks. Solid understanding of machine learning, deep learning, NLP, or computer vision. Hands-on with data engineering, model deployment (MLOps), and cloud platforms (AWS, Azure, GCP). Strong problem-solving, algorithmic, and analytical skills. Knowledge of big data tools (Spark, Hadoop) is a plus. More ❯