776 to 800 of 1,086 Data Pipeline Jobs in London

of 12 months ending December 2024 totaled $13.8 billion. Experience : Minimum 10+ Years Strong Knowledge in Hadoop, Kafka, SQL/NoSQL Specialization in designing and implementing large-scale data pipelines, ETL processes, and distributed systems Should be able to work independenty with minimal help/guidance Good Understanding of Airflow,Data Fusion and Data Flow Strong Background and experience in Data Ingestions,Transformation,Modeling and Performance tuning. One migration Experience from Cornerstone to GCP will be added advantage Suppport the design and development of BigData echosystem Experience in building complex SQL Queries Strong Communication Skills More ❯

legal/regulatory requirements into clear technical stories and testable acceptance criteria. Integrate privacy controls and automated assurance checks into CI/CD pipelines. technical depth - software and data engineering, web/mobile SDK, client/server tracking and content and data streaming, data pipelines. Cross-Functional Collaboration Work closely with Product, Architecture, Security … to ensure privacy alignment with technical and business objectives. Help evolve privacy engineering frameworks and best practices across the organisation. Experience & Skills Technical Background Experience in software/data engineering or similar technical role. Familiarity with data pipelines, APIs, SDKs, client-server tracking, consent tech, event-driven systems. Knowledge of cloud environments, modern data …/SAFe Delivery Experience embedding NFRs and BDD into agile delivery. Comfortable in PI planning, system demos and Inspect-and-Adapt sessions. Systems & Risk Understanding Strong grasp of data flows, system interdependencies and third-party risk. Ability to surface cross-platform privacy impacts and technical dependencies. Nice to Have Previous privacy engineering/data protection assurance More ❯

this is your chance to shape the next generation of AI infrastructure. Design, implement, and optimize LangGraph-based AI workflows and multi-agent systems Integrate LLMs, APIs, and data pipelines into production-ready solutions Build scalable, maintainable AI applications with structured memory, tools, and dynamic reasoning paths Collaborate with cross-functional teams from data scientists to …/CD practices Creative problem-solver with a bias toward action and experimentation Experience deploying AI agents at scale Knowledge of cloud platforms (AWS, GCP, Azure) Background in data engineering, NLP, or ML Ops Work on cutting-edge AI projects with real-world impact Collaborate with a world-class engineering team Flexible remote environment with strong growth potential More ❯

to shape the next generation of AI infrastructure. What You’ll Do Design, implement, and optimize LangGraph-based AI workflows and multi-agent systems Integrate LLMs, APIs, and data pipelines into production-ready solutions Build scalable, maintainable AI applications with structured memory, tools, and dynamic reasoning paths Collaborate with cross-functional teams — from data scientists to … Creative problem-solver with a bias toward action and experimentation Nice to Have Experience deploying AI agents at scale Knowledge of cloud platforms (AWS, GCP, Azure) Background in data engineering, NLP, or ML Ops Why Join Us Work on cutting-edge AI projects with real-world impact Collaborate with a world-class engineering team Flexible remote environment with More ❯

to shape the next generation of AI infrastructure. What You’ll Do Design, implement, and optimize LangGraph-based AI workflows and multi-agent systems Integrate LLMs, APIs, and data pipelines into production-ready solutions Build scalable, maintainable AI applications with structured memory, tools, and dynamic reasoning paths Collaborate with cross-functional teams — from data scientists to … Creative problem-solver with a bias toward action and experimentation Nice to Have Experience deploying AI agents at scale Knowledge of cloud platforms (AWS, GCP, Azure) Background in data engineering, NLP, or ML Ops Why Join Us Work on cutting-edge AI projects with real-world impact Collaborate with a world-class engineering team Flexible remote environment with More ❯

to shape the next generation of AI infrastructure. What You’ll Do Design, implement, and optimize LangGraph-based AI workflows and multi-agent systems Integrate LLMs, APIs, and data pipelines into production-ready solutions Build scalable, maintainable AI applications with structured memory, tools, and dynamic reasoning paths Collaborate with cross-functional teams — from data scientists to … Creative problem-solver with a bias toward action and experimentation Nice to Have Experience deploying AI agents at scale Knowledge of cloud platforms (AWS, GCP, Azure) Background in data engineering, NLP, or ML Ops Why Join Us Work on cutting-edge AI projects with real-world impact Collaborate with a world-class engineering team Flexible remote environment with More ❯

to shape the next generation of AI infrastructure. What You’ll Do Design, implement, and optimize LangGraph-based AI workflows and multi-agent systems Integrate LLMs, APIs, and data pipelines into production-ready solutions Build scalable, maintainable AI applications with structured memory, tools, and dynamic reasoning paths Collaborate with cross-functional teams — from data scientists to … Creative problem-solver with a bias toward action and experimentation Nice to Have Experience deploying AI agents at scale Knowledge of cloud platforms (AWS, GCP, Azure) Background in data engineering, NLP, or ML Ops Why Join Us Work on cutting-edge AI projects with real-world impact Collaborate with a world-class engineering team Flexible remote environment with More ❯

engineer seeking a role where your expertise directly drives business success and personal rewards. Ideal candidates will have some Banking/Financial Background and Trade Floor/Market Data Support experience and whilst predominantly Windows candidates must have some Linux with any E-Trading experience highly beneficial. Role Overview: Provide day-to-day Technical Support of Traders and … CI/CD, containerization, infrastructure as code) Cloud platforms experience beyond basic administration (AWS, Azure, GCP) Experience integrating AI or automation into operational workflows (e.g., monitoring, alerting, or data pipelines) Some knowledge of Atlassian Jira & Confluence Interest in emerging technologies (AI/ML, blockchain, IoT, edge computing) Open-source contributions or personal tech projects you're proud of … Other Highly Desirable Skills: Previous Application Support - Ideally Trading/Market Data - Futures & Options Trading/Settlement Systems advantageous Some Networking - Routers, Switches and Firewalls including Cisco - able to configure and troubleshoot mid-range switches and set up/troubleshoot VLANs Strong Linux/Unix System Administration Beneficial - RedHat, Ubuntu, Solaris. Core understanding of Databases - SQL Server/ More ❯

full stack , from designing intuitive user experiences to architecting resilient back-end systems. You're eager to learn new technologies, driven by a passion for leveraging software and data to make a tangible difference in decarbonization and enterprise transformation. About the Role We're seeking a Senior Software Engineer to join this company's founding engineering team . … Full-Stack Development Design, build, and deploy end-to-end features across front-end, back-end, and infrastructure. Write clean, maintainable code that balances quality and delivery speed. Data Engineering & Systems Design Develop robust data pipelines and integrations that deliver financial and emissions insights. Contribute to data modeling, ETL, and analytics foundations to support … of software engineering experience . Full-stack experience (e.g. React/TypeScript, Node.js, Python, or similar). Thrive in startup or early-stage environments . Have experience with data engineering, ETL pipelines, or analytics systems . Are quick to learn new technologies and enjoy solving diverse challenges. Plus points Experience with dbt, DuckDB , or the modern data More ❯

This is a highly autonomous role, perfect for someone who thrives on building, managing, and continuously improving the systems that keep a fast-moving business running smoothly. From data pipelines to automation workflows, you will ensure every technical aspect of the business operates efficiently and strategically. Responsibilities: Own all technology systems and processes across the business. Design, build … and maintain data pipelines integrating POS, kitchen operations, labor, and inventory systems. Develop and manage dashboards and reporting tools for leadership and operations. Build and maintain low/no-code automation workflows to streamline operations. Manage API integrations between platforms. Identify, recommend, and implement new tech solutions that drive efficiency and growth. Ensure data accuracy, availability … security, and compliance. Partner with leadership to shape the company's tech and data strategy. Experience: Proven experience in data engineering, analytics, and reporting (SQL, Google BigQuery, Power BI, Looker, Tableau). Strong capability with API integrations and low/no-code tools (n8n, Zapier, Airtable, Make). Broad technical problem-solving skills, able to implement More ❯

Excellent problem-solving skills. Experience using a coding language to develop models and analytical tools. Experience manipulating and analyzing large, complex datasets. Desirable Experience & Skills Practical knowledge of data engineering practices (designing and building robust data pipelines) Knowledge of python and core libraries applicable to data science (e.g., pandas, numpy, statsmodel More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Senior Software Engineer - Backend & Data | Fully Remote (UK) Founding Engineer | Python | GCP | Terraform | Event-Based Systems | Data Pipelines An innovative, mission-driven LegalTech SaaS start-up is looking for a Senior Product Engineer (Backend & Data) with deep experience in Python, Product development, and Data engineering. Role Information: Salary : Up to … over technical decisions from day one. You’ll take technical ownership of the backend to ensure it’s robust, scalable, and ready for real customers, while adding new Data-driven features, optimising performance, and shaping the long-term Product roadmap. While your focus will be backend systems in Python, you’ll also work across the stack, collaborate directly … a strong Product mindset to every decision. This role is ideal for someone who thrives on turning early-stage ideas into scalable, market-ready Products backed by solid Data pipelines. Senior Product Engineer - Highlights: Enhance and scale backend services in Python Architect event-driven solutions in GCP with Pub/Sub & Cloud Run Build and optimise Python code More ❯

Job Description we are building an enterprise-grade AI/ML Data Platform that enables scalable, secure, and responsible machine learning across the firm. We are seeking a Lead Software Engineer with a strong background in software development and platform engineering to help drive the Test Engineering Programa strategic initiative focused on building robust, intelligent validation frameworks and … infrastructure that power our ML and data products. This is a software engineering role embedded in quality and reliability initiatives. Youll architect and develop tools, services, and automation that elevate platform assurance across large-scale distributed systems. If you're passionate about platform quality, CI/CD excellence, infrastructure-as-code, and bringing engineering rigor to validation, this … pipelines and AI infrastructure. Develop platform-level test solutions and automation frameworks using Python, Terraform, and modern cloud-native practices. Contribute to the platforms CI/CD pipeline by integrating automated testing, resilience checks, and observability hooks at every stage. Lead initiatives that drive testability, platform resilience, and validation as code across all layers of the ML More ❯

highly experienced Product Manager with deep programmatic advertising expertise to lead the development of a next-generation meta DSP platform. This senior position requires exceptional technical depth, strong data-driven decision-making, and the proven ability to translate complex technical concepts into clear business outcomes. Key Responsibilities Product Vision & Strategy Own the product vision, strategy, and roadmap for … a unified advertising platform. Define how advertising and audience data flows through the platform to maximize targeting accuracy and campaign effectiveness. Ensure alignment between technical capabilities and commercial goals, driving measurable partner value. Build business cases, requirements, and ROI models to prioritize product investments. Technical Product Management Oversee integration and optimization of multiple DSPs, SSPs, and ad-serving … technologies. Define technical requirements for real-time bidding systems handling billions of daily requests. Lead API product management across the AdTech/MarTech ecosystem. Design data pipelines and architecture for cross-platform campaign analytics. Ensure sub-100ms response times while maintaining 99.9% platform reliability. Data & Compliance Implement comprehensive measurement frameworks for attribution and campaign effectiveness. Ensure More ❯

and crypto analytics. Our in-house technology powers a suite of innovative financial solutions, delivering deep market insights and actionable intelligence for professional investors and institutions. By combining data science, algorithmic precision, and intuitive design, we develop cutting-edge tools that enable users to analyze, interpret, and act on market dynamics with confidence. Your role As a Senior … Software Engineer in the Product Engineering team you will build and evolve a data and content dissemination platform (Web, App, APIs, messaging) and corresponding data pipelines, ensuring that our analytics and trading systems remain at the forefront of financial innovation. You will provide the content of our proprietary investment framework directly to our clients. In order … to succeed, you are required to deep dive and analyze various use cases with different teams like investment, finance, data or strategy engineers. Apart from supporting our constantly evolving products by driving the development of our components, you will actively help in business requirement analysis and specification to improve not only the tools but also processes and information More ❯

and crypto analytics. Our in-house technology powers a suite of innovative financial solutions, delivering deep market insights and actionable intelligence for professional investors and institutions. By combining data science, algorithmic precision, and intuitive design, we develop cutting-edge tools that enable users to analyze, interpret, and act on market dynamics with confidence. Your role As a Senior … Software Engineer in the Product Engineering team you will build and evolve a data and content dissemination platform (Web, App, APIs, messaging) and corresponding data pipelines, ensuring that our analytics and trading systems remain at the forefront of financial innovation. You will provide the content of our proprietary investment framework directly to our clients. In order … to succeed, you are required to deep dive and analyze various use cases with different teams like investment, finance, data or strategy engineers. Apart from supporting our constantly evolving products by driving the development of our components, you will actively help in business requirement analysis and specification to improve not only the tools but also processes and information More ❯

and crypto analytics. Our in-house technology powers a suite of innovative financial solutions, delivering deep market insights and actionable intelligence for professional investors and institutions. By combining data science, algorithmic precision, and intuitive design, we develop cutting-edge tools that enable users to analyze, interpret, and act on market dynamics with confidence. Your role As a Senior … Software Engineer in the Product Engineering team you will build and evolve a data and content dissemination platform (Web, App, APIs, messaging) and corresponding data pipelines, ensuring that our analytics and trading systems remain at the forefront of financial innovation. You will provide the content of our proprietary investment framework directly to our clients. In order … to succeed, you are required to deep dive and analyze various use cases with different teams like investment, finance, data or strategy engineers. Apart from supporting our constantly evolving products by driving the development of our components, you will actively help in business requirement analysis and specification to improve not only the tools but also processes and information More ❯

and crypto analytics. Our in-house technology powers a suite of innovative financial solutions, delivering deep market insights and actionable intelligence for professional investors and institutions. By combining data science, algorithmic precision, and intuitive design, we develop cutting-edge tools that enable users to analyze, interpret, and act on market dynamics with confidence. Your role As a Senior … Software Engineer in the Product Engineering team you will build and evolve a data and content dissemination platform (Web, App, APIs, messaging) and corresponding data pipelines, ensuring that our analytics and trading systems remain at the forefront of financial innovation. You will provide the content of our proprietary investment framework directly to our clients. In order … to succeed, you are required to deep dive and analyze various use cases with different teams like investment, finance, data or strategy engineers. Apart from supporting our constantly evolving products by driving the development of our components, you will actively help in business requirement analysis and specification to improve not only the tools but also processes and information More ❯

Senior Data Scientist – Biomedical AI Location: London (Hybrid, 4 days on-site) Advance the future of AI-driven biomedical discovery Considering making an application for this job Check all the details in this job description, and then click on Apply. The Opportunity We're seeking an experienced data scientist with strong biological or biomedical expertise to … help shape and deliver cutting-edge AI solutions in life sciences. You'll play a key role in applying advanced machine learning to complex biomedical data, contributing to breakthroughs in drug discovery, biomarker identification, and health data analysis. This is a chance to make real scientific impact in a fast-growing, mission-led company. What You … ll Do Design and implement machine learning models across diverse biomedical datasets (genomics, proteomics, imaging, clinical data, etc.) Collaborate with biologists, clinicians, and engineers to translate biological problems into scalable AI solutions Contribute to the development of data pipelines, model validation, and reproducible research practices Support strategic data science initiatives and guide junior team More ❯

multiple teams and contribute on key decisions. Provide solutions to problems for their immediate team and across multiple teams. Collaborate with cross-functional teams to develop and deploy data-driven insights. As an Infrastructure Automation Engineer you will be: Required to work independently and be self-motivated, leading a team of other Automation Infrastructure Engineers and Analysts Experienced … in the following: Infrastructure Development and Automation: Building use cases and creating infrastructure applications using programming languages such as C#, C++, and Python to process data locally Containerization and Orchestration: Using tools like Docker and Kubernetes to package and manage applications for scalable and efficient deployment. Packaged Application and industry standard APIs such as Revitt, MEF and TMFORUM. … and Resource Management: Managing resources efficiently via deployment of scalable infrastructure. Includes knowledge of containerization, virtualization, and orchestration tools to dynamically allocate resources based on demand. Develop innovative data solutions to optimize data generation, collection, and processing. Collaborate with cross-functional teams to ensure data quality and integrity. We are looking for experience in More ❯

multiple teams and contribute on key decisions. Provide solutions to problems for their immediate team and across multiple teams. Collaborate with cross-functional teams to develop and deploy data-driven insights. As an Infrastructure Automation Engineer you will be: Required to work independently and be self-motivated, leading a team of other Automation Infrastructure Engineers and Analysts Experienced … in the following: Infrastructure Development and Automation: Building use cases and creating infrastructure applications using programming languages such as C#, C++, and Python to process data locally Containerization and Orchestration: Using tools like Docker and Kubernetes to package and manage applications for scalable and efficient deployment. Packaged Application and industry standard APIs such as Revitt, MEF and TMFORUM. … and Resource Management: Managing resources efficiently via deployment of scalable infrastructure. Includes knowledge of containerization, virtualization, and orchestration tools to dynamically allocate resources based on demand. Develop innovative data solutions to optimize data generation, collection, and processing. Collaborate with cross-functional teams to ensure data quality and integrity. We are looking for experience in More ❯