526 to 550 of 938 Data Pipeline Jobs in London

We’re seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You’ll own the full data lifecycle — from ingestion and processing to deployment and monitoring of machine learning models — while leading a small, high-performing team. What You’ll Do Build and maintain … data pipelines and cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and adoption … of emerging AI tech. What We’re Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. Nice More ❯

We're seeking a Lead Data Engineer to design and deliver scalable data and AI solutions across internal and client projects. You'll own the full data life cycle - from ingestion and processing to deployment and monitoring of machine learning models - while leading a small, high-performing team. What You'll Do Build and … maintain data pipelines and cloud infrastructure (AWS/GCP). Develop AI-driven applications including LLM tools, RAG pipelines, and automation solutions. Lead on client communication , project delivery, and stakeholder alignment. Collaborate with Data Science and Analytics teams to improve data access, automation, and governance. Drive innovation through proofs-of-concept , model monitoring , and … adoption of emerging AI tech. What We're Looking For 5+ years in data engineering, with team or project leadership experience. Advanced Python (Pandas, PyTorch, TensorFlow, Scikit-learn). Strong AWS/GCP , MySQL , and CI/CD experience; Docker/Kubernetes a plus. Excellent communication, organisation, and problem-solving skills. Passion for innovation and ethical, scalable AI. More ❯

when needed. The ideal candidate will act primarily as a Solutions Architect - collaborating with clients, consultancy teams, and internal stakeholders to design scalable, future-proof solutions across digital, data, and MarTech domains. However, this individual should also be comfortable getting hands-on in engineering scenarios, whether it's during critical build phases, technical troubleshooting, or prototyping new concepts. … technical ideas into business value. Solution Design & Delivery Translate business requirements into architectural designs and actionable technical documentation. Design robust, scalable, and maintainable digital solutions across web, mobile, data, and MarTech ecosystems. Take ownership of high-level designs, low-level designs, integration specifications, and build oversight. Client Collaboration & Delivery Execution Participate in workshops and discovery sessions to capture … and non-technical audiences. Nice to Have Experience with platforms like Braze, Google Analytics, Adobe Analytics, Contentful, or Sitecore. Experience across technology domains including CMS, CRM, Martech platforms, data pipelines, analytics, and cloud services. Exposure to CDPs (e.g., Bloomreach, Segment, BlueConic, Tealium) and data integration pipelines. Understanding of data modelling, ETL processes, and basic More ❯

Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or Node.js. Implement AI/ML pipelines for training, validation, and deployment using tools like MLflow, Vertex AI, or Azure ML. Monitor model performance, detect drift, and drive … continuous improvement. Optimize inference performance and cost through model compression, quantization, and API optimization. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Support POCs, pilots, and full-scale implementations using agile methodologies. Strong programming skills in Python (preferred), with experience in … Java or Node.js. Familiarity with RAG pipelines, embedding models, and vector databases. Experience with cloud platforms (AWS, GCP, Azure) and AI/ML services. Strong understanding of data engineering, data pipelines, and ETL workflows. Bachelor's or Master's degree in Computer Science, AI/ML, Data Science, or related field. Languages: English More ❯

... Project Description: Apply prompt engineering, Retrieval-Augmented Generation (RAG), and context-aware pipelines to enhance model accuracy and relevance. Integrate AI models with enterprise systems, APIs, and data stores using Python, Java, or Node.js. Implement AI/ML pipelines for training, validation, and deployment using tools like MLflow, Vertex AI, or Azure ML. Monitor model performance, detect … drive continuous improvement. Optimize inference performance and cost through model compression, quantization, and API optimization. Prepare and curate training datasets (structured/unstructured text, images, code). Apply data preprocessing, tokenization, and embedding generation techniques. Work with vector databases (e.g., Support POCs, pilots, and full-scale implementations using agile methodologies. Strong programming skills in Python (preferred), with experience … in Java or Node.js. -Familiarity with RAG pipelines, embedding models, and vector databases. -Experience with cloud platforms (AWS, GCP, Azure) and AI/ML services. -Strong understanding of data engineering, data pipelines, and ETL workflows. -Bachelor's or Master's degree in Computer Science, AI/ML, Data Science, or related field. &##Languages: English More ❯

Senior Data Engineer At BNY, our culture allows us to run our company better and enables employees growth and success.As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the worlds investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients … finance and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary. Were seeking a future team member for the role of Senior Data Engineer, Vice President , to join our Investment Management Engineering team. This role is located in London . In this role, youll make an impact in the following ways: Lead … the design and development of data pipelines feeding the BNY Investments analytical platform, ensuring high quality and performance. Provide architectural oversight by designing scalable, secure, and cost-efficient data systems tailored to support BNYs Investments business needs. Contribute to the design and development of AI/ML initiatives ongoing in BNY Investments Mentor and coach junior More ❯

Senior Data Engineer At BNY, our culture allows us to run our company better and enables employees growth and success.As a leading global financial services company at the heart of the global financial system, we influence nearly 20% of the worlds investible assets. Every day, our teams harness cutting-edge AI and breakthrough technologies to collaborate with clients … finance and this is what #LifeAtBNY is all about. Join us and be part of something extraordinary. Were seeking a future team member for the role of Senior Data Engineer, Vice President , to join our Investment Management Engineering team. This role is located in London . In this role, youll make an impact in the following ways: Lead … the design and development of data pipelines feeding the BNY Investments analytical platform, ensuring high quality and performance. Provide architectural oversight by designing scalable, secure, and cost-efficient data systems tailored to support BNYs Investments business needs. Contribute to the design and development of AI/ML initiatives ongoing in BNY Investments Mentor and coach junior More ❯

across cross-functional technical teams Managing complex interdependencies between products and projects Driving continuous improvement of agile (Kanban) processes Partnering with engineers to integrate AI into development and data pipelines Overseeing delivery metrics, reporting, and governance Solid understanding of agile ways of working (Kanban in particular) Skilled with JIRA, Confluence and Azure DevOps Financial services knowledge is desirable More ❯

time: quantization, pruning, ONNX/TensorRT, mixed precision, batching, caching. Ship models to edge & cloud with CI/CD, versioning, and rollback; instrument latency and accuracy SLAs. Create data pipelines: collection, labeling, augmentation/synthesis, dataset versioning (DVC). Collaborate with backend/infra on streaming (RTMP/TCP), Pub/Sub, autoscaling, and observability. Must haves Python More ❯

global collaboration, and keeping delivery on point. What you ll do: Lead cross-functional teams (UK & India-based) delivering FS products on Azure Embed AI across development and data pipelines Streamline Kanban delivery using JIRA, Confluence & Azure DevOps Balance ad hoc requests with strategic initiatives Scale processes, mentor teams & drive continuous improvement What you ll bring: Proven technical More ❯

global collaboration, and keeping delivery on point. What you’ll do: Lead cross-functional teams (UK & India-based) delivering FS products on Azure Embed AI across development and data pipelines Streamline Kanban delivery using JIRA, Confluence & Azure DevOps Balance ad hoc requests with strategic initiatives Scale processes, mentor teams & drive continuous improvement What you’ll bring: Proven technical More ❯

global collaboration, and keeping delivery on point. What you’ll do: Lead cross-functional teams (UK & India-based) delivering FS products on Azure Embed AI across development and data pipelines Streamline Kanban delivery using JIRA, Confluence & Azure DevOps Balance ad hoc requests with strategic initiatives Scale processes, mentor teams & drive continuous improvement What you’ll bring: Proven technical More ❯

global collaboration, and keeping delivery on point. What you’ll do: Lead cross-functional teams (UK & India-based) delivering FS products on Azure Embed AI across development and data pipelines Streamline Kanban delivery using JIRA, Confluence & Azure DevOps Balance ad hoc requests with strategic initiatives Scale processes, mentor teams & drive continuous improvement What you’ll bring: Proven technical More ❯

across cross-functional technical teams Managing complex interdependencies between products and projects Driving continuous improvement of agile (Kanban) processes Partnering with engineers to integrate AI into development and data pipelines Overseeing delivery metrics, reporting, and governance Acting as the link between stakeholders and technical teams Designing scalable delivery frameworks to support future growth Requirements: Experience leading technical delivery More ❯

across cross-functional technical teams Managing complex interdependencies between products and projects Driving continuous improvement of agile (Kanban) processes Partnering with engineers to integrate AI into development and data pipelines Overseeing delivery metrics, reporting, and governance Acting as the link between stakeholders and technical teams Designing scalable delivery frameworks to support future growth Requirements: Experience leading technical delivery More ❯

across cross-functional technical teams Managing complex interdependencies between products and projects Driving continuous improvement of agile (Kanban) processes Partnering with engineers to integrate AI into development and data pipelines Overseeing delivery metrics, reporting, and governance Acting as the link between stakeholders and technical teams Designing scalable delivery frameworks to support future growth Requirements: Experience leading technical delivery More ❯

across cross-functional technical teams Managing complex interdependencies between products and projects Driving continuous improvement of agile (Kanban) processes Partnering with engineers to integrate AI into development and data pipelines Overseeing delivery metrics, reporting, and governance Acting as the link between stakeholders and technical teams Designing scalable delivery frameworks to support future growth Requirements: Experience leading technical delivery More ❯

teams to build seamless user experiences What will the Senior Product Engineer bring? Strong backend development expertise with Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building high-quality products that customers More ❯

teams to build seamless user experiences What will the Senior Product Engineer bring? Strong backend development expertise with Node.js and Typescript Experience designing secure, scalable backend systems (authentication, data pipelines, APIs) Familiarity with modern cloud infrastructure (GCP or AWS) Ability to communicate technical ideas clearly and influence team direction A passion for building high-quality products that customers More ❯

Innovator, in technology and GTM, you love delivering ideas whose time has come. AI/ML literate - understands LLM limits, evals, performance/latency/cost trade-offs, data pipelines, guardrails, and can quickly gain respect of Eng/Research. Specific Voice AI experience certainly helps! We encourage you to apply even if you do not feel you More ❯

LLM safety, performance, and output explainability. This role suits someone who enjoys working across both frontend and backend systems, connecting AI models to real-world user interfaces and data pipelines. What you'll be doing: Develop and deploy full stack features (Python backend, React frontend) Integrate LLM and GenAI components into the product ecosystem Conduct user research to More ❯

Work Location: London (Office Based) The Role The role will be integral to realizing the customer's vision and strategy in transforming some of their critical application and data engineering components. As a global financial markets infrastructure and data provider , the customer leverages cutting-edge technologies to support its core services and business requirements. This role … is critical in enabling the technical thought leadership and excellence required for that purpose. Your Responsibilities Design, build, and optimise scalable data pipelines for batch and streaming workloads. Develop and manage dataflows and semantic models to support analytics-related business requirements. Implement complex transformations, aggregations, and joins ensuring performance and reliability. Apply robust data validations, cleansing … and profiling techniques to ensure data accuracy and consistency. Implement role-based access, data masking, and compliance protocols. Performance tune and optimise jobs and workloads to reduce latency. Collaborate with analysts and business stakeholders to translate requirements into technical solutions. Create, maintain, and update documentation and internal knowledge repositories. Your Profile Essential Skills/Knowledge/ More ❯

Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our clients data infrastructure … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯

Innovative AI Start-up now requires a Python engineer to build innovative data solutions which power smarter and more relevant customer experiences. You will develop and design data pipelines, data models, backend APIs and an array of customer facing data services. The role: Own and improve our clients data infrastructure … develop dashboards to deliver insights. Shape the direction of our clients architecture, scalability and security. Key Requirements: Strong hands-on Python experience with a solid understanding of modern data tools. Extensive experience working with both SQL and NoSQL databases. Exposure to cloud services, infrastructure as code and CI/CD pipelines. Strong understanding of data modelling More ❯

and seeing your work make a visible impact, you’ll like this one. You’ll join a growing consumer app that helps millions of people each month, where data actually drives every product decision. The team moves fast, values ownership, and is looking for someone who wants to build clean, scalable data systems that others rely … on daily. You’ll take charge of the data platform - designing pipelines, connecting systems, and making sure everyone across the company can trust and use the data with confidence. You won’t be stuck doing endless ad hoc reports. You’ll build the foundations that make analysis and experimentation effortless for everyone else. What you’ll … do Design, build, and maintain data pipelines and orchestration (Airflow, dbt, BigQuery) Integrate and manage data from multiple SaaS platforms (e.g. GA4, AppsFlyer, Stripe, PostHog) Build reliable infrastructure for analytics, growth, and product teams Improve data quality, observability, and scalability across the platform Enable self-serve insights through well-structured models and documentation What More ❯