Data Pipeline Jobs in London

876 to 900 of 1,015 Data Pipeline Jobs in London

Lead Software Engineer (Python)

london, south east england, united kingdom
Circuit Mind
non-functional requirements. Co-design, pair on, and review the development work of other lead software developers. You’ll work on the entire company's backend code base: data models, algorithms, data pipelines, infrastructure, APIs, complex database queries, ML models. Learn, use, and improve best practices and processes for high-quality software development. Our technology stack More ❯
Posted:

Lead Software Engineer (Python)

london (city of london), south east england, united kingdom
Circuit Mind
non-functional requirements. Co-design, pair on, and review the development work of other lead software developers. You’ll work on the entire company's backend code base: data models, algorithms, data pipelines, infrastructure, APIs, complex database queries, ML models. Learn, use, and improve best practices and processes for high-quality software development. Our technology stack More ❯
Posted:

Product Manager

London, United Kingdom
Winnow Solutions
collaborative design and development practices at the core, you will partner with technical leads, founders, senior leadership, and external clients to define and deliver complex inbound and outbound data integrations that unlock value at scale. You will: Define the integration roadmap & strategy, prioritising initiatives that multiply Winnow's impact and revenue. Work with cross scrum teams to deliver … secure, reliable APIs, data pipelines and third party connectors. Partner with Business Development to shape commercial proposals and manage client expectations throughout the integration lifecycle. Influence product direction in a fast paced environment and see your work rapidly deployed by hospitality businesses worldwide. Over time, based on business needs as well as capability and interest, your area of … and value of pursuing different strategic integration pathways to accelerate business growth. Define and maintain a multi year integration roadmap aligned to company OKRs and market opportunities. Build data driven business cases that quantify customer value, commercial impact and technical feasibility. Collaborate with enterprise customers to capture integration requirements and translate them into clear user stories and acceptance More ❯
Employment Type: Permanent
Salary: GBP Annual
Posted:

Lead Backend Engineer

City of London, London, United Kingdom
Wave Talent
stores, and ops teams to see your code in action. 🧱 What You’ll Be Building Scalable backend services and operational tooling using Node.js, TypeScript, and AWS APIs and data pipelines to support logistics, supply chain, and real-time store operations Event-driven systems and distributed architecture for fast, fault-tolerant execution Back-office tools and dashboards for internal … teams—integrated directly with on-the-ground workflows Systems to optimise KPIs like order accuracy, worker productivity, and inventory speed 🔧 Tech Stack Backend: Node.js, TypeScript, Express Data: PostgreSQL, MongoDB, event streams Infra: AWS (Lambda, DynamoDB, EventBridge), GCP, Docker, CI/CD pipelines Architecture: Serverless, microservices, event-driven Tooling: Monitoring, dashboarding, dev tooling, cloud infra automation ✅ What You Bring … 5+ years backend experience with Node.js and TypeScript Deep experience with SQL/NoSQL databases and data modelling Strong understanding of cloud infrastructure (AWS or GCP) and DevOps Experience building and maintaining scalable APIs and backend systems Ability to lead architecture, define standards, and raise the bar for engineering quality Great collaborator with product, design, and ops teams More ❯
Posted:

Lead Backend Engineer

London Area, United Kingdom
Wave Talent
stores, and ops teams to see your code in action. 🧱 What You’ll Be Building Scalable backend services and operational tooling using Node.js, TypeScript, and AWS APIs and data pipelines to support logistics, supply chain, and real-time store operations Event-driven systems and distributed architecture for fast, fault-tolerant execution Back-office tools and dashboards for internal … teams—integrated directly with on-the-ground workflows Systems to optimise KPIs like order accuracy, worker productivity, and inventory speed 🔧 Tech Stack Backend: Node.js, TypeScript, Express Data: PostgreSQL, MongoDB, event streams Infra: AWS (Lambda, DynamoDB, EventBridge), GCP, Docker, CI/CD pipelines Architecture: Serverless, microservices, event-driven Tooling: Monitoring, dashboarding, dev tooling, cloud infra automation ✅ What You Bring … 5+ years backend experience with Node.js and TypeScript Deep experience with SQL/NoSQL databases and data modelling Strong understanding of cloud infrastructure (AWS or GCP) and DevOps Experience building and maintaining scalable APIs and backend systems Ability to lead architecture, define standards, and raise the bar for engineering quality Great collaborator with product, design, and ops teams More ❯
Posted:

Lead Backend Engineer

london, south east england, united kingdom
Wave Talent
stores, and ops teams to see your code in action. 🧱 What You’ll Be Building Scalable backend services and operational tooling using Node.js, TypeScript, and AWS APIs and data pipelines to support logistics, supply chain, and real-time store operations Event-driven systems and distributed architecture for fast, fault-tolerant execution Back-office tools and dashboards for internal … teams—integrated directly with on-the-ground workflows Systems to optimise KPIs like order accuracy, worker productivity, and inventory speed 🔧 Tech Stack Backend: Node.js, TypeScript, Express Data: PostgreSQL, MongoDB, event streams Infra: AWS (Lambda, DynamoDB, EventBridge), GCP, Docker, CI/CD pipelines Architecture: Serverless, microservices, event-driven Tooling: Monitoring, dashboarding, dev tooling, cloud infra automation ✅ What You Bring … 5+ years backend experience with Node.js and TypeScript Deep experience with SQL/NoSQL databases and data modelling Strong understanding of cloud infrastructure (AWS or GCP) and DevOps Experience building and maintaining scalable APIs and backend systems Ability to lead architecture, define standards, and raise the bar for engineering quality Great collaborator with product, design, and ops teams More ❯
Posted:

Lead Backend Engineer

london (city of london), south east england, united kingdom
Wave Talent
stores, and ops teams to see your code in action. 🧱 What You’ll Be Building Scalable backend services and operational tooling using Node.js, TypeScript, and AWS APIs and data pipelines to support logistics, supply chain, and real-time store operations Event-driven systems and distributed architecture for fast, fault-tolerant execution Back-office tools and dashboards for internal … teams—integrated directly with on-the-ground workflows Systems to optimise KPIs like order accuracy, worker productivity, and inventory speed 🔧 Tech Stack Backend: Node.js, TypeScript, Express Data: PostgreSQL, MongoDB, event streams Infra: AWS (Lambda, DynamoDB, EventBridge), GCP, Docker, CI/CD pipelines Architecture: Serverless, microservices, event-driven Tooling: Monitoring, dashboarding, dev tooling, cloud infra automation ✅ What You Bring … 5+ years backend experience with Node.js and TypeScript Deep experience with SQL/NoSQL databases and data modelling Strong understanding of cloud infrastructure (AWS or GCP) and DevOps Experience building and maintaining scalable APIs and backend systems Ability to lead architecture, define standards, and raise the bar for engineering quality Great collaborator with product, design, and ops teams More ❯
Posted:

Python Developer – Up to £180,000 + Bonus + Benefits

Greater London, England, United Kingdom
Hybrid / WFH Options
Hunter Bond
What You’ll Be Doing Designing, developing, and maintaining Python-based trading and research infrastructure Building bespoke analytics and visualization tools in close collaboration with investment teams Optimizing data pipelines , automating complex workflows, and improving operational efficiency ✅ What You’ll Bring Proven experience in Python development , ideally within high-performance or data-intensive environments Understanding of More ❯
Posted:

Python Developer – Up to £180,000 + Bonus + Benefits

london, south east england, united kingdom
Hybrid / WFH Options
Hunter Bond
What You’ll Be Doing Designing, developing, and maintaining Python-based trading and research infrastructure Building bespoke analytics and visualization tools in close collaboration with investment teams Optimizing data pipelines , automating complex workflows, and improving operational efficiency ✅ What You’ll Bring Proven experience in Python development , ideally within high-performance or data-intensive environments Understanding of More ❯
Posted:

Backend Python Developer

London, United Kingdom
Hybrid / WFH Options
Adecco
month contract , inside IR35 , offering hybrid working (3 days onsite). Key Responsibilities Develop robust backend systems for Python-based web applications Integrate AI/ML components with data, infrastructure, and frontend systems Deliver high-quality, well-documented, and thoroughly tested code Monitor and enhance performance of tools and services Collaborate across technical teams to build end-to … end data pipelines Essential Skills Proven experience in Python backend development (e.g. FastAPI) Strong cloud-native development skills, ideally with Google Cloud Familiarity with DevOps practices, automated testing (e.g. pytest), and agile methodologies Passion for healthcare innovation and continuous learning Bonus: Background in biological sciences or pharmaceutical industry Preferred Skills Experience with Docker and multi-container architectures Exposure More ❯
Employment Type: Contract
Posted:

Backend Python Developer

London, South East, England, United Kingdom
Hybrid / WFH Options
Adecco
month contract , inside IR35 , offering hybrid working (3 days onsite). Key Responsibilities Develop robust backend systems for Python-based web applications Integrate AI/ML components with data, infrastructure, and frontend systems Deliver high-quality, well-documented, and thoroughly tested code Monitor and enhance performance of tools and services Collaborate across technical teams to build end-to … end data pipelines Essential Skills Proven experience in Python backend development (e.g. FastAPI) Strong cloud-native development skills, ideally with Google Cloud Familiarity with DevOps practices, automated testing (e.g. pytest), and agile methodologies Passion for healthcare innovation and continuous learning Bonus: Background in biological sciences or pharmaceutical industry Preferred Skills Experience with Docker and multi-container architectures Exposure More ❯
Employment Type: Contractor
Rate: Salary negotiable
Posted:

CTO // Co-Founder // Early Stage Engineer (LLMs, Go and React)

City of London, London, United Kingdom
GrowthStage
the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯
Posted:

CTO // Co-Founder // Early Stage Engineer (LLMs, Go and React)

London Area, United Kingdom
GrowthStage
the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯
Posted:

CTO // Co-Founder // Early Stage Engineer (LLMs, Go and React)

london, south east england, united kingdom
GrowthStage
the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯
Posted:

CTO // Co-Founder // Early Stage Engineer (LLMs, Go and React)

london (city of london), south east england, united kingdom
GrowthStage
the potential (or ambition) to lead technology at a company-defining level. 🔍 What You'll Do Build and own core infrastructure and backend systems Design and implement APIs, data models, and scalable services Collaborate closely with founders on product direction and technical architecture Ship code fast, validate assumptions, and iterate Lay the groundwork for the future engineering team … doesn’t scare you; in fact, you prefer it Experienced with cloud infrastructure — AWS, GCP, or similar; IaC (Terraform, Pulumi, etc.) is a plus Competent with databases and data modeling — SQL and NoSQL, designing schema for scale Comfortable writing tests and deploying production systems — you care about code quality and reliability ⭐ Bonus Experience (Not Required, but Valuable) Worked … enterprise customers Experience with applied machine learning or MLOps (not just academic or notebook-based work) Exposure to event-driven architectures, streaming systems (Kafka, etc.), or real-time data pipelines Frontend experience in React, TypeScript, or similar modern frameworks 📈 What We Offer Early-stage equity and the opportunity to shape foundational decisions High ownership, zero bureaucracy — build what More ❯
Posted:

Senior Back End Engineer

London, United Kingdom
W Talent
Senior Backend Engineer| AI x Data Systems Salary £80 to 100K plus equity A stealth start up backed by top investors is reimagining how data-driven workflows are built and automated with AI ( FS and Fintech ). We're looking for a Senior Backend Engineer to help design and scale core infrastructure powering next-gen, high … throughput data systems. The role: -Build and optimise ingestion pipelines, APIs, and query engines -Own data performance across PostgreSQL, ClickHouse, and Kafka -Shape architecture for large-scale, AI-powered data processing -Work closely with product and AI teams to ship fast and iterate You'll bring: -5+ years of backend experience (Python, Go … or Kotlin preferred) -Strong SQL and data modelling skills -Experience with distributed systems, streaming, or event-driven design -Curiosity about AI, data pipelines, and intelligent automation If you're excited by building reliable systems for AI-driven products and want to make an impact at an early stage - let's talk. More ❯
Employment Type: Permanent
Salary: £80000 - £100000/annum
Posted:

Lead Computer Vision Engineer

London Area, United Kingdom
Addition+
The role: Lead CV Model Development — Design, train, and optimise detection, recognition, segmentation, and tracking models, balancing accuracy, speed, and robustness for real-world retail environments. Enhance synthetic data pipelines to improve generalisation and domain adaptation. Advance Large Vision Models (LVM) — Improve performance, scalability, and adaptability of our in-house LVM for diverse retail use cases. Deliver Proven … to benchmarking and ongoing improvements. Collaborate Across Teams — Work with Product, Infrastructure, and Customer teams to integrate models into workflows. Provide technical leadership aligned with business goals. Champion Data & MLOps — Maintain high data quality standards and develop scalable automation systems for seamless deployment and experimentation. Lead a team of ML Engineers Requirements PhD (or equivalent) in … deploying large-scale CV models in production. Strong Python skills with PyTorch or TensorFlow expertise. Deep understanding of modern CV architectures, especially LVMs and Transformers. Experience with multimodal data (images, video, text) and MLOps workflows. Hands-on, self-directed, evidence-driven, and collaborative, with excellent communication skills for both technical and non-technical audiences This is an excellent More ❯
Posted:

Lead Computer Vision Engineer

City of London, London, United Kingdom
Addition+
The role: Lead CV Model Development — Design, train, and optimise detection, recognition, segmentation, and tracking models, balancing accuracy, speed, and robustness for real-world retail environments. Enhance synthetic data pipelines to improve generalisation and domain adaptation. Advance Large Vision Models (LVM) — Improve performance, scalability, and adaptability of our in-house LVM for diverse retail use cases. Deliver Proven … to benchmarking and ongoing improvements. Collaborate Across Teams — Work with Product, Infrastructure, and Customer teams to integrate models into workflows. Provide technical leadership aligned with business goals. Champion Data & MLOps — Maintain high data quality standards and develop scalable automation systems for seamless deployment and experimentation. Lead a team of ML Engineers Requirements PhD (or equivalent) in … deploying large-scale CV models in production. Strong Python skills with PyTorch or TensorFlow expertise. Deep understanding of modern CV architectures, especially LVMs and Transformers. Experience with multimodal data (images, video, text) and MLOps workflows. Hands-on, self-directed, evidence-driven, and collaborative, with excellent communication skills for both technical and non-technical audiences This is an excellent More ❯
Posted:

Lead Computer Vision Engineer

london, south east england, united kingdom
Addition+
The role: Lead CV Model Development — Design, train, and optimise detection, recognition, segmentation, and tracking models, balancing accuracy, speed, and robustness for real-world retail environments. Enhance synthetic data pipelines to improve generalisation and domain adaptation. Advance Large Vision Models (LVM) — Improve performance, scalability, and adaptability of our in-house LVM for diverse retail use cases. Deliver Proven … to benchmarking and ongoing improvements. Collaborate Across Teams — Work with Product, Infrastructure, and Customer teams to integrate models into workflows. Provide technical leadership aligned with business goals. Champion Data & MLOps — Maintain high data quality standards and develop scalable automation systems for seamless deployment and experimentation. Lead a team of ML Engineers Requirements PhD (or equivalent) in … deploying large-scale CV models in production. Strong Python skills with PyTorch or TensorFlow expertise. Deep understanding of modern CV architectures, especially LVMs and Transformers. Experience with multimodal data (images, video, text) and MLOps workflows. Hands-on, self-directed, evidence-driven, and collaborative, with excellent communication skills for both technical and non-technical audiences This is an excellent More ❯
Posted:

Lead Computer Vision Engineer

london (city of london), south east england, united kingdom
Addition+
The role: Lead CV Model Development — Design, train, and optimise detection, recognition, segmentation, and tracking models, balancing accuracy, speed, and robustness for real-world retail environments. Enhance synthetic data pipelines to improve generalisation and domain adaptation. Advance Large Vision Models (LVM) — Improve performance, scalability, and adaptability of our in-house LVM for diverse retail use cases. Deliver Proven … to benchmarking and ongoing improvements. Collaborate Across Teams — Work with Product, Infrastructure, and Customer teams to integrate models into workflows. Provide technical leadership aligned with business goals. Champion Data & MLOps — Maintain high data quality standards and develop scalable automation systems for seamless deployment and experimentation. Lead a team of ML Engineers Requirements PhD (or equivalent) in … deploying large-scale CV models in production. Strong Python skills with PyTorch or TensorFlow expertise. Deep understanding of modern CV architectures, especially LVMs and Transformers. Experience with multimodal data (images, video, text) and MLOps workflows. Hands-on, self-directed, evidence-driven, and collaborative, with excellent communication skills for both technical and non-technical audiences This is an excellent More ❯
Posted:

Software Engineer

London Area, United Kingdom
Hadte Group
quo, building products people love, and having fun along the way. We’re looking for a talented Python Engineer who’s passionate about creating an exceptional real-time data platform that will process and deliver data instantaneously; allowing for instant insights and actions. In finance, these systems are crucial because markets move very quickly, and delays … of even milliseconds can have big consequences. Essential skills: 3+ years of experience in Python development. 3+ with open-source real-time data feeds (Amazon Kinesis, Apache Kafka, Apache Pulsar or Redpanda) Exposure building and managing data pipelines in production. Experience integrating serverless functions (AWS, Azure or GCP). Passion for fintech and building products that … make a real difference. Day to day: Develop and maintain our real-time data streaming pipelines. Write clean, reusable and scalable code. Optimise performance and troubleshoot issues across the platform. Stay up to date with the latest development trends and tools. Collaborate with product and engineering to deliver high-quality features. Benefits: Opportunity to shape a product used More ❯
Posted:

Software Engineer

City of London, London, United Kingdom
Hadte Group
quo, building products people love, and having fun along the way. We’re looking for a talented Python Engineer who’s passionate about creating an exceptional real-time data platform that will process and deliver data instantaneously; allowing for instant insights and actions. In finance, these systems are crucial because markets move very quickly, and delays … of even milliseconds can have big consequences. Essential skills: 3+ years of experience in Python development. 3+ with open-source real-time data feeds (Amazon Kinesis, Apache Kafka, Apache Pulsar or Redpanda) Exposure building and managing data pipelines in production. Experience integrating serverless functions (AWS, Azure or GCP). Passion for fintech and building products that … make a real difference. Day to day: Develop and maintain our real-time data streaming pipelines. Write clean, reusable and scalable code. Optimise performance and troubleshoot issues across the platform. Stay up to date with the latest development trends and tools. Collaborate with product and engineering to deliver high-quality features. Benefits: Opportunity to shape a product used More ❯
Posted:

Software Engineer

london, south east england, united kingdom
Hadte Group
quo, building products people love, and having fun along the way. We’re looking for a talented Python Engineer who’s passionate about creating an exceptional real-time data platform that will process and deliver data instantaneously; allowing for instant insights and actions. In finance, these systems are crucial because markets move very quickly, and delays … of even milliseconds can have big consequences. Essential skills: 3+ years of experience in Python development. 3+ with open-source real-time data feeds (Amazon Kinesis, Apache Kafka, Apache Pulsar or Redpanda) Exposure building and managing data pipelines in production. Experience integrating serverless functions (AWS, Azure or GCP). Passion for fintech and building products that … make a real difference. Day to day: Develop and maintain our real-time data streaming pipelines. Write clean, reusable and scalable code. Optimise performance and troubleshoot issues across the platform. Stay up to date with the latest development trends and tools. Collaborate with product and engineering to deliver high-quality features. Benefits: Opportunity to shape a product used More ❯
Posted:

Software Engineer

london (city of london), south east england, united kingdom
Hadte Group
quo, building products people love, and having fun along the way. We’re looking for a talented Python Engineer who’s passionate about creating an exceptional real-time data platform that will process and deliver data instantaneously; allowing for instant insights and actions. In finance, these systems are crucial because markets move very quickly, and delays … of even milliseconds can have big consequences. Essential skills: 3+ years of experience in Python development. 3+ with open-source real-time data feeds (Amazon Kinesis, Apache Kafka, Apache Pulsar or Redpanda) Exposure building and managing data pipelines in production. Experience integrating serverless functions (AWS, Azure or GCP). Passion for fintech and building products that … make a real difference. Day to day: Develop and maintain our real-time data streaming pipelines. Write clean, reusable and scalable code. Optimise performance and troubleshoot issues across the platform. Stay up to date with the latest development trends and tools. Collaborate with product and engineering to deliver high-quality features. Benefits: Opportunity to shape a product used More ❯
Posted:

Senior Frontend Engineer – 3D Visualization (React, WebGL, Python)

London, South East, England, United Kingdom
US TECH SOLUTIONS LIMITED
drive frontend architecture decisions. Experience building interactive, visual, or media-rich web applications. Desirable (Nice to Have): Experience working with scientific or research-based datasets . Knowledge of data pipelines and structured data processing. Familiarity with performance tuning for high-resolution visualizations in browsers. Exposure to AI/ML workflows, even if not building models directly. More ❯
Employment Type: Contractor
Rate: £44.00 - £46.00 per hour
Posted:
Data Pipeline
London
10th Percentile
£46,000
25th Percentile
£61,250
Median
£80,000
75th Percentile
£97,500
90th Percentile
£122,500