651 to 675 of 1,426 Data Pipeline Jobs in London

Functions, and serverless architectures. Hands‐on experience with Python development for automation, API integrations, scripting, and cloud‐native application development. Experience building AI data pipelines, including document ingestion, preprocessing, metadata enrichment, chunking, embedding generation, vector indexing, and retrieval workflows. Familiarity with AI prompt development, prompt tuning, prompt templates ...

Develop and deploy AI-powered features in production , including RAG (Retrieval-Augmented Generation) systems, multi-agent infrastructure, and evaluation frameworks (Evals) . Create data pipelines for AI model training, evaluation, and continuous improvement. Mentor junior developers and promote engineering best practices. Required Qualifications 5+ years of professional software ...

What You’ll Do Design & Build robust software systems – develop scalable backend services and APIs that power our AI-driven applications. Develop & Optimise data pipelines – implement efficient, reliable systems for ingesting, processing, and serving financial data. Engineer Cloud-Native Solutions on AWS (Lambda, ECS/EKS, S3, Redshift ...

Develop and deploy AI-powered features in production , including RAG (Retrieval-Augmented Generation) systems, multi-agent infrastructure, and evaluation frameworks (Evals) . Create data pipelines for AI model training, evaluation, and continuous improvement. Mentor junior developers and promote engineering best practices. What you can expect ...

Have: Experience building or integrating LLM-powered features in production (RAG pipelines, agent workflows, evaluation frameworks) Familiarity with sports tech, real-time data pipelines, or performance-sensitive consumer applications Experience with infrastructure-as-code or deployment automation Location Candidate can be located in London Ontario with occasional travel ...

systems and CI/CD pipelines. REST API Services: Proficient in designing and consuming RESTful web services. Kafka: Skilled in implementing real‐time data pipelines and messaging systems. Splunk: Expertise in monitoring, logging, and troubleshooting application performance. Team Leadership: Proven experience in leading, mentoring, and managing development teams. ...

technologies Designing solutions across AWS and GCP Building AI services using AWS Bedrock Evaluating and integrating foundation models and LLM platforms Building APIs, data pipelines and integrations between AI services and existing enterprise systems Leading technical decisions around scalability, performance, security and AI governance Taking AI prototypes ...

Responsibilities Design, train, and evaluate deep learning models for computer vision tasks (e.g., classification, detection, segmentation, tracking, retrieval...). Build and maintain scalable data pipelines for training and evaluation. Optimize model architectures for performance, accuracy, and efficiency (e.g., pruning, quantization, distributed training). Contribute to research and prototyping ...

Understand defence and security users' needs in situational awareness and force protection, then scope solutions Design, build, and deploy Palantir Foundry data pipelines, ontology models, and operator-facing applications Integrate live intelligence into existing workflows, common operating pictures, and command-and-control tooling Build and tune custom widgets … Highest-signal resume keywords Palantir Foundry Development Python Programming Docker Containerization Kubernetes Orchestration Solutions Engineering Experience ATS Optimization Keywords Hard Skills Data Pipeline Development Ontology Modeling Application Development SQL Programming Java Programming TypeScript Programming JavaScript Programming Bash Scripting Go Programming Networking Fundamentals Soft Skills Stakeholder Communication Problem ...

Hybrid working pattern - 2 days per week from London Bridge Office Hometrack is seeking an experienced Senior Data Engineer to join our product team to help us deliver Hometrack's Data Services ambitions. By building the best property data sets available, which back … open the door to helping all our customers make the decisions that matter to them - to buy, to lend, to build. The Data Services team works with 100s of customers across the property sector ranging from mortgage lenders, house builders, investors, fin & proptech, insurers, telco, retail and utilities ...

Start Date: ASAP Role Summary We are seeking an experienced Databricks Lead Engineer to drive the design, development, and optimization of enterprise-scale data platforms. The ideal candidate will have strong technical leadership capabilities, deep expertise in the Databricks Lakehouse platform, and a proven track record of delivering … robust data pipelines and architecture in complex environments. Key Responsibilities Lead the design and implementation of scalable data architectures on the Databricks Lakehouse platform. Oversee the development of efficient ETL/ELT pipelines using PySpark, SQL, and Delta Lake. Mentor and guide junior data ...

Build and maintain ingestion pipelines into the data warehouse using Fivetran and custom pipelines Own data orchestration to keep data moving on schedule and recover cleanly from failures Build and manage AWS-based data infrastructure as code with Terraform Build enterprise-grade … customer data pipelines and connectors for HR, payroll, and other systems Reliably and securely move customer data in and out at enterprise volumes Connect data to AI agents and services, including through MCP connectors Work with product and stakeholders to scope problems and agree ...

defence and security users to understand situational-awareness and force-protection needs Scope solutions for operational requirements Design, build, and deploy Palantir Foundry data pipelines, ontology models, and operator-facing applications Integrate live intelligence into existing workflows, common operating pictures, and command-and-control tooling Build and tune … standards. Highest-signal resume keywords Palantir Foundry Experience Python Programming Kubernetes Orchestration Security Clearance Solutions Engineering ATS Optimization Keywords Hard Skills Data Pipeline Development Ontology Modeling Application Development SQL Programming Java Programming TypeScript Programming JavaScript Programming Bash Scripting Go Programming Linux Fundamentals Soft Skills Stakeholder Communication Customer ...

About the TeamIt's an exciting time to join our rapidly growing Accounting team with ample development opportunities. We're growing the Revenue Data team with Engineering and Accounting Data openings to drive our automation and systems infrastructure and while keeping pace within … technical direction and fostering a high-performance culture within a fast-moving, high-stakes financial environment. Drive measurable improvements in data accuracy, pipeline reliability, and system scalability — directly enabling faster close cycles and audit readiness across the organization. We're excited about you because...You have 7+ years ...

Lead Data Engineer (Permanent, London on-site 4 Days) - Sponsorship is not available for this role A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used … property teams. This is a hands-on, high-ownership role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities. Start-up or Scale-up experience required coupled with a computing degree from a Russell Group university. ...

travel brands and businesses, including Tripadvisor, Viator, and TheFork. The AI & Business Intelligence Program Manager leads the end-to-end execution of data strategy and AI initiatives across Tripadvisor’s Travel Experiences. Positioning yourself at the intersection of business intelligence, product, and customer operations, you will translate complex … performance, traveler engagement trends, and BI dashboard metrics into executive-ready status updates. Orchestrate AI & BI Roadmaps: Direct complex, cross-functional programs spanning Data Engineering, AI/ML, Product, and Traveler CX teams to ensure business intelligence initiatives land on time. Deliver Operational Momentum: Maintain project management rigor ...

Lead Data Engineer (Permanent, London on-site 4 Days) - Sponsorship is not available for this role A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used … property teams. This is a hands-on, high-ownership role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities. Start-up or Scale-up experience required coupled with a computing degree from a Russell Group university. ...

platforms Handle and partner with external vendors/configuration centres to deliver scalable, compliant solutions globally Act as a link between engineering, product, data science ensuring solutions move beyond prototypes into sustainable production AI & Engineering Leadership Design, develop and maintain production-grade AI applications and services using modern … cloud-native design, CI/CD, testing, observability). Define and implement reusable AI platforms and capabilities (e.g. conversational assistants, AI search, unstructured data processing, GenAI solutions). Lead architectural decisions , ensuring responsible AI, explain ability, security, and operational robustness are embedded by design. Evaluate and integrate LLMs ...

Enfint is seeking a senior data engineer to design and build scalable SQL databases and cloud data solutions in Azure. You will develop data pipelines for analytics and ML workloads, collaborate with data scientists, and ensure governance and security across data platforms. The role requires 5+ years of experience in data engineering or database development, with strong SQL, data modelling, and Python skills. Flexible working options are available in Greater London. #J-18808-Ljbffr ...

Novo Nordisk in London is seeking a Sr Data Engineering Professional to develop data pipelines and data products for early research. You will bridge engineering excellence and scientific understanding, enabling data scientists and researchers to use complex datasets more effectively. You will … join Bio Data & AI Engineering within Data Foundations & Engineering as part of the larger AI & Digital Innovation organisation in R&D, collaborating with colleagues across the UK, Denmark and US. #J-18808-Ljbffr ...

Artefact, a global data services provider, is seeking a Senior Data Engineer to join its fast-growing team in London. You will design and scale data pipelines, mentor engineers, and align data solutions with business goals. You will work with SQL, Python … cloud-native tools like Databricks, Snowflake, and Airflow, shaping data governance and CI/CD practices while collaborating with analysts, architects and stakeholders. #J-18808-Ljbffr ...

Senior Data Scientist Location – London – Hybrid Salary - £70k – £82,5k + Benefits Please Note: Due to the AWESOME nature of this work, Applicants must hold a valid British passport - Duel Nationality wont be accepted - sorry Some data science roles are about optimising marketing campaigns or improving … recommendation engines, this isn't one of them. We're looking for an experienced Data Scientist to work on highly secure, technically demanding projects where the questions are complex, the data is challenging and the outcomes genuinely matter. You'll work alongside experts from a range ...

team. This is a strategic, hands-on engineering leadership role focused on designing and delivering scalable, cloud-native, event-driven platforms that enable data-driven and intelligent solutions across Jefferies' client-facing business units. The role will form part of the Madison CRM & Analytics programme and will require … workflows. This role is well suited to an engineer who is comfortable operating across the full technology stack, from backend services and distributed data architecture through to responsive user interfaces, production support, and engineering best practice. Key ResponsibilitiesLead the design, development, and delivery of backend services and platform ...

Security Operations team, you will help Ripple detect, investigate, and respond to security threats across our environment. You’ll work across detection and data engineering, incident response, and security automation — building the tooling and detection logic that lets the team scale. You’ll operate independently on sophisticated investigations … maintain security automation workflows (e.g., in Tines) that reduce manual toil in detection, triage, and response. Own and improve SIEM/data pipeline health, including log source coverage, parsing/normalization, and alert quality. Develop cross-functional relationships to influence security initiatives and drive adoption of security ...

Overview The Service Reporting Manager is responsible for transforming operational data into meaningful insights that enhance service delivery, efficiency, and customer experience. This role analyses ticket trends, performance metrics, and operational behaviours to drive process improvement, proactive problem management, and informed decision-making across the Service Desk … wider IT organisation. Responsibilities Data Analytics Design and deliver advanced analytics to identify trends, recurring issues, and opportunities for service improvement Define and implement best practices for data collection, storage and analysis. Develop predictive models and insights to support proactive problem management. Create dashboards and visuals ...