51 to 72 of 72 Data Pipeline Jobs in the City of London

Database Data Engineer | London (3 days a week onsite) | up to £100,000 Peaple Talent have partnered with a forward-thinking financial services organisation transforming access to credit across the UK. With a strong reputation for customer trust and innovation, they’re now looking for a Data Engineer with deep database expertise to play a critical role in modernising and scaling their data platforms. 💻 The Role This is a database-heavy Data Engineer position where you’ll take ownership of designing, optimising and evolving production-critical systems across AWS. Particularly using ...

Marketing Data Analyst/Scientist (SQL) London/WFH to £80k 13 month FTC - July start Do you have expertise with analysing marketing data combined with excellent stakeholder management and communication skills? You could be progressing your career in an impactful Marketing Data Analyst … global FinTech/CFD trading company that has been consistently voted as one of the UKs top employers. As a Marketing Data Analyst/Scientist you will analyse marketing campaign performance across digital channels to drive insights, optimise campaigns and improve marketing effectiveness, collaborating with Product Managers ...

strong engineering capability is the bigger priority. What you will do Design and build core platform components including pricing services, APIs, and data pipelines Develop scalable ingestion and processing systems for market, macro, and time-series data Build internal tooling that improves how analytics and trading … platform What you will need Strong software engineering fundamentals across architecture, design, and quality practices 5+ years’ experience in platform engineering, quant development, data engineering, or software engineering within financial services Strong Python experience in production environments Exposure to C++ or Rust would be beneficial for performance-sensitive ...

Google Cloud, or Azure. Knowledge of containerization and orchestration tools like Docker and Kubernetes is a plus. Experience designing end to end ML data pipelines. Experience with database technologies such as PostgreSQL, MySQL, or MongoDB, Spark, Databricks and stream data processing such as Kafka, RedPanda … stay up-to-date with the state-of-the-art open source infrastructure solutions applicable to designing and improving large scale recommender systems, data engineering, and machine learning You have a Master’s or PhD in Computer Science, statistics, or an engineering field with 5+ years of experience ...

hire a Senior Software Engineer for an exciting AI startup. This is a core platform role with real ownership. You will work on data integrations, platform execution, and the systems that power AI-driven analytics. What You Will Be Doing Building core data integrations with common … SaaS platforms Designing data pipelines that ingest provider APIs into our analytics datastore Improving the agent platform and executor with better error handling, observability, and speed Making LLM interactions more efficient through prompts, snippets, and tooling Improving internal developer experience and platform tooling Helping take an early ...

/Architect to drive enterprise AI initiatives. This role blends strategic leadership with hands-on solution design, working closely with Product, Engineering, and Data teams to deliver scalable, practical AI-driven capabilities. Key Responsibilities Identify and prioritize impactful AI/GenAI use cases with business leaders Define architectures … enabled solutions across data, applications, and workflows Provide hands-on technical leadership in prototyping, model integration, and validation Establish best practices for embedding AI/GenAI into development workflows Build reusable AI patterns and accelerators for enterprise adoption Align with data teams on readiness, governance ...

pair on, and review the development work of other lead software developers. You’ll work on the entire company's backend code base: data models, algorithms, data pipelines, infrastructure, APIs, complex database queries, ML models. Learn, use, and improve best practices and processes for high-quality ...

Design and build RESTful APIs, microservices, and event-driven architectures Integrate backend services with AI/LLM workflows and automation systems Build reliable data pipelines, background jobs, and operational services Lead backend engineering best practices, code reviews, and technical direction Mentor engineers and contribute to a strong engineering … culture Collaborate closely with Product, AI, and Data teams on system design and delivery Monitor, maintain, and improve performance, reliability, and observability across production systems Benefits of the role: Competitive salary + meaningful equity package Flexible hybrid working structure Opportunity to shape architecture and engineering culture from ...

Senior Data Engineer/GCP/Looker/Big Query £500 - 550 per day (Outside IR35) London/Hybrid (1 day a week) This is an opportunity for you to join a rapidly growing ecommerce business who are looking for a Senior Data Engineer to build … maintain data pipelines for a new reporting solution within the business. You'll be responsible for the build across ingestion, modelling and creating semantic layers using their GCP stack. Successful applicants will have experience with: Looker BigQuery GCP Gemini Exceptional candidates would have worked with: Retail Data ...

expert-led technology and consulting. Across both our technology and consulting services, Novatus delivers practical solutions to some of the most complex regulatory, data and operational challenges in financial services. Our SaaS platform, En>ACT ( short for Ensuring Accurate, Complete and Timely reporting ), is a market-leading solution … model delivers consulting services to solve complex challenges, combining deep expertise, ownership and delivery to create lasting change. Our expertise spans Strategy & Operations, Data & AI, Risk & Resilience, Compliance, Transaction Reporting, and ESG. We embed ourselves within client teams to deliver both insight and execution, taking ownership of outcomes ...

trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that … closely with researchers. This includes curating code examples, providing precise solutions, and making corrections — with a primary focus on Python across backend services, data pipelines, and ML infrastructure, alongside JavaScript (including ReactJS), C/C++, Java, Rust, and Go. You will evaluate and refine AI-generated code ...

SOAR playbooks to automate investigation and response workflows Support onboarding of log sources into SIEM, ensuring accurate parsing and normalisation Optimise search performance, data pipelines, and platform efficiency Troubleshoot issues across SIEM/SOAR environments (data ingestion, alerting, integrations, automation workflows) Collaborate with Detection Engineers … operationalise detection use cases Implement enrichment workflows incorporating threat intelligence, asset context, and identity data Support incident response through effective automation and data availability Maintain clear and comprehensive documentation for configurations, integrations, and playbooks Required Skills & Experience Minimum 3+ years of commercial experience in SOC, SIEM ...

arisen for an experienced KDB Developer to work alongside their Quants and Traders. This is an exciting opportunity to take ownership of critical data and analytics capabilities in a business where your work will directly support front-office decision-making, research, and platform performance. In addition … months. THE ROLE: KDB Developer This position sits within a small, highly capable team focused on building, improving and supporting the firms data environment. The successful candidate will play a key role in designing and developing scalable data collection and analytics solutions, while helping ensure ...

Role The Senior Technical Product Manager will own and build lifecycle and retention capabilities end-to-end, combining product thinking, technical execution, and data-driven experimentation to unlock sustained user growth. Role Highlights Design and launch AI-driven lifecycle journeys with minimal engineering support Architect and optimise … programmes across the full customer lifecycle Integrate APIs, tools, and data pipelines to deliver personalised experiences Run structured experiments to improve retention, engagement, and revenue Collaborate closely with growth, data, and engineering leadership You Will Need Proven ability to build and ship technical products independently Strong ...

intelligent pipelines that handle thousands of concurrent operations. Design and implement core backend systems including APIs, databases, event processing, and real-time data pipelines that support the product. Collaborate with frontend engineers and product leadership to translate customer needs into technical architecture and implementation. Own reliability and performance … from real users, and continuously improve what you build. Work on systems at scale : Build the dialer infrastructure, agent systems, intelligence pipelines, and data processing engines that only a few companies have needed to construct. What we're looking for Strong technical foundation : You've built complex systems ...

leading energy technology platform to hire their first Head of Applied AI Research . The energy grid is one of the most complex, data-rich, highest-stakes systems on the planet. Our client has built the operating system for it. You've likely heard of them through their … flagship client, who powers 40% of the UK energy market. They process 15 billion data points daily across 70 million households worldwide, hold $500m in contracted ARR, and are expanding rapidly across Europe, Australia, Japan and the US. They are, by any measure, the leading AI-driven energy ...

powered product features, including the intent and routing logic that sits at the core of the platform – Own third-party integrations and data partnerships that expand our reach and signal quality – Keep the product knowledge base structured, current, and useful for the whole team – Contribute … products and made hard calls under ambiguity – Enough engineering ability to review code, prototype features, and pressure-test technical decisions – Comfortable with APIs, data pipelines, and integration work – Excellent written communication — specs, pitches, and user-facing copy – High EQ — able to work across engineers, designers, and external partners ...

directly impact user experience. What you'll be doing: → Design, train and optimise ML models for personalisation and recommendations → Build and maintain scalable data pipelines for feature engineering and model training → Deploy and monitor models in production — performance, availability, relevance → Lead A/B testing and offline experiments … + TensorFlow or PyTorch ✦ Kubeflow, TFX or similar training frameworks ✦ Model serving experience — Triton, TorchServe, TF Serving ✦ Real-time streaming and high-volume data processing ✦ Strong grasp of recommendation systems and personalisation algorithms ✦ Familiarity with Generative AI in production settings If this sounds like your kind of challenge ...

trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that … closely with researchers. This includes curating code examples, providing precise solutions, and making corrections — with a primary focus on Python across backend services, data pipelines, and ML infrastructure, alongside JavaScript (including ReactJS), C/C++, Java, Rust, and Go. You will evaluate and refine AI-generated code ...

concept into scalable production systems Align machine learning initiatives with product, commercial, and operational goals Advise on architecture across LLMs, agentic systems, MLOps, data pipelines, and model deployment environments Support leadership teams with AI roadmap prioritisation, delivery oversight, and capability planning Improve collaboration between product, data … investors Identify gaps across teams, tooling, and operating models to improve execution maturity Qualifications 10+ years of experience across machine learning, AI, or data-driven environments Experience leading ML teams within production-scale businesses Strong understanding of LLMs, MLOps, AI platform architecture, and scalable ML systems Experience operating ...

understanding of .NET memory management internals - GC generations, LOH, pinned objects, finalisation, and how allocation patterns affect runtime behaviour Experience optimising high-throughput data processing pipelines - including async/await patterns, Channel, pipelines, and avoiding synchronisation bottlenecks Proven ability to diagnose large dataset query performance issues across both … allocation patterns, LOH fragmentation, finaliser queues, and GC tuning (gen0/1/2, server vs. Workstation, DATAS) Investigate and optimise high-throughput data pipelines - batch processing, streaming patterns, buffer management, and backpressure handling Identify and resolve large dataset query performance issues - index utilisation, query plan analysis, pagination ...

discovery through sprint planning to build, ensuring architecture is integral and practical. Lead the AI design agenda by designing platforms, integration patterns, and data flows that support AI capabilities in the Specialty business. Interface with global Enterprise Architecture to adopt standards beneficial to the UK business while protecting … placing platforms and integration patterns (Whitespace, PPL, API ecosystem). Strong knowledge of market messaging standards such as ACORD (MRC, AL3) and structured data initiatives like Blueprint Two. Experience with post-bind and processing architecture including policy administration, endorsements, premium flows, and carrier settlement. Expertisein delegated authority system ...