251 to 275 of 296 Data Pipeline Jobs in London

firms and systematic hedge funds. These organizations operate at the absolute bleeding edge of technology, treating the global financial markets as a complex data science problem. They are deploying massive compute clusters and proprietary machine learning models to trade billions of dollars daily. If you're an engineer … compute layers, squeezing maximum efficiency out of hardware. Build World-Class Observability: Create robust monitoring and telemetry systems to provide real-time insights into pipeline health, trading activity, and model behavior. Work with the Best: Work side-by-side with world-class researchers and mathematicians to translate theoretical strategies ...

growing our AI capabilities and we’re looking for curious problem solvers who love turning data into decisions. If you enjoy spotting patterns, learning to write code, and testing ideas with evidence, this is where you’ll make a difference. Role During this programme, you’ll work … areas such as below work as part of team to become expert-level data and AI talent: AI Adoption & Enablement – helping shape, test and improve ML models, data pipelines, or automation solutions Data & Insights – partnering with product, operations or customer facing teams to understand ...

Technical Data Architect Location: London (3 Days in Office) Salary: £95,000 Shape a first-of-its-kind national platform from the ground up, driving the technical architecture behind a transformative new digital content marketplace. The Opportunity The company is a forward-thinking public initiative focused on building … national leadership, giving the team the chance to influence strategy, direction, and long-term impact. The organisation is dedicated to delivering transparency, ethical data use, and high-quality standards across the digital content ecosystem. It brings together multidisciplinary experts to prototype, test, and shape a platform with ...

Data Engineer - Contract Location: Fully Remote (Occasional half-day on-site optional) Duration: 3 - 6 months Day Rate: Outside IR35 We're looking for a hands-on Data Engineer who can do more than just deliver-someone who brings best practice and thinks creatively. This … strong people culture, where collaboration and a sense of humor are part of the day-to-day. Key Responsibilities: Design and implement robust data models Optimise performance across data pipelines Deliver high-quality solutions with a focus on scalability and efficiency Provide guidance on best practices ...

knowledge of current approaches and industry trends. and • Experience in Metaheuristic optimisation (essential) • Experience with AI/ML Techniques • Exposure to cloud-based data pipelines for large-scale test data processing for Data Centres. The successful candidate could be straight ...

sophisticated Retrieval-Augmented Generation (RAG) systems, leveraging advanced techniques like embeddings with Voyage AI, rerankers , and query enrichment . Designing and maintaining efficient data pipelines and vector storage solutions using MongoDB Atlas Vector Search. Fine-tuning LLMs on custom datasets to enhance performance for specialized tasks related … Proven experience building and deploying applications with LLM APIs such as OpenAI , Anthropic , Gemini , and DeepSeek . Hands-on experience with the full RAG pipeline, including vector embeddings , rerankers , and data indexing in databases like MongoDB. Practical knowledge of LLM fine-tuning, prompt engineering, and performance optimization. ...

models and trading logic into robust production-ready software Develop internal tools and interfaces used directly by front-office trading teams Improve market data ingestion, exchange connectivity, and real-time data flows Contribute to distributed systems, low-latency communication, and performance tuning initiatives Take part … Physics, Engineering, or a related discipline (graduating between December 2025 and June 2026) Strong programming capability in C++ and Python Solid foundations in data structures, algorithms, and operating systems Comfortable working in Linux/Unix environments A strong focus on writing clean, efficient, and maintainable code Excellent analytical ...

LLMs) for business use cases using prompt engineering and reinforcement learning. Experiment with model configurations to balance performance, cost, and scalability. Build robust data pipelines for continuous model improvement and retraining. Ensure compliance with ethical AI and data governance standards (privacy, bias mitigation). Develop APIs … Required Skills Programming: Python, .NET/C# (Key to have a background in C#) Knowledge of AI principles and AI ethics Knowledge of data safety in LLM usage Experience with: AWS: boto3, Bedrock, SageMaker, Lambda, S3, EC2 Azure: Azure OpenAI Service, Cosmos DB Retrieval-Augmented Generation (RAG), Graph ...

Senior Backend Engineer , you’ll play a key role in building scalable, high-performance backend systems that ingest, process, and serve data on millions of assets—helping global security teams uncover exposures before attackers do. What you’ll be doing: Designing and building backend services and data pipelines powering a cutting-edge cybersecurity platform Architecting scalable microservices and APIs to process massive volumes of security data Working closely with product and frontend teams to integrate backend services into the platform experience Continuously improving systems performance, deployment, and monitoring as the company scales globally ...

operational resource allocation. Designing automated PowerBI dashboards using DAX and Power Query to track KPIs and tribunal performance. Maintaining high standards of data integrity and quality, ensuring compliance with public sector governance and GDPR. Translating complex datasets into plain-language reports and visualisations for senior leadership Build efficient … data pipelines and automate workflows to streamline reporting and improve organizational resilience. Conduct forecasting and trend analysis to identify operational anomalies and support long-term service planning. Profile Public Sector Experience: Proven track record of analyzing large datasets within a government or regulatory environment. Skills in Power ...

it. Use frontend frameworks such as shadcn and tailwind-ui to build features without the need for high-fidelity designs. Working with our data team to surface insights in usable interfaces. Improving deployment pipelines and infrastructure (AWS, Terraform). Shipping iteratively and responding to customer feedback quickly. Collaborating … directly with the platform and data teams to ensure seamless integration. Building a comprehensive understanding of our existing products and identifying areas for enhancement. Where required, helping with DevOps tasks and infrastructure automation. Documenting implementation processes clearly and concisely. Contributing to product discussions, bringing innovative solutions to complex ...

Designing, developing, and maintaining Python-based trading and research infrastructure Building bespoke analytics and visualization tools in close collaboration with investment teams Optimizing data pipelines , automating complex workflows, and improving operational efficiency ✅ What You’ll Bring Proven experience in Python development , ideally within high-performance or data ...

redefining what is possible in genomics, therapeutics, nutrition, and agriculture. Having recently closed a significant round of funding, they have scaled their data asset tenfold, creating one of the world’s largest biological datasets. The team comprises biologists, engineers, ML researchers, and field scientists who collaborate across disciplines … ability to manage complex projects across multiple teams. Strong organisational, planning, and communication skills. Familiarity with cloud infrastructure (e.g., AWS), CI/CD, data pipelines, or other modern technical workflows. Experience managing external vendors or technical partners. Proactive, adaptable, and able to thrive in a fast-moving environment. ...

Senior Data/Backend Engineer: Shaping the Future of Audio Safety Our client is looking for a Senior Data Engineer to join their Centralized Safety Team as they scale their GenAI and recommendation features, they remain safe and enjoyable for millions of global listeners. … seeking a 'T-shaped' engineer-someone with a deep foundation in large-scale data pipelines who is also passionate about operating mission-critical backend services (or vice versa). You will architect 'Tier 0' services that filter and protect content across Who You Are * Expertise: Deep knowledge ...

week) A leading global sports and entertainment brand is seeking an Product Manager to drive the roadmap for their AdTech platforms, ensuring innovative, data-driven solutions that connect brands with millions of fans worldwide. This is an exciting opportunity for a Product Manager to shape how advertising technology … ownership, with at least 2–3 years in AdTech or digital media. Strong knowledge of programmatic advertising, ad servers, DMPs, DSPs, and customer data platforms. Experience working with APIs, data pipelines, and integrations across AdTech/martech ecosystems. Understanding of data privacy and compliance ...

Role We are looking for a Head of Engineering to join a high-growth technology business operating at the forefront of large-scale data processing, machine learning and next-generation search experiences. In this role, you will lead multiple engineering teams across data … diverse and deeply technical organisation. Responsibilities Own the execution of the engineering roadmap across all product and platform areas Lead architectural direction for data processing, machine learning pipelines and web application development Ensure systems are scalable, reliable and capable of handling large-scale data and evolving ...

Senior Full Stack Engineer/Developer (TypeScript React Data) Remote UK to £90k Are you a data savvy Full Stack Engineer? You could be progressing your career in a senior, hands-on Senior Full Stack Engineer at a scaling Fintech who have built an energy trading … have React and Redux front end skills combined with backend JavaScript, TypeScript, Node.js and API experience You're comfortable working with complex, data rich environments, have a good appreciation of ETL data pipelines and LLMs (Large Language Models) You have previous experience within Fintech, Payments, eCommerce ...

Lead Data Engineer Permanent London (Hybrid) £90,000 - £110,000 Snowflake dbt Fivetran SQL Tableau Are you an expert in automated data pipelines and ready to own a next-generation, enterprise data platform? Method Resourcing have partnered exclusively with a market-leading digital ...

large enterprises manage large-scale, complex workflows with high accuracy and speed. Its modular multi‐agent AI architecture powers configurable workflow, automation, and data platform used by a broad range of enterprise customers, without being limited to a single vertical. The platform focuses on data validation … role In this role you will own a core enterprise B2B platform built on a modular framework for configuring AI workers, workflows, and data pipelines. You will combine strategic product ownership with hands‐on work on product development of the platform. You will partner closely with engineering ...

world. We are now looking for a CTO and co-founder to own the engineering vision and architecture, translate complex product and data requirements into scalable systems, and help build a world-class team in Dubai. Role You will be responsible for building the technical foundation … platform from the ground up. This includes system architecture, back-end design, data pipelines, AI integration, and infrastructure decisions across multiple regions. You will work directly with the founding team to transform a validated product and design into a robust, intelligent application ready for scale. What ...

understand the brain, to protect the brain from neurological disease and enhance the brain in health. We do this by generating our own data, building brain foundation models, and translating discovery to real clinical and research impact. Role focus As a Machine Learning Researcher, you will help design … train, and evaluate foundation models that learn from large-scale biological data (genomics, epigenomics, single-cell, proteomics, clinical signals). Depending on your strengths, you might skew more towards: Modelling & algorithms – new architectures, training objectives, scaling strategies, multi-task/multi-modal learning. Applied research – framing high-impact ...

What You Might Be Doing As an Full-stack Engineer at GSK, you could get involved with: Developing front-end applications and interactive data visualizations. Integrating AI/ML components with backend systems and data pipelines. Building and maintaining cloud-based infrastructure for large-scale applications. … disease with vaccines, specialty and general medicines. We focus on the science of the immune system and the use of new platform and data technologies, investing in four core therapeutic areas (infectious diseases, HIV, respiratory/immunology and oncology). Our success absolutely depends on our people. While ...

scale: over 2.5 billion visits a year, 23 million active customers, and 50 million unique visitors per month. You'll partner with Product, Data Science, and Design to build systems that are fast, relevant, and reliable, guiding the evolution of our discovery and customer experience platforms. The Details … relevance, and personalisation. Oversee category navigation and product catalogue systems to ensure customers can easily browse and find products at scale. Partner with Data Science to embed AI-driven experiences (e.g. AI Stylist) into the shopping journey. We believe being together in person helps us move faster, connect ...

scientific rigour, and a culture built around high impact and low ego. The successful candidate will work at the intersection of quantitative research, data engineering, and high-performance software development — with code that moves rapidly from prototype to production and directly influences trading performance. The Role … researchers to productionise models and design scalable research/tooling infrastructure Develop high-performance, robust code across Python and C++ Build and maintain data pipelines, research platforms, and components of the live trading stack Optimise system performance, reliability, and throughput across large-scale datasets Contribute to architectural decisions ...

scale - this one's for you. You'll develop and improve the internal tooling that researchers rely on daily: distributed compute workflows, data pipelines, and robust infrastructure that connects research code to real environments - including hardware/prototype devices on-site. What … Python tooling that supports ML research workflows Improve reliability: fix bugs, optimise performance, and ship iterative enhancements in sprints Integrate with distributed compute, data storage, and internal development systems Work closely with researchers as your "users" - gather requirements, translate ambiguity into working software Write clean, maintainable code ...